From hugh at davenport.net.nz Sat Dec 1 00:34:37 2012 From: hugh at davenport.net.nz (Hugh Davenport) Date: Sat, 01 Dec 2012 11:34:37 +1300 Subject: [Dovecot] Redelivery of mdbox messages to pass through sieve Message-ID: <9de555621a92f37172e259470ee76247@davenport.net.nz> Hey, I've been slack and haven't updated my sieve script for yonks, and finally got round to it. What I was wondering is whether there was a way to basically take all the messages from a folder and pass it through sieve again. I've found earlier messages in this list, but they were for Maildir format, not mdbox which I use now. Does anyone know of a way to do this? Cheers, Hugh From user+dovecot at localhost.localdomain.org Sat Dec 1 01:30:18 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 01 Dec 2012 00:30:18 +0100 Subject: [Dovecot] Redelivery of mdbox messages to pass through sieve In-Reply-To: <9de555621a92f37172e259470ee76247@davenport.net.nz> References: <9de555621a92f37172e259470ee76247@davenport.net.nz> Message-ID: <50B9418A.2040905@localhost.localdomain.org> On 11/30/2012 11:34 PM Hugh Davenport wrote: > Hey, > > I've been slack and haven't updated my sieve script for yonks, and > finally got round to it. > What I was wondering is whether there was a way to basically take all > the messages from a > folder and pass it through sieve again. I've found earlier messages in > this list, but they > were for Maildir format, not mdbox which I use now. > > Does anyone know of a way to do this? See sieve-filter(1) || http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html Regards, Pascal -- The trapper recommends today: cafefeed.1233600 at localdomain.org From hugh at davenport.net.nz Sat Dec 1 01:48:51 2012 From: hugh at davenport.net.nz (Hugh Davenport) Date: Sat, 01 Dec 2012 12:48:51 +1300 Subject: [Dovecot] Redelivery of mdbox messages to pass through sieve In-Reply-To: <50B9418A.2040905@localhost.localdomain.org> References: <9de555621a92f37172e259470ee76247@davenport.net.nz> <50B9418A.2040905@localhost.localdomain.org> Message-ID: On 2012-12-01 12:30, Pascal Volk wrote: > See sieve-filter(1) || > http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html Thanks muchly, I will look into this. Cheers, Hugh From mcp2000 at gmail.com Sat Dec 1 02:34:09 2012 From: mcp2000 at gmail.com (Sam DWH) Date: Sat, 01 Dec 2012 08:34:09 +0800 Subject: [Dovecot] =?utf-8?b?5Zue5aSN77yaICAyLjEuMTIgLSBQaWdlb25ob2xlIDAu?= =?utf-8?q?3=2E3_build_failed=3A_/usr/bin/ld=3A=09cannot_find_-lssl?= =?utf-8?q?_-lcrypto?= Message-ID: Did you installed openssh? Tobias Hachmer ??? >Hello list, > >Although timos bugfix release this morning I can't build pigeonhole 0.3.3 for >dovecot 2.1.12 successfully. I don't know if it is a new bug or if I do >something wrong but with dovecot 2.1.10 all worked fine, with the same configure >options. > >configure options (out of debian/rules for building debian package): > >./configure --with-dovecot=/usr/lib/dovecot \ > --host=$(DEB_HOST_GNU_TYPE) \ > --build=$(DEB_BUILD_GNU_TYPE) \ > --prefix=/usr \ > --sysconfdir=/etc \ > --libexecdir=\$${prefix}/lib \ > --localstatedir=/var \ > --mandir=\$${prefix}/share/man \ > --infodir=\$${prefix}/share/info \ > --with-moduledir=\$${prefix}/lib/dovecot/modules > > >buildlogextraction with error, the full log is available here: >https://launchpadlibrarian.net/124478979/buildlog_ubuntu-precise- >amd64.dovecot-2.1-pigeonhole_0.3.3-7~kokelnet~precise_FAILEDTOBUILD.txt.gz > >Thanks in advance for any help, >Tobias Hachmer > >Making all in lib-sieve-tool >make[4]: Entering directory `/build/buildd/dovecot-2.1- >pigeonhole-0.3.3/src/lib-sieve-tool' >/bin/bash ../../libtool --tag=CC --mode=compile x86_64-linux-gnu-gcc - >DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-sieve -I/usr/include/dovecot - >D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer- >size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes -Wmissing- >declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast >-fno-builtin-strftime -Wstrict-aliasing=2 -MT sieve-tool.lo -MD -MP -MF >.deps/sieve-tool.Tpo -c -o sieve-tool.lo sieve-tool.c >libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - >I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g >-O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - >Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- >subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- >aliasing=2 -MT sieve-tool.lo -MD -MP -MF .deps/sieve-tool.Tpo -c sieve-tool.c >-fPIC -DPIC -o .libs/sieve-tool.o >libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - >I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g >-O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - >Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- >subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- >aliasing=2 -MT sieve-tool.lo -MD -MP -MF .deps/sieve-tool.Tpo -c sieve-tool.c >-o sieve-tool.o >/dev/null 2>&1 >mv -f .deps/sieve-tool.Tpo .deps/sieve-tool.Plo >/bin/bash ../../libtool --tag=CC --mode=compile x86_64-linux-gnu-gcc - >DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-sieve -I/usr/include/dovecot - >D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer- >size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes -Wmissing- >declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast >-fno-builtin-strftime -Wstrict-aliasing=2 -MT mail-raw.lo -MD -MP -MF >.deps/mail-raw.Tpo -c -o mail-raw.lo mail-raw.c >libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - >I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g >-O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - >Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- >subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- >aliasing=2 -MT mail-raw.lo -MD -MP -MF .deps/mail-raw.Tpo -c mail-raw.c -fPIC >-DPIC -o .libs/mail-raw.o >libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - >I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g >-O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - >Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- >subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- >aliasing=2 -MT mail-raw.lo -MD -MP -MF .deps/mail-raw.Tpo -c mail-raw.c -o >mail-raw.o >/dev/null 2>&1 >mv -f .deps/mail-raw.Tpo .deps/mail-raw.Plo >/bin/bash ../../libtool --tag=CC --mode=link x86_64-linux-gnu-gcc - >std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat- >security -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >-Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime - >Wstrict-aliasing=2 -Wl,-Bsymbolic-functions -Wl,-z,relro -o libsieve-tool.la >sieve-tool.lo mail-raw.lo -lrt >libtool: link: ar cru .libs/libsieve-tool.a .libs/sieve-tool.o .libs/mail- >raw.o >libtool: link: ranlib .libs/libsieve-tool.a >libtool: link: ( cd ".libs" && rm -f "libsieve-tool.la" && ln -s "../libsieve- >tool.la" "libsieve-tool.la" ) >make[4]: Leaving directory `/build/buildd/dovecot-2.1- >pigeonhole-0.3.3/src/lib-sieve-tool' >Making all in sieve-tools >make[4]: Entering directory `/build/buildd/dovecot-2.1- >pigeonhole-0.3.3/src/sieve-tools' >x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-sieve - >I../../src/lib-sieve-tool -I./debug -I/usr/include/dovecot - >D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer- >size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes -Wmissing- >declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast >-fno-builtin-strftime -Wstrict-aliasing=2 -MT sievec.o -MD -MP -MF >.deps/sievec.Tpo -c -o sievec.o sievec.c >mv -f .deps/sievec.Tpo .deps/sievec.Po >/bin/bash ../../libtool --tag=CC --mode=link x86_64-linux-gnu-gcc - >std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat- >security -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >-Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime - >Wstrict-aliasing=2 -export-dynamic -Wl,-Bsymbolic-functions -Wl,-z,relro -o >sievec sievec.o ../../src/lib-sieve/libdovecot-sieve.la ../../src/lib-sieve- >tool/libsieve-tool.la -ldovecot-storage -lssl -lcrypto -ldovecot-lda - >L/usr/lib/dovecot -ldovecot -lrt >libtool: link: x86_64-linux-gnu-gcc -std=gnu99 -g -O2 -fstack-protector -- >param=ssp-buffer-size=4 -Wformat -Wformat-security -Wall -W -Wmissing- >prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 >-Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -Wl,-Bsymbolic- >functions -Wl,-z -Wl,relro -o .libs/sievec sievec.o -Wl,--export-dynamic >../../src/lib-sieve/.libs/libdovecot-sieve.so ../../src/lib-sieve- >tool/.libs/libsieve-tool.a /usr/lib/dovecot/libdovecot-storage.so -lssl - >lcrypto /usr/lib/dovecot/libdovecot-lda.so -L/usr/lib/dovecot >/usr/lib/dovecot/libdovecot.so -lrt -Wl,-rpath -Wl,/usr/lib/dovecot >/usr/bin/ld: cannot find -lssl >/usr/bin/ld: cannot find -lcrypto >collect2: ld returned 1 exit status >make[4]: *** [sievec] Error 1 >make[4]: Leaving directory `/build/buildd/dovecot-2.1- >pigeonhole-0.3.3/src/sieve-tools' >make[3]: *** [all-recursive] Error 1 >make[3]: Leaving directory `/build/buildd/dovecot-2.1-pigeonhole-0.3.3/src' >make[2]: *** [all-recursive] Error 1 >make[2]: Leaving directory `/build/buildd/dovecot-2.1-pigeonhole-0.3.3' >make[1]: *** [all] Error 2 >make[1]: Leaving directory `/build/buildd/dovecot-2.1-pigeonhole-0.3.3' >make: *** [build-stamp] Error 2 From lists at kokelnet.de Sat Dec 1 12:48:00 2012 From: lists at kokelnet.de (Tobias Hachmer) Date: Sat, 01 Dec 2012 11:48 +0100 Subject: [Dovecot] =?utf-8?b?5Zue5aSN77yaIDIuMS4xMiAtIFBpZ2VvbmhvbGUgMC4z?= =?utf-8?q?=2E3_build_failed=3A_/usr/bin/ld=3A=09cannot_find_-lssl_?= =?utf-8?q?-lcrypto?= In-Reply-To: References: Message-ID: <32248717.QcLt1kGcaM@tobias-pc> On Saturday 01 December 2012 08:34:09 Sam DWH wrote: > Did you installed openssh? Well, no, I have installed libssl-dev (Ubuntu Precise). What I have really done is to add the libssl-dev to the dependencies of my dovecot-dev package. This dovecot-dev package is a dependency of my pigeonhole package. Regards, Tobias From tlhackque at yahoo.com Sat Dec 1 17:59:58 2012 From: tlhackque at yahoo.com (tlhackque) Date: Sat, 01 Dec 2012 10:59:58 -0500 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions Message-ID: <50BA297E.4070104@yahoo.com> I have a (mbox/IMAP) directory under my mail directory with these permissions: drwxrws--- 4 tlhackque mail 4096 Dec 1 10:34 Vendors/ It contains a subdirectory: -rw-rw---- 1 thlackque mail 84805345 Dec 1 10:34 Vendors/AVendor If I try to rename the AVendor folder (client is Thunderbird 17.0), I get this error: Unable to rename across conflicting directory permisssions If I chmod g-s Vendors, the RENAME command succeeds. I shouldn't have to do this... Version and configuration information: dovecot --version 2.1.10 # OS: Linux 2.6.22.14-72.fc6 i686 Fedora Core release 6 (Zod) first_valid_gid = 4000 first_valid_uid = 4000 hostname = example.net login_greeting = Dovecot ready. Unauthorized access is prohibited. mail_access_groups = mail mail_location = mbox:~/mail:INBOX=/var/mail/%n mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { driver = pam } plugin { autocreate = Trash autocreate2 = Train As Spam autocreate3 = Train As Ham autocreate4 = Train As Forgotten autosubscribe = Trash autosubscribe2 = Train As Spam autosubscribe3 = Train As Ham autosubscribe4 = Train As Forgotten } service imap-login { inet_listener imap { address = imap.v4.example.net imap.v6.example.net port = 143 } inet_listener imaps { address = imap.v4.example.net imap.v6.example.net port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { address = pop.v4.example.net pop.v6.example.net port = 110 } inet_listener pop3s { address = pop.v4.example.net pop.v6.example.net port = 995 ssl = yes } } ssl_ca = References: <8EDD59BD-AC4B-442F-B148-285BC368B49B@iki.fi> <43B7D59A-BEE2-4954-862D-6B8DF521EB38@usc.edu> Message-ID: <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> On Nov 29, 2012, at 7:42 AM, Erik A Johnson wrote: >>>> No, the test to bug out doesn't work because net_geterror(proxy->fd_ssl) returns 0 in the statement >>>> >>>> if (!proxy->client_proxy && net_geterror(proxy->fd_ssl) == ENOTCONN) { I was wrong here: the FIRST time, net_geterror returns EBADF = "The argument socket is not a valid file descriptor" (and then 0 on subsequent calls). On November 29, 2012 at 12:43:42 PM PST, Timo Sirainen wrote: >>> I wonder if something like would work: >>> >>> if (!proxy->client && read(proxy->fd_ssl, &err, 0) < 0 && errno == ENOTCONN) { On November 29, 2012 at 2:12:18 PM PST, Ben Morrow wrote: >> How about calling getpeername on fd_ssl? That should reliably tell you >> if the socket is connected or not. http://cr.yp.to/docs/connect.html >> suggests that read is not always a reliable test for that. Thanks, Ben. On November 29, 2012 at 2:39:51 PM PST, Timo Sirainen wrote: > Yes, that sounds like it would work better: > > if (!proxy->client && net_getpeername(proxy->fd_ssl, NULL, NULL) < 0 && errno == ENOTCONN) { Using getpeername or net_getpeername, errno is set to EINVAL = "socket has been shut down", so we could instead use if (!proxy->client && net_getpeername(proxy->fd_ssl, NULL, NULL) < 0 && errno == EINVAL) { So it seems that we have the following options: 1. net_geterror(proxy->fd_ssl) == EBADF 2. read(proxy->fd_ssl, &err, 0) < 0 && errno == ENOTCONN 3. net_getpeername(proxy->fd_ssl, NULL, NULL) < 0 && errno == EINVAL Which is preferable? Should the "#ifdef __APPLE__" remain? or would any of these tests be appropriate for other platforms as well? On Nov 28, 2012, at 10:18PM PST, Timo Sirainen wrote: >>>>> This is either OSX bug or OpenSSL bug.. Apparently what happens is: >>>>> >>>>> 1. Client sends SYN packet to Dovecot >>>>> 2. Dovecot accept()s the connection (sends SYN-ACK) and goes into OpenSSL code >>>>> 3. Client doesn't send ACK to Dovecot. Does it send RST or nothing or something else? I don't know. >>>>> 4. OSX notices anyway that something is wrong with the socket, and kqueue says that the socket is ready for reading >>>>> 5. OpenSSL read()s, which fails with ENOTCONN. But OpenSSL thinks this is a non-fatal error and simply asks to be notified again when something can be read >>>>> 6. goto 4 >>>>> >>>>> So, whose bug is it? OpenSSL's ENOTCONN handling probably makes sense for client connections where connect() hasn't finished yet. But then again, this is accept()ed connection where it typically should fail like that. Except I guess it might be correct behavior if read() is done after SYN-ACK but before receiving ACK. >>>>> >>>>> While OSX is receiving ACK from the client, it shouldn't say that the fd is readable. It probably doesn't. But after it receives it realizes that the socket is disconnected. So read() probably shouldn't be returning ENOTCONN anymore at this point, but instead ECONNRESET or ETIMEDOUT. >>>>> >>>>> See if the attached patch helps. >>>>> >>>>> >>>>> On 29.11.2012, at 7.45, Erik A Johnson wrote: >>>>>> Here's the log: >>>>>> >>>>>> Nov 28 21:28:11 macbookpro-e17d.home dovecot[54139]: master: Dovecot v2.1.10 starting up (core dumps disabled) >>>>>> Nov 28 21:30:19 macbookpro-e17d.home dovecot[54141]: imap-login: Debug: ssl_step() >>>>>> Nov 28 21:30:19 macbookpro-e17d.home dovecot[54141]: imap-login: Debug: ssl_handshake: SSL_accept()=-1 >>>>>> Nov 28 21:30:19 macbookpro-e17d.home dovecot[54141]: imap-login: Debug: SSL_get_error() = 2 >>>>>> Nov 28 21:30:19 macbookpro-e17d.home dovecot[54141]: imap-login: Debug: - want_read >>>>>> Nov 28 21:30:19 macbookpro-e17d.home dovecot[54141]: imap-login: Debug: ssl_set_io(0) >>>>>> [last 5 lines are repeated until process is killed] >>>>>> >>>>>> On Nov 26, 2012, as 11:38PM PST, Timo Sirainen wrote: >>>>>>> >>>>>>> Could you try with the attached patch, and with only the problematic >>>>>>> client running? What does it log (the beginning of the session until it >>>>>>> starts repeating the same lines)? >>>>>>> >>>>>>> On 10.11.2012, at 12.44, Erik A Johnson wrote: >>>>>>>> imap-login processes are hanging (using 100% of CPU) when connected from a client that is partially blocked by a firewall. It appears that imap-login is stuck in a loop trying to complete an ssl handshake. imap-login is working fine for other clients not blocked by the firewall (including localhost). >>>>>>>> >>>>>>>> This is dovecot 2.1.10 under Mac OS X 10.8.2 (compiled from sources); the firewall is Little Snitch 3.0.1 blocking port 993, which appears to let the connection initiate but then squashes and disconnects the socket during ssl handshaking. >>>>>>>> >>>>>>>> gdb backtrace and Activity Monitor's "Sample Process" show that imap-login is stuck calling ioloop-kqueue's io_loop_handler_run -> io_loop_call_io -> ssl_step repeatedly; dtruss shows that it is repeatedly making system calls to kevent and read, the latter returning -1 with errno 57=ENOTCONN="Socket is not connected". (I also tried ./configure --with-ioloop=poll and --with-iopoll=select instead of the default best = kqueue but the results were the same; --with-iopoll=epoll didn't work because epoll is not available on this machine.) The client, initiated by the command "openssl s_client -connect SERVER:993", first responds "CONNECTED(00000003)" but then immediately the error "60278:error:140790E5:SSL routines:SSL23_WRITE:ssl handshake failure:/SourceCache/OpenSSL098/OpenSSL098-44/src/ssl/s23_lib.c:182:". The infinite loop is in src/lib/ioloop.c in the function "io_loop_run" where the statement "while (ioloop->running) io_loop_handler_run(ioloop)" is executed. >>> From ben at morrow.me.uk Sat Dec 1 21:07:36 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 1 Dec 2012 19:07:36 +0000 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> References: <8EDD59BD-AC4B-442F-B148-285BC368B49B@iki.fi> <43B7D59A-BEE2-4954-862D-6B8DF521EB38@usc.edu> <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> Message-ID: <20121201190736.GA91986@anubis.morrow.me.uk> At 10AM -0800 on 1/12/12 Erik A Johnson wrote: > > On November 29, 2012 at 2:39:51 PM PST, Timo Sirainen wrote: > > Yes, that sounds like it would work better: > > > > if (!proxy->client && net_getpeername(proxy->fd_ssl, NULL, NULL) < > > 0 && errno == ENOTCONN) { > > Using getpeername or net_getpeername, errno is set to EINVAL = "socket > has been shut down", so we could instead use > > if (!proxy->client && net_getpeername(proxy->fd_ssl, NULL, NULL) < > 0 && errno == EINVAL) { > > So it seems that we have the following options: > > 1. net_geterror(proxy->fd_ssl) == EBADF > 2. read(proxy->fd_ssl, &err, 0) < 0 && errno == ENOTCONN > 3. net_getpeername(proxy->fd_ssl, NULL, NULL) < 0 && errno == EINVAL > > Which is preferable? I think the djb page I mentioned before comes down in favour of if (!proxy->client && net_getpeername(...) < 0 && read(proxy->fd_ssl, &err, 1) < 0 && errno == ENOTCONN) { where the read is of 1 byte rather than 0 since a read of 0 apparently sometimes succeeds even if the socket isn't connected, and the getpeername is to protect against actually reading from a connected socket. However, doing all that every time we try to read seems like a lot of wasted effort; if possible, it would be better to identify the circumstances when it might happen (for instance, is it true that if we've done at least one successful SSL read on this socket that this error won't occur?). > Should the "#ifdef __APPLE__" remain? or would any of these tests be > appropriate for other platforms as well? I had a go at reproducing this on FreeBSD and failed, but I don't believe we've seen a packet trace yet so I wasn't entirely sure what might provoke it. There is definitely a bug in the OS here somewhere, unless the socket never gets as far as SYN-SYN/ACK-ACK, since ENOTCONN should only be returned *before* the socket has connected successfully. An ordinary disconnected socket should simply return EOF from read, and a socket that got RST should return ECONNRESET. Are you able to reproduce this and get a tcpdump packet trace (on the dovecot side of any firewalls)? Also, when this happens, does it happen straight away or is there a delay until the connection times out? (I don't suppose you know if the source for the OSX network stack is online anywhere? I'd be interested to see how different it is from FreeBSD's.) Ben From rhunen at xs4all.nl Sun Dec 2 22:30:27 2012 From: rhunen at xs4all.nl (Roger Hunen) Date: Sun, 02 Dec 2012 21:30:27 +0100 Subject: [Dovecot] Thunderbird SSL/TLS client authentication fails Message-ID: <50BBBA63.9090005@xs4all.nl> Hi, This is my first post to the list, so greetings to you all! I am seeking your help with SSL/TLS client authentication. I currently have the following setup: * Server: - Debian Squeeze (fully patched) - OpenSSL 0.9.8o - Dovecot v2.1.10 (Debian backport package from Wheezy) - SSL listener on port 993 with the Dovecot selfsigned certificate that was created during installation - Virtual users (user at domain.net) with password in passwd style file * Client: - Windows XP SP3 (fully patched) - Thunderbird 17.0 - IMAP account using "Normal password" authentication - Roundcube webmail (to be added soon) This works just fine :) ==> I now want to set Thunderbird to use "TLS certificate" authentication so that I can safely expose port 993 to the internet for mobile use. The idea is that clients with a trusted client certificate do not need a password so that I can change my password for Roundcube without having to change passwords on other IMAP clients (Roundcube will connect to localhost without SSL). To do so I did the following: - use XCA (v0.9.3, Windows version) to setup a private root CA with a CRL - export root CA certificate and CRL in PEM format and join them into a ca.pem file (order: certificate, CRL) - configure Dovecot to use the ca.pem file and require a client certificate - use XCA to generate a private key and certificate for commonName=user at mydomain.net - import certificate and private key into Thunderbird - change IMAP account setting in Thunderbird to use "TLS Certificate" authentication - When prompted, select the imported certificate to be used for authentication. Unfortunately the authentication fails :( Using "verbose_ssl=yes" I can see in the Dovecot logfile that Thunderbird connects and that the SSL handshake completes successfully. "Valid certificate" is logged for both client certificate and root CA certificate. This looks "so far so good" to me :) The Dovecot log has the following lines at the point of failure: imap-login: Warning: SSL alert: where=0x4004, ret=256: warning close notify [] imap-login: Warning: SSL alert: where=0x4008, ret=256: warning close notify [] imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=, lip=, TLS, session= (IP address and TLS session ID removed) The last log line ("user=<>") suggests that Dovecot does not try to use the commonName from the client certificate as the username even though (I think) I have configured Dovecot to do so. The relevant lines in the Dovecot configuration are: auth_mechanisms = plain auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes disable_plaintext_auth = yes protocols = imap ssl = yes ssl_ca = Observation: with "auth_ssl_require_client_cert = yes" Dovecot requires Thunderbird to send the client certificate even when Thunderbird uses "Normal password" authentication (authentication only fails if I delete the certificate from Thunderbird). So the SSL part looks OK to me. It seems that Dovecot is waiting for the client to logon over the established SSL/TLS connection instead of taking the username from the commonName in the certificate. ==> What could be going wrong here? I can post full config and logfile lines if you wnt to. Except for some possible oversight on my behalf there is nothing secret in there (I just didn't want to add too many lines to this already long post). Regards, -Roger From daniel.parthey at informatik.tu-chemnitz.de Sun Dec 2 23:18:48 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 2 Dec 2012 22:18:48 +0100 Subject: [Dovecot] Thunderbird SSL/TLS client authentication fails In-Reply-To: <50BBBA63.9090005@xs4all.nl> References: <50BBBA63.9090005@xs4all.nl> Message-ID: <20121202211848.GA12361@daniel.localdomain> Roger Hunen wrote: > I am seeking your help with SSL/TLS client authentication. > Unfortunately the authentication fails :( http://wiki2.dovecot.org/SSL/DovecotConfiguration states: "You may also want to disable the password checking completely. Doing this currently circumvents Dovecot's security model so it's not recommended to use it, but it is possible by making the passdb allow logins using any password (typically requiring "nopassword" extra field to be returned)." See http://wiki2.dovecot.org/PasswordDatabase/ExtraFields Regards Daniel -- https://plus.google.com/103021802792276734820 From jugree at lavabit.com Mon Dec 3 02:35:33 2012 From: jugree at lavabit.com (jugree at lavabit.com) Date: Sun, 2 Dec 2012 19:35:33 -0500 (EST) Subject: [Dovecot] IMAP+SSL Message-ID: <30460.62.113.219.3.1354494933.squirrel@lavabit.com> Hi. I've already posted on the list (0), but I can't access that account. I don't want to hijack that thread that's why I decided to create this one. > Please don't trim the doveconf -n output... > It shows the version of dovecot (so no one has to ask)... I'm using 1.2.15. (0) http://dovecot.org/pipermail/dovecot/2012-November/069665.html From daniel at dhag.net Mon Dec 3 10:11:12 2012 From: daniel at dhag.net (Daniel Funke) Date: Mon, 03 Dec 2012 09:11:12 +0100 Subject: [Dovecot] sieve problem after upgrade to 2.1.12 Message-ID: <50BC5EA0.7020802@dhag.net> Hi, I have a sieve filter for a mailbox with amavisd-admin mails. if header :regex "Subject" "^INVALID HEADER" { fileinto "INVALID HEADER"; } After the upgrade to dovecot 2.1.12 this filter doesn't work for some (16) messages with this subject. For 424 messages it worked correct. Any ideas where to look? Bye Daniel From hao.zhang at octlink.com Mon Dec 3 08:43:55 2012 From: hao.zhang at octlink.com (=?gb2312?B?1cXquw==?=) Date: Mon, 3 Dec 2012 14:43:55 +0800 Subject: [Dovecot] Connection closed by foreign host. Message-ID: <201212031443545441873@octlink.com> hi, when i telnet 127.0.0.1 110,input the username and password,echo the error: Connection closed by foreign host. THE CONFIG: [root at www fuse-dfs]# dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.el6.i686 i686 CentOS Linux release 6.0 (Final) listen = * login_trusted_networks = 10.12.0.0/16 mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } protocols = pop3 ssl_cert = , method=PLAIN, rip=10.12.3.1, lip=10.12.3.101, secured Dec 3 14:29:17 www dovecot: auth: Error: userdb(zhanghao,10.12.3.1): user not found from userdb passwd Dec 3 14:29:17 www dovecot: pop3: Error: Authenticated user not found from userdb, auth lookup id=3926917121 (client-pid=8774 client-id=1) Dec 3 14:29:17 www dovecot: pop3-login: Internal login failure (pid=8774 id=1) (auth failed, 1 attempts): user=, method=PLAIN, rip=10.12.3.1, lip=10.12.3.101, mpid=8775, secured thank you very much! Best Regards ?????????????? Beijing Octopus link Co. Ltd ???????????257????? ?? 607 ????? ? ? ???13810705782 Email: support at octlink.com -------------- next part -------------- A non-text attachment was scrubbed... Name: 31998_??????.bmp Type: image/bmp Size: 31998 bytes Desc: not available URL: From ben at morrow.me.uk Mon Dec 3 10:55:12 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Mon, 3 Dec 2012 08:55:12 +0000 Subject: [Dovecot] sieve problem after upgrade to 2.1.12 In-Reply-To: <50BC5EA0.7020802@dhag.net> References: <50BC5EA0.7020802@dhag.net> Message-ID: <20121203085512.GB91986@anubis.morrow.me.uk> At 9AM +0100 on 3/12/12 you (Daniel Funke) wrote: > > I have a sieve filter for a mailbox with amavisd-admin mails. > > if header :regex "Subject" "^INVALID HEADER" > { > fileinto "INVALID HEADER"; > } > > After the upgrade to dovecot 2.1.12 this filter doesn't work for some > (16) messages with this subject. For 424 messages it worked correct. What does 'doesn't work' mean? Was the message delivered to the INBOX, was it thrown away, did something else happen? Is there anything else in the sieve script, or any other sieve scripts, that might be affecting what happens? > Any ideas where to look? Start by looking in the main dovecot log to make sure the messages were actually delivered by dovecot-lda (rather than by your mail server's own LDA, for instance). Then check the .dovecot.sieve.log file in the user's home directory for any sieve errors. If it doesn't become apparent what's going on from that, then you will need to find a way to reproduce this. Look at the messages which failed and the messages which didn't, and see if you can see some common difference. Ben From tibby at tibby.hu Sat Dec 1 16:07:47 2012 From: tibby at tibby.hu (tibby at tibby.hu) Date: Sat, 01 Dec 2012 15:07:47 +0100 Subject: [Dovecot] Store mailbox usage in mysql not just the limit Message-ID: <0dffb191a6b27be6f36096ee2f5eba34@tibby.hu> Hello! I have dovecot working using mysql for auth and mailbox quota. in the mail database I have a user table with colums for: email, password, quota_kb, quota_messages I want to make a php script that would get the quota_kb and substract the usage to display the total free space left for mail usage. How can I do this? Is there a function in dovecot to store the current usage per mailbox ? Thanks! From johnsone at usc.edu Mon Dec 3 12:48:04 2012 From: johnsone at usc.edu (Erik A Johnson) Date: Mon, 03 Dec 2012 02:48:04 -0800 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> References: <8EDD59BD-AC4B-442F-B148-285BC368B49B@iki.fi> <43B7D59A-BEE2-4954-862D-6B8DF521EB38@usc.edu> <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> Message-ID: At 10AM -0800 on 1/12/12 Erik A Johnson wrote: >> Should the "#ifdef __APPLE__" remain? or would any of these tests be >> appropriate for other platforms as well? On 12/1/2012 at 11:07:36am PST, Ben Morrow wrote: > I had a go at reproducing this on FreeBSD and failed, but I don't believe we've seen a packet trace yet so I wasn't entirely sure what might provoke it. There is definitely a bug in the OS here somewhere, unless the socket never gets as far as SYN-SYN/ACK-ACK, since ENOTCONN should only be returned *before* the socket has connected successfully. An ordinary disconnected socket should simply return EOF from read, and a socket that got RST should return ECONNRESET. > > Are you able to reproduce this and get a tcpdump packet trace (on the dovecot side of any firewalls)? Attached is the output of "sudo tcpdump -i en0 -vv -A host CLIENT" run on the SERVER. I know enough about tcpdump to be dangerous; if there is additional output that would be helpful, please let me know what options to use for tcpdump (the OS X tcpdump man page is at http://developer.apple.com/library/mac/#documentation/Darwin/Reference/ManPages/man1/tcpdump.1.html). > Also, when this happens, does it happen straight away or is there a delay until the connection times out? It happens straight away. > (I don't suppose you know if the source for the OSX network stack is online anywhere? I'd be interested to see how different it is from FreeBSD's.) Would it be somewhere at http://opensource.apple.com/release/mac-os-x-1082/ ? -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: tcpdump_output.txt URL: From rhunen at xs4all.nl Mon Dec 3 14:41:11 2012 From: rhunen at xs4all.nl (Roger Hunen) Date: Mon, 03 Dec 2012 13:41:11 +0100 Subject: [Dovecot] Thunderbird SSL/TLS client authentication fails - solved with workaround In-Reply-To: <20121202211848.GA12361@daniel.localdomain> References: <50BBBA63.9090005@xs4all.nl> <20121202211848.GA12361@daniel.localdomain> Message-ID: <50BC9DE7.2060809@xs4all.nl> On 2012/12/02 22:18, Daniel Parthey wrote: > Roger Hunen wrote: >> I am seeking your help with SSL/TLS client authentication. >> Unfortunately the authentication fails :( > > http://wiki2.dovecot.org/SSL/DovecotConfiguration states: > > "You may also want to disable the password checking completely. Doing this > currently circumvents Dovecot's security model so it's not recommended to use > it, but it is possible by making the passdb allow logins using any password > (typically requiring "nopassword" extra field to be returned)." > > See http://wiki2.dovecot.org/PasswordDatabase/ExtraFields This sounded like a bad idea at first as it would allow webmail users to logon without entering a password. However, your suggestion made me think (and go!) in a direction that I would not have gone on my own. Thank you for that! First things first: the solution/workaround :) * Create two passwd style files - mailusers.143 with password and without 'nopassword' extra field - mailusers.993 without password but with 'nopassword' extra field * Configure a passdb (driver=passwd-file) that selects the password database file using the %a variable (local port): mailusers.%a My Dovecot setup now * does not require a valid password for connections to the imaps port (993); the username is taken from the certificate that is issued by a trusted CA. * does require a password for connections to the imap port (143). Currently the system supports very few users, so working with two passwd files is not a problem. For the future I plan to use a mysql database with two different queries on the same table based on the local port number. For those who are interested: read on for some more findings... * As far as I can tell (from docs and source) Dovecot supports only username/password based authentication schemes. There is no such thing as certificate based authentication (unless I have overlooked something or it is undocumented). * Even if 'auth_ssl_username_from_cert=yes' Dovecot will only take the username from the certificate if the client sends username and password to logon. * When configured to use "TLS Certificate" authentication Thunderbird will not send a username/password to logon. Thunderbird considers the authentication done once the SSL handshake has completed. Given the above this is a recipe for failure. * With 'auth_ssl_username_from_cert=yes' Dovecot will ignore the given username and use the designated field in the certificate instead (usually commonName). Together with the 'nopasswd' extra field a certificate based authentication scheme can be implemented. The client must be configured to use username and password (which will be completely ignored by Dovecot as intended in such a setup). * Dovecot will log an error if a passwd file record has a non-empty password and the 'nopassword' extra field is present. Either can be present but not both. * Dovecot will log an error "input is missing end-of-settings line" if the configuration contains a setting with a name that is not valid in the given context. Something like "Invalid setting 'x' at line y" would be more helpful to pinpoint the problem. * Dovecot documentation is sparse in many respects which makes it difficult to use Dovecot to its full potential. I realize though that resources are at a premium and that writing documentation is not everybody's cup of tea. From a documentation point of view Exim4 is an excellent example. Regards, -Roger From daniel at dhag.net Mon Dec 3 15:42:45 2012 From: daniel at dhag.net (Daniel Funke) Date: Mon, 03 Dec 2012 14:42:45 +0100 Subject: [Dovecot] sieve problem after upgrade to 2.1.12 In-Reply-To: <20121203085512.GB91986@anubis.morrow.me.uk> References: <50BC5EA0.7020802@dhag.net> <20121203085512.GB91986@anubis.morrow.me.uk> Message-ID: <50BCAC55.90307@dhag.net> Hi Ben, thank you for your quick answer. "doesn't work" should mean, the message is delivered to the INBOX. There is only one quite simple sieve-script for this user (generated by roundcube). Here's the complete script: ------------------------------ require ["regex","fileinto"]; # rule:[move INVALID HEADER] if header :regex "Subject" "^INVALID HEADER" { fileinto "INVALID HEADER"; } # rule:[move Cron] if header :regex "Subject" "^Cron " { fileinto "Cron"; } ------------------------------ All messages are delivered with lmtp and generated by amavisd-new in this case. I've no .dovecot.sieve.log in the users home dir. Can I activate it or will it appear only in case of sieve errors? I can't find any difference between the messages. Maybe you can have a look: -------------------- message delivered to INBOX (nok) -------------------- Return-Path: Received: from mail.****.net ([*.*.*.*]) by dovecot.****.net (Dovecot) with LMTP id /zSOLkVrvFBjDQAAfopj6Q ; Mon, 03 Dec 2012 10:05:09 +0100 Received: from localhost (unknown [192.168.12.27]) by mail2.****.net (Postfix) with ESMTP id 47922154A6A for ; Mon, 3 Dec 2012 10:05:09 +0100 (CET) Content-Type: multipart/mixed; boundary="----------=_1354525509-3680-1" Content-Transfer-Encoding: 7bit MIME-Version: 1.0 From: "Mail-Security" Date: Mon, 3 Dec 2012 10:05:09 +0100 (CET) Subject: INVALID HEADER in mail FROM LOCAL [172.16.105.182]:57392 To: Message-ID: This is a multi-part message in MIME format... ------------=_1354525509-3680-1 Content-Type: text/plain; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable No viruses were found. Bad header: Non-encoded 8-bit data (char E1 hex): Subject: ... Jose Sousa# Lista compar\341vel de vendas m[...] Content type: BadHdr8bit Internal reference code for the message is 03680-12/EWdUiMCcvfCl -------------------- message delivered to "INVALID HEADER" (ok) -------------------- Return-Path: Received: from mail.****.net ([*.*.*.*]) by dovecot.****.net (Dovecot) with LMTP id LlmtN9abvFDWEgAAfopj6Q ; Mon, 03 Dec 2012 13:35:03 +0100 Received: from localhost (unknown [192.168.12.27]) by mail2.****.net (Postfix) with ESMTP id 5D301154E45 for ; Mon, 3 Dec 2012 13:35:03 +0100 (CET) Content-Type: multipart/mixed; boundary="----------=_1354538103-7835-0" Content-Transfer-Encoding: 7bit MIME-Version: 1.0 From: "Mail-Security" Date: Mon, 3 Dec 2012 13:35:03 +0100 (CET) Subject: INVALID HEADER in mail FROM LOCAL [172.16.105.182]:44981 To: Message-ID: This is a multi-part message in MIME format... ------------=_1354538103-7835-0 Content-Type: text/plain; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable No viruses were found. Bad header: Non-encoded 8-bit data (char FC hex): Subject: ZFIAS-Fehler: Direktion T\374rkei# 151#Umsa[...] Content type: BadHdr8bit Internal reference code for the message is 07835-12/8PpOmsB88Xzl Am 03.12.2012 09:55, schrieb Ben Morrow: > At 9AM +0100 on 3/12/12 you (Daniel Funke) wrote: >> I have a sieve filter for a mailbox with amavisd-admin mails. >> >> if header :regex "Subject" "^INVALID HEADER" >> { >> fileinto "INVALID HEADER"; >> } >> >> After the upgrade to dovecot 2.1.12 this filter doesn't work for some >> (16) messages with this subject. For 424 messages it worked correct. > What does 'doesn't work' mean? Was the message delivered to the INBOX, > was it thrown away, did something else happen? > > Is there anything else in the sieve script, or any other sieve scripts, > that might be affecting what happens? > >> Any ideas where to look? > Start by looking in the main dovecot log to make sure the messages were > actually delivered by dovecot-lda (rather than by your mail server's own > LDA, for instance). Then check the .dovecot.sieve.log file in the user's > home directory for any sieve errors. > > If it doesn't become apparent what's going on from that, then you will > need to find a way to reproduce this. Look at the messages which failed > and the messages which didn't, and see if you can see some common > difference. > > Ben > From f.bonnet at esiee.fr Mon Dec 3 16:45:18 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Mon, 03 Dec 2012 15:45:18 +0100 Subject: [Dovecot] conversion MBOX -->Maildir Message-ID: <50BCBAFE.9030100@esiee.fr> Hello I would like to start MBOX to Maildir conversion at 2.1.12 what would be the safest method to perform this ? wiki2 says the following , is it up to date ? mbox -> maildir migration. Set mail_location=maildir:~/Maildir and run dsync -u username mirror mbox:~/mail:INBOX=/var/mail/username thank you From f.bonnet at esiee.fr Mon Dec 3 17:34:16 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Mon, 03 Dec 2012 16:34:16 +0100 Subject: [Dovecot] pop3-login: Error: SSL: Stacked error: Message-ID: <50BCC678.6010106@esiee.fr> Hello again I have few messages in dovecot.log like the following : Dec 03 15:52:07 pop3-login: Error: SSL: Stacked error: error:140943F2:SSL routines:SSL3_READ_BYTES:sslv3 alert unexpected message: SSL alert number 10 Anyone could tell what does this means ? Thank you From rventura at h-st.com Mon Dec 3 19:17:07 2012 From: rventura at h-st.com (Romer Ventura) Date: Mon, 3 Dec 2012 11:17:07 -0600 Subject: [Dovecot] Gmail style conversations Message-ID: <17018_1354555027_50BCDE93_17018_25_1_08f301cdd17a$05ad6f40$11084dc0$@h-st.com> Hello, I am wondering if there is any way to support Gmail style conversation when using Dovecot? Someway of associating all inbound and sent emails..? I know that some clients let you display the emails in "conversation" which kinda does what Gmail does, however, it does not associate the Sent emails with it. Thanks for any information.

This document and attachments may contain technical data controlled under the U.S. International Traffic in Arms Regulations (ITAR) or the Export Administration Regulations (EAR) and may not be exported to a Foreign Person, either in the U.S. or abroad, without the proper authorization by the U.S. Department of State or Department of Commerce, whichever is applicable. CONFIDENTIALITY NOTE: This electronic transmission, including all attachments, is directed in confidence solely to the person(s) to whom it is addressed, or an authorized recipient, and may not otherwise be distributed, copied or disclosed. The contents of the transmission may also be subject to intellectual property rights and such rights are expressly claimed and are not waived. If you have received this transmission in error, please notify the sender immediately by return electronic transmission and then immediately delete this transmission, including all attachments, without copying, distributing or disclosing same. The recipient should check this e-mail and any attachments for the presence of viruses. Houston Sigma Technologies L.P. accepts no liability for any damage caused by any virus transmitted by this e-mail.

From slusarz at curecanti.org Mon Dec 3 21:21:14 2012 From: slusarz at curecanti.org (Michael M Slusarz) Date: Mon, 03 Dec 2012 12:21:14 -0700 Subject: [Dovecot] Gmail style conversations In-Reply-To: <17018_1354555027_50BCDE93_17018_25_1_08f301cdd17a$05ad6f40$11084dc0$@h-st.com> References: <17018_1354555027_50BCDE93_17018_25_1_08f301cdd17a$05ad6f40$11084dc0$@h-st.com> Message-ID: <20121203122114.Horde.8BVynrICAT1vKdghDuxJCw1@bigworm.curecanti.org> Quoting Romer Ventura : > I am wondering if there is any way to support Gmail style > conversation when using Dovecot? Someway of associating all inbound and sent > emails..? Sure: just save all sent-mail messages to the same mailbox and use a threaded (REFERENCES) sort. michael From e-frog at gmx.de Mon Dec 3 22:59:00 2012 From: e-frog at gmx.de (e-frog) Date: Mon, 03 Dec 2012 21:59:00 +0100 Subject: [Dovecot] Gmail style conversations In-Reply-To: <17018_1354555027_50BCDE93_17018_25_1_08f301cdd17a$05ad6f40$11084dc0$@h-st.com> References: <17018_1354555027_50BCDE93_17018_25_1_08f301cdd17a$05ad6f40$11084dc0$@h-st.com> Message-ID: <50BD1294.2070509@gmx.de> On 03.12.2012 18:17, wrote Romer Ventura: > I am wondering if there is any way to support Gmail style > conversation when using Dovecot? Someway of associating all inbound and sent > emails..? > The documentation for the virtual plugin has an example for GMail-style "conversation view". I didn't try it myself so far however ... http://wiki2.dovecot.org/Plugins/Virtual#Examples From daniel.parthey at informatik.tu-chemnitz.de Mon Dec 3 23:44:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 3 Dec 2012 22:44:02 +0100 Subject: [Dovecot] Store mailbox usage in mysql not just the limit In-Reply-To: <0dffb191a6b27be6f36096ee2f5eba34@tibby.hu> References: <0dffb191a6b27be6f36096ee2f5eba34@tibby.hu> Message-ID: <20121203214402.GA8386@daniel.localdomain> Hi Tibby, tibby at tibby.hu wrote: > I have dovecot working using mysql for auth and mailbox quota. > > in the mail database I have a user table with colums for: > email, password, quota_kb, quota_messages > > I want to make a php script that would get the quota_kb and > substract the usage to display the total free space left for mail > usage. > How can I do this? > Is there a function in dovecot to store the current usage per mailbox ? Yes, you can store current usage quota in an SQL dictionary: http://wiki2.dovecot.org/Quota/Dict For this you should create two more columns in your database, into which dovecot may write the current usage values. Regards Daniel -- https://plus.google.com/103021802792276734820 From dave at boostpro.com Tue Dec 4 04:50:03 2012 From: dave at boostpro.com (Dave Abrahams) Date: Mon, 03 Dec 2012 21:50:03 -0500 Subject: [Dovecot] clucene (in)stability Message-ID: Considering two crashing bugs, which have got no response (https://sourceforge.net/tracker/?func=detail&aid=3587525&group_id=80013&atid=558446 and https://sourceforge.net/tracker/?func=detail&aid=3592291&group_id=80013&atid=558446) and the lack of activity in its Git repository, I am inclined to think that CLucene's current release series (e.g. 2.3.3.4) should be considered unsuitable for serious use (including with Dovecot). I'm going to try CLucene 0.9.21, which they claim has been "proven to be stable over time" (see http://clucene.sourceforge.net), and see how it works out. I wonder if there's a future envisioned for FTS with Dovecot that's suitable for small installations (i.e. doesn't require a Solr server) and has a good chance of correctness and stability? -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From tss at iki.fi Tue Dec 4 05:44:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 05:44:23 +0200 Subject: [Dovecot] clucene (in)stability In-Reply-To: References: Message-ID: <1D825D28-8748-4712-9983-13771C1BEA14@iki.fi> On 4.12.2012, at 4.50, Dave Abrahams wrote: > > Considering two crashing bugs, which have got no response > (https://sourceforge.net/tracker/?func=detail&aid=3587525&group_id=80013&atid=558446 > and > https://sourceforge.net/tracker/?func=detail&aid=3592291&group_id=80013&atid=558446) > and the lack of activity in its Git repository, I am inclined to think > that CLucene's current release series (e.g. 2.3.3.4) should be > considered unsuitable for serious use (including with Dovecot). I haven't heard of any big problems in a couple of large installations. Maybe the problems exist only in OSX and not in Linux?.. > I'm > going to try CLucene 0.9.21, which they claim has been "proven to be > stable over time" (see http://clucene.sourceforge.net), and see how it > works out. Probably not that easy to port the current fts-lucene to use it.. At least I think you need to remove the filtering features. > I wonder if there's a future envisioned for FTS with Dovecot that's > suitable for small installations (i.e. doesn't require a Solr server) > and has a good chance of correctness and stability? You could try porting it into luceneplusplus. I've thought about it a few times but haven't had time to try. https://github.com/luceneplusplus From dave at boostpro.com Tue Dec 4 07:30:35 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 00:30:35 -0500 Subject: [Dovecot] clucene (in)stability In-Reply-To: <1D825D28-8748-4712-9983-13771C1BEA14@iki.fi> (Timo Sirainen's message of "Tue, 4 Dec 2012 05:44:23 +0200") References: <1D825D28-8748-4712-9983-13771C1BEA14@iki.fi> Message-ID: on Mon Dec 03 2012, Timo Sirainen wrote: > On 4.12.2012, at 4.50, Dave Abrahams wrote: > >> >> Considering two crashing bugs, which have got no response >> (https://sourceforge.net/tracker/?func=detail&aid=3587525&group_id=80013&atid=558446 >> and >> https://sourceforge.net/tracker/?func=detail&aid=3592291&group_id=80013&atid=558446) >> and the lack of activity in its Git repository, I am inclined to think >> that CLucene's current release series (e.g. 2.3.3.4) should be >> considered unsuitable for serious use (including with Dovecot). > > I haven't heard of any big problems in a couple of large > installations. Maybe the problems exist only in OSX and not in > Linux?.. I'd be shocked if these issues were OS specific, but anything's possible. Also, if you look at their tracker there's no shortage of worrisome problems. >> I'm going to try CLucene 0.9.21, which they claim has been "proven to >> be stable over time" (see http://clucene.sourceforge.net), and see >> how it works out. > > Probably not that easy to port the current fts-lucene to use it.. At > least I think you need to remove the filtering features. Nope, doesn't compile out-of-the-box. I'm back to the latest. >> I wonder if there's a future envisioned for FTS with Dovecot that's >> suitable for small installations (i.e. doesn't require a Solr server) >> and has a good chance of correctness and stability? > > You could try porting it into luceneplusplus. I've thought about it a > few times but haven't had time to > try. https://github.com/luceneplusplus Huh. Nice; uses Boost, and the code doesn't look nearly as awful as that other library. I can't find an API reference, but I guess I could start from the assumption that everything has the same name in both projects. I might try if I get a few minutes, thanks. -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From ben at morrow.me.uk Tue Dec 4 14:43:53 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Tue, 4 Dec 2012 12:43:53 +0000 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: References: <8EDD59BD-AC4B-442F-B148-285BC368B49B@iki.fi> <43B7D59A-BEE2-4954-862D-6B8DF521EB38@usc.edu> <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> Message-ID: <20121204124352.GC91986@anubis.morrow.me.uk> At 2AM -0800 on 3/12/12 you (Erik A Johnson) wrote: > At 10AM -0800 on 1/12/12 Erik A Johnson wrote: > >> Should the "#ifdef __APPLE__" remain? or would any of these tests be > >> appropriate for other platforms as well? > > > On 12/1/2012 at 11:07:36am PST, Ben Morrow wrote: > > I had a go at reproducing this on FreeBSD and failed, but I don't > > believe we've seen a packet trace yet so I wasn't entirely sure what > > might provoke it. There is definitely a bug in the OS here > > somewhere, unless the socket never gets as far as SYN-SYN/ACK-ACK, > > since ENOTCONN should only be returned *before* the socket has > > connected successfully. An ordinary disconnected socket should > > simply return EOF from read, and a socket that got RST should return > > ECONNRESET. > > > > Are you able to reproduce this and get a tcpdump packet trace (on > > the dovecot side of any firewalls)? > > Attached is the output of "sudo tcpdump -i en0 -vv -A host CLIENT" run > on the SERVER. > > I know enough about tcpdump to be dangerous; if there is additional > output that would be helpful, please let me know what options to use > for tcpdump (the OS X tcpdump man page is at > http://developer.apple.com/library/mac/#documentation/Darwin/Reference/ > ManPages/man1/tcpdump.1.html). > > > Also, when this happens, does it happen straight away or is there a > > delay until the connection times out? > > It happens straight away. > > > (I don't suppose you know if the source for the OSX network stack is > > online anywhere? I'd be interested to see how different it is from > > FreeBSD's.) > > Would it be somewhere at http://opensource.apple.com/release/mac-os-x-1082/ ? Well, it looks to me as though xnu/bsd/kern/uipc_socket.c:soreceive will indeed return ENOTCONN for a socket which was once successfully connected but has now been disconnected. This happens when the socket is in the DEFUNCT state, which is a state that doesn't exist in FreeBSD; it's not completely clear but I suspect firewalls may be able to put arbitrary sockets into that state. If this happens, OpenSSL's assumption that ENOTCONN always means 'we haven't finished accepting the connection yet' will no longer be correct. That suggests to me that until this gets fixed in OpenSSL (or, ideally, the OSX kernel), Dovecot should attempt to test for this condition, under #ifdef __APPLE__. Alternatively, it might be worth investigating the SO_DEFUNCTOK socket option: it looks to me as though clearing this prevents a socket from going into this state, but only root is allowed to do that. This trace seems to bear out that idea, at least as far as it makes sense. (I've taken out the packet dumps, since they don't tell me anything.) > 02:40:58.721596 IP (tos 0x0, ttl 64, id 17809, offset 0, flags [DF], > proto TCP (6), length 64) > CLIENT.51819 > SERVER.imaps: Flags [S], cksum 0xe780 (correct), > seq 2439614483, win 65535, options [mss 1460,nop,wscale > 3,nop,nop,TS val 1051593167 ecr 0,sackOK,eol], length 0 > 02:40:58.721803 IP (tos 0x0, ttl 64, id 55036, offset 0, flags [DF], > proto TCP (6), length 64) > SERVER.imaps > CLIENT.51819: Flags [S.], cksum 0x277c (correct), > seq 947774533, ack 2439614484, win 65535, options [mss > 1460,nop,wscale 4,nop,nop,TS val 877424355 ecr > 1051593167,sackOK,eol], length 0 > 02:40:58.726646 IP (tos 0x0, ttl 64, id 34733, offset 0, flags [DF], > proto TCP (6), length 52) > CLIENT.51819 > SERVER.imaps: Flags [.], cksum 0x6748 (correct), > seq 1, ack 1, win 65535, options [nop,nop,TS val 1051593169 ecr > 877424355], length 0 These three packets are the standard TCP 3-way handshake. At this point both ends ought to consider the connection successfully established. > 02:40:58.726754 IP (tos 0x0, ttl 64, id 6073, offset 0, flags [DF], > proto TCP (6), length 52) > SERVER.imaps > CLIENT.51819: Flags [.], cksum 0x4718 (correct), > seq 1, ack 1, win 8235, options [nop,nop,TS val 877424360 ecr > 1051593169], length 0 This is a window update from the server, indicating that the previous window of 65535 should be expanded to 131760 (that is, 8235 from the 'win' field in this packet, shifted left by the 4 from the 'wscale' option in the server's SYN/ACK packet). This is normal. > 02:40:58.732338 IP (tos 0x0, ttl 64, id 20960, offset 0, flags [DF], > proto TCP (6), length 52) > SERVER.imaps > CLIENT.51819: Flags [F.], cksum 0x4712 (correct), > seq 1, ack 1, win 8235, options [nop,nop,TS val 877424365 ecr > 1051593169], length 0 This is what's weird. It's a FIN packet from the server, which usually indicates the server deliberately closed the connection. I don't see any reason for Dovecot or OpenSSL to do that, but I suspect this is what happens if the firewall makes the socket DEFUNCT. (I haven't yet managed to follow the code well enough to prove that...) > 02:40:58.746788 IP (tos 0x0, ttl 64, id 37781, offset 0, flags [DF], > proto TCP (6), length 182) > CLIENT.51819 > SERVER.imaps: Flags [P.], cksum 0xfb11 (correct), > seq 1:131, ack 1, win 65535, options [nop,nop,TS val 1051593169 > ecr 877424355], length 130 > 02:40:58.746793 IP (tos 0x0, ttl 64, id 50564, offset 0, flags [DF], > proto TCP (6), length 52) > CLIENT.51819 > SERVER.imaps: Flags [.], cksum 0x66ba (correct), > seq 131, ack 2, win 65535, options [nop,nop,TS val 1051593170 ecr > 877424365], length 0 This is a data packet from the client trying to initiate the SSL conversation (presumably it sent this before it saw the FIN) followed by an ACK acknowledging the server's FIN. > 02:40:58.746842 IP (tos 0x0, ttl 64, id 49645, offset 0, flags [DF], > proto TCP (6), length 40) > SERVER.imaps > CLIENT.51819: Flags [R], cksum 0xad98 (correct), > seq 947774534, win 0, length 0 > 02:40:58.746843 IP (tos 0x0, ttl 64, id 42942, offset 0, flags [DF], > proto TCP (6), length 40) > SERVER.imaps > CLIENT.51819: Flags [R], cksum 0xad97 (correct), > seq 947774535, win 0, length 0 The server at this point is being rude: it sends RSTs to both those packets, which mean that the server doesn't think these packets belong to a connection it knows about. This supports the idea that the socket has been made DEFUNCT: an ordinary closed socket shouldn't do this. > 02:40:58.747318 IP (tos 0x0, ttl 64, id 27131, offset 0, flags [DF], > proto TCP (6), length 52) > CLIENT.51819 > SERVER.imaps: Flags [F.], cksum 0x66b9 (correct), > seq 131, ack 2, win 65535, options [nop,nop,TS val 1051593170 ecr > 877424365], length 0 > 02:40:58.747335 IP (tos 0x0, ttl 64, id 48383, offset 0, flags [DF], > proto TCP (6), length 40) > SERVER.imaps > CLIENT.51819: Flags [R], cksum 0xad97 (correct), > seq 947774535, win 0, length 0 The client continues trying to be polite, and sends its own FIN/ACK indicating it is closing the connection. The server sends another RST, since it still doesn't know about this connection any more. So, it looks to me as though you have a firewall problem. You may be able to get more information by setting the kern.ipc.sodefunctlog sysctl to 1: this should make the kernel log to syslog (or wherever the OSX kernel logs go) when sockets are made DEFUNCT and when reads fail for that reason. Ben From marc at perkel.com Tue Dec 4 16:15:45 2012 From: marc at perkel.com (Marc Perkel) Date: Tue, 04 Dec 2012 06:15:45 -0800 Subject: [Dovecot] [OT] MS Exchange Alternative? Message-ID: <50BE0591.8030907@perkel.com> Just wondering if there's an open source Linux alternative to MS Exchange so that all the features of outlook work? From ben at morrow.me.uk Tue Dec 4 16:18:23 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Tue, 4 Dec 2012 14:18:23 +0000 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: <20121204124352.GC91986@anubis.morrow.me.uk> References: <8EDD59BD-AC4B-442F-B148-285BC368B49B@iki.fi> <43B7D59A-BEE2-4954-862D-6B8DF521EB38@usc.edu> <05D0B7EC-1FB9-426B-B026-75FB5A37F5F4@usc.edu> <20121204124352.GC91986@anubis.morrow.me.uk> Message-ID: <20121204141822.GD91986@anubis.morrow.me.uk> At 12PM +0000 on 4/12/12 Ben Morrow wrote: > > Well, it looks to me as though xnu/bsd/kern/uipc_socket.c:soreceive will > indeed return ENOTCONN for a socket which was once successfully > connected but has now been disconnected. This happens when the socket is > in the DEFUNCT state, which is a state that doesn't exist in FreeBSD; > it's not completely clear but I suspect firewalls may be able to put > arbitrary sockets into that state. Investigating a little further, it should be possible to test for this situation directly. Assuming I'm correct about what's going on here, this should be both cleaner and safer than mucking about looking for ENOTCONN and guessing about what's happening. Erik, does this make the problem go away? I left out the proxy->client_proxy test, since AFAICT this is just as likely to happen on a client socket. Ben --- src/login-common/ssl-proxy-openssl.c~ 2012-07-28 17:56:31 +0100 +++ src/login-common/ssl-proxy-openssl.c 2012-12-04 14:12:03 +0000 @@ -407,6 +407,21 @@ switch (err) { case SSL_ERROR_WANT_READ: +#ifdef SO_ISDEFUNCT + /* Some Apple firewalls appear to be able to mark a + * socket DEFUNCT, at which point all reads return + * immediately with ENOTCONN. Since that is supposed to + * mean 'the socket hasn't finished connecting yet', + * OpenSSL keeps asking for another read and we go into + * an infinite loop. + */ + if (getsockopt(proxy->fd_ssl, SOL_SOCKET, SO_ISDEFUNCT, + (void *)&err, sizeof(err)) == 0 && err) { + errstr = t_strdup_printf( + "%s: socket is defunct", func_name); + break; + } +#endif ssl_set_io(proxy, SSL_ADD_INPUT); break; case SSL_ERROR_WANT_WRITE: From martin.rabl at rablnet.de Tue Dec 4 16:19:23 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Tue, 04 Dec 2012 15:19:23 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0591.8030907@perkel.com> References: <50BE0591.8030907@perkel.com> Message-ID: <50BE066B.205@rablnet.de> Am 04.12.2012 15:15, schrieb Marc Perkel: > Just wondering if there's an open source Linux alternative to MS > Exchange so that all the features of outlook work? Give SOGo a try ... http://www.sogo.nu -- Viele Gr??e, Martin Rabl From jc at info-systems.de Tue Dec 4 16:20:20 2012 From: jc at info-systems.de (Jakob Curdes) Date: Tue, 04 Dec 2012 15:20:20 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0591.8030907@perkel.com> References: <50BE0591.8030907@perkel.com> Message-ID: <50BE06A4.6020004@info-systems.de> Am 04.12.2012 15:15, schrieb Marc Perkel: > Just wondering if there's an open source Linux alternative to MS > Exchange so that all the features of outlook work? Did you have a look at zarafa? Most part of it is open source; the outlook connector ist closed source however and requires a license fee for more than three clients. It uses MAPI to connect to Outlook, unlike many other solutions that do calendar syncs etc. via the ActiveSync protocol. Zarafa is a completely different thing than dovecot, however; it stores all mails in a MySQL database. HTH, Jakob Curdes From nmilas at noa.gr Tue Dec 4 16:22:33 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 04 Dec 2012 16:22:33 +0200 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0591.8030907@perkel.com> References: <50BE0591.8030907@perkel.com> Message-ID: <50BE0729.5020905@noa.gr> On 4/12/2012 4:15 ??, Marc Perkel wrote: > Just wondering if there's an open source Linux alternative to MS > Exchange so that all the features of outlook work? > > Try SoGo (http://www.sogo.nu/english.html) together with your basic mail software (e.g. Postfix/Dovecot). Nick From crohmann at netcologne.de Tue Dec 4 16:28:39 2012 From: crohmann at netcologne.de (Christian Rohmann) Date: Tue, 04 Dec 2012 15:28:39 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0591.8030907@perkel.com> References: <50BE0591.8030907@perkel.com> Message-ID: <50BE0897.5020807@netcologne.de> Hey Marc, On 04.12.2012 15:15, Marc Perkel wrote:> Just wondering if there's an open source Linux alternative to MS > Exchange so that all the features of outlook work? Open-Xchange. They have a module called OLOX2 that enables you to make MS Outlook think it's connected to a Microsoft Exchange. So syncing of mails, calendar and contacts as well as global address book. Regards Christian From simon.buongiorno at gmail.com Tue Dec 4 16:52:00 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Tue, 4 Dec 2012 09:52:00 -0500 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE066B.205@rablnet.de> References: <50BE0591.8030907@perkel.com> <50BE066B.205@rablnet.de> Message-ID: On Dec 4, 2012 9:20 AM, "Martin Rabl" wrote: > > Am 04.12.2012 15:15, schrieb Marc Perkel: > >> Just wondering if there's an open source Linux alternative to MS >> Exchange so that all the features of outlook work? > > Give SOGo a try ... http://www.sogo.nu Horde groupware? www.Horde.org Simon From jc at info-systems.de Tue Dec 4 16:55:27 2012 From: jc at info-systems.de (Jakob Curdes) Date: Tue, 04 Dec 2012 15:55:27 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: References: <50BE0591.8030907@perkel.com> <50BE066B.205@rablnet.de> Message-ID: <50BE0EDF.8090209@info-systems.de> > Horde groupware? www.Horde.org > I tried horde but for real Outlook connectivity, which is done via ActiveSync, my experience ist not so good; then and now I got contacts that kepte replicating themselves and dates that would not show up in Outlook or the Web GUI. If you use it with Thunderbird or the like, different story. JC From hummel at pasteur.fr Tue Dec 4 17:10:29 2012 From: hummel at pasteur.fr (Thomas Hummel) Date: Tue, 4 Dec 2012 16:10:29 +0100 Subject: [Dovecot] Maidir layout : why and how ? Message-ID: <20121204151029.GE1745@parmesan.sis.pasteur.fr> Hello Timo, I've been using dovecot from many years now using Maildir mailbox format with default layout (Maildir++, everthing in a single directory). What would be the reason(s) to convert to Layout=fs ? I can only think of one : to allow dots in mailbox names. And even in that case, I guess I still have the option to use the litescape plugin. Besides, how would one process to do the conversion ? Using dsync ? Thanks. -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From sirtcp at gmail.com Tue Dec 4 17:18:18 2012 From: sirtcp at gmail.com (Muhammad Yousuf Khan) Date: Tue, 4 Dec 2012 20:18:18 +0500 Subject: [Dovecot] dotlock error Message-ID: i finally manage to control access on public folder by File system permission. i have 3 test users. 1. tom 2. fmaster 3 . testmail tom and fmaster are a group called "news-own" and testmail user is a readonly one. here is my folder structure ill share dovecot -n output at the end of this email. drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 tmp drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 new -rwxrwxrwx 1 tom news-own 68 Dec 4 19:08 dovecot-uidlist -rw-rw-r-T 1 fmaster news-own 16K Dec 4 19:10 dovecot.index.cache drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:15 cur -rw-rw-r-T 1 tom news-own 1.1K Dec 4 19:16 dovecot.index.log everything works fine as far as user fmaster and tom is concern as they are member of "news-own" and this group own the mailbox now the problem i face with readonly users. i am getting this error in /var/log/mail.info (against user testmail) file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: /public/.News at first point i saw this error and i could not subscribe to the folder. and the said log has been generated. now on second stage i change the dovecot-uidlist file permission to "1666" so that testmail user can also write to the file. now problem starts from here, i see two folder one is News and second one is News-1 and i don't know from where the second folder showed up. and when i click on any of the folder my /var/log/mail.info start to show below massage continuously. until i restart the dovecot service. file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: /public/.News i search google and i saw that people suggested to set stickey bit on which i already did or suggested to stop "dot locking" so i am here to ask is there any way to solve my said problem with out disabling dot locking? or if i stop dot locking what are the consequences? here i my dovcecot -n root at mailsrv:/public/.News# dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/postfix.pem ssl_key_file: /etc/ssl/private/postfix.key login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/index mail_debug: yes mbox_write_locks: fcntl dotlock namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Shared folders/ location: maildir:/public list: yes auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix Thanks in advance, any help or suggestion would be highly appreciated. From tss at iki.fi Tue Dec 4 18:03:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 18:03:10 +0200 Subject: [Dovecot] CVE-2012-5620 Message-ID: <25FD7268-F999-4B2E-9844-EF391CB51D09@iki.fi> This CVE isn't worthy of existence. A user can crash his/her own IMAP session by issuing a specific SEARCH command, which is just slightly worse than user issuing a LOGOUT command. It took years for people to notice this bug, because just about no IMAP client issues such a command. From tss at iki.fi Tue Dec 4 18:22:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 18:22:00 +0200 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE06A4.6020004@info-systems.de> References: <50BE0591.8030907@perkel.com> <50BE06A4.6020004@info-systems.de> Message-ID: On 4.12.2012, at 16.20, Jakob Curdes wrote: > Am 04.12.2012 15:15, schrieb Marc Perkel: >> Just wondering if there's an open source Linux alternative to MS Exchange so that all the features of outlook work? > Did you have a look at zarafa? Most part of it is open source; the outlook connector ist closed source however and requires a license fee for more than three clients. > It uses MAPI to connect to Outlook, unlike many other solutions that do calendar syncs etc. via the ActiveSync protocol. Zarafa is a completely different thing than dovecot, however; it stores all mails in a MySQL database. Future versions of Zarafa will hopefully serve IMAP protocol via Dovecot. :) From lists at sterenborg.info Tue Dec 4 18:33:38 2012 From: lists at sterenborg.info (Rob Sterenborg (lists)) Date: Tue, 04 Dec 2012 17:33:38 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: References: <50BE0591.8030907@perkel.com> <50BE06A4.6020004@info-systems.de> Message-ID: <50BE25E2.5070603@sterenborg.info> On 12/04/2012 05:22 PM, Timo Sirainen wrote: > On 4.12.2012, at 16.20, Jakob Curdes wrote: > >> Am 04.12.2012 15:15, schrieb Marc Perkel: >>> Just wondering if there's an open source Linux alternative to MS Exchange so that all the features of outlook work? >> Did you have a look at zarafa? Most part of it is open source; the outlook connector ist closed source however and requires a license fee for more than three clients. >> It uses MAPI to connect to Outlook, unlike many other solutions that do calendar syncs etc. via the ActiveSync protocol. Zarafa is a completely different thing than dovecot, however; it stores all mails in a MySQL database. > > Future versions of Zarafa will hopefully serve IMAP protocol via Dovecot. :) If they'd do that, it would be great because that's *the* reason I'm not running Zarafa. Last time I tried the Zarafa IMAP server, which is some years ago, I was converting email locally via IMAP, just to see how Zarafa worked and behaved. The conversion would hang at random times, and it's IMAP server was so slow compared to Dovecot that I didn't want to use it. From dave at boostpro.com Tue Dec 4 18:46:26 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 11:46:26 -0500 Subject: [Dovecot] doveadm fts optimize undocumented Message-ID: Subject says all. Timo, would you write something up where the world will find it? Also, it would be great if doveadm fts was covered in the doveadm manpage. Thanks, -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From tss at iki.fi Tue Dec 4 18:55:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 18:55:42 +0200 Subject: [Dovecot] doveadm fts optimize undocumented In-Reply-To: References: Message-ID: On 4.12.2012, at 18.46, Dave Abrahams wrote: > Subject says all. Timo, would you write something up where the world > will find it? Also, it would be great if doveadm fts was covered in the > doveadm manpage. It runs the Lucene's optimize function with fts-lucene backend. Does nothing with others. Basically I think it just gathers multiple Lucene index files together and packs them into a single file, dropping all deleted data (Lucene documentation has more details I think). Similar to what "doveadm purge" does to mdbox files. fts-lucene runs the optimize also internally automatically once in a while, so I'm not sure if that doveadm command should necessarily even exist. From tss at iki.fi Tue Dec 4 18:58:36 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 18:58:36 +0200 Subject: [Dovecot] Maidir layout : why and how ? In-Reply-To: <20121204151029.GE1745@parmesan.sis.pasteur.fr> References: <20121204151029.GE1745@parmesan.sis.pasteur.fr> Message-ID: On 4.12.2012, at 17.10, Thomas Hummel wrote: > I've been using dovecot from many years now using Maildir mailbox format with > default layout (Maildir++, everthing in a single directory). > > What would be the reason(s) to convert to Layout=fs ? Some people already are using fs layout for their maildirs, for example with mutt, and want to preserve that. > I can only think of one : > to allow dots in mailbox names. And even in that case, I guess I still have the > option to use the litescape plugin. Yeah. > Besides, how would one process to do the conversion ? Using dsync ? That's the easiest way. BTW. There's also the possibility of using LAYOUT=maildir++ with mbox format. That makes even less sense. :) From dave at boostpro.com Tue Dec 4 18:59:20 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 11:59:20 -0500 Subject: [Dovecot] doveadm fts optimize undocumented In-Reply-To: (Timo Sirainen's message of "Tue, 4 Dec 2012 18:55:42 +0200") References: Message-ID: on Tue Dec 04 2012, Timo Sirainen wrote: > On 4.12.2012, at 18.46, Dave Abrahams wrote: > >> Subject says all. Timo, would you write something up where the world >> will find it? Also, it would be great if doveadm fts was covered in the >> doveadm manpage. > > It runs the Lucene's optimize function with fts-lucene backend. Does > nothing with others. Basically I think it just gathers multiple Lucene > index files together and packs them into a single file, dropping all > deleted data (Lucene documentation has more details I think). Similar > to what "doveadm purge" does to mdbox files. fts-lucene runs the > optimize also internally automatically once in a while, so I'm not > sure if that doveadm command should necessarily even exist. I think the answer lies in your perception of benefits vs maintainance (including documentation) costs... ;-) -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From tss at iki.fi Tue Dec 4 19:01:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 19:01:08 +0200 Subject: [Dovecot] doveadm fts optimize undocumented In-Reply-To: References: Message-ID: On 4.12.2012, at 18.59, Dave Abrahams wrote: > on Tue Dec 04 2012, Timo Sirainen wrote: > >> On 4.12.2012, at 18.46, Dave Abrahams wrote: >> >>> Subject says all. Timo, would you write something up where the world >>> will find it? Also, it would be great if doveadm fts was covered in the >>> doveadm manpage. >> >> It runs the Lucene's optimize function with fts-lucene backend. Does >> nothing with others. Basically I think it just gathers multiple Lucene >> index files together and packs them into a single file, dropping all >> deleted data (Lucene documentation has more details I think). Similar >> to what "doveadm purge" does to mdbox files. fts-lucene runs the >> optimize also internally automatically once in a while, so I'm not >> sure if that doveadm command should necessarily even exist. > > I think the answer lies in your perception of benefits vs maintainance > (including documentation) costs... ;-) Based on the awesome explanation I just gave, I wouldn't mind if someone converts something based on it to a man page patch! From dave at boostpro.com Tue Dec 4 18:57:41 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 11:57:41 -0500 Subject: [Dovecot] When are search indexes updated? References: <508C9C8A.8000309@hardwarefreak.com> Message-ID: Here's a further experience report with questions inline: 1. "doveadm index '*'" crashes in clucene (for me), so it must be trying to update the FTS indexes, somehow. Is that (the updating, not the crashing) intended behavior, and if so, should it be documented? 2. "doveadm search text SOMETHINGthatWONTbeFOUND" takes a long time and finds stuff without crashing, but doesn't seem to create the lucene-indexes/ directory in my mdbox, and it takes a long time the next time around. Is "doveadm search" intended to update the FTS indexes if they're missing? 3. Performing a search on a large mailbox through IMAP takes a long time the first time around, during which "top" shows the big cpu hog is /opt/local/libexec/dovecot/indexer-worker, lucene-indexes/ is created, and subsequent searches go quickly. Nice! Is there a reasonably easy way to start such a search on all my mailboxes from the command line by using doveadm or the preauth tunnel? on Thu Nov 01 2012, Dave Abrahams wrote: > on Sat Oct 27 2012, Stan Hoeppner wrote: > >> On 10/27/2012 3:00 PM, David Abrahams wrote: >>> >>> I noticed that occasionally searching in my huge archive mailbox can be >>> really slow, so I tried doveadm index on it and it seemed to do a lot of >>> work, which seemed strange given, for example, that dovecot-lda says it >>> keeps Dovecot index files up-to-date. Then I thought, "maybe these are >>> different files than the search indices." If so, that's not entirely >>> clear from the docs and Wiki. So, questions: >> >> Mailbox and search indexes are separate. > > If so, I hereby request that they be properly and explicitly > distinguished from one another, every place "index" is mentioned on the > wiki. > >> Look in your mailbox directory and you'll see them, such as on 1.2.x >> with mbox: > > I'm on 2.x with mdbox, FWIW. > >> $ la /home/stan/mail/.imap/1-Dovecot >> total 3.4M >> drwx------ 2 stan stan 135 Oct 25 21:39 . >> drwx------ 51 stan stan 4.0K Apr 13 2012 .. >> -rw------- 1 stan stan 44K Oct 27 13:28 dovecot.index >> -rw------- 1 stan stan 1.2M Oct 27 21:23 dovecot.index.cache >> -rw------- 1 stan stan 18K Oct 27 21:23 dovecot.index.log >> -rw------- 1 stan stan 1.1M May 20 06:32 dovecot.index.search >> -rw------- 1 stan stan 1.1M May 20 06:32 dovecot.index.search.uids >> >> I've not full text searched this folder for quite some time, thus the >> search indexes are not current, and the next FTS of this mail folder >> will take much more time than if the FTS indexes were current. >> >>> * When are search indexes updated? >> >> When the index is stale. > > That's pretty vague :-) > >>> * Are they updated incrementally? >>> * If not, why not? >>> * If so, why would a mailbox's index drift out-of-date, as mine had? >> >> When a sufficient number of messages are added to an IMAP folder the FTS >> index becomes stale. > > That's a little less vague, thanks :-) > >> This index is not updated in real time. This is why Timo and others >> recommend cron'ing a script to index folders regularly that are >> searched regularly. > > And how does one index the folders for search? Is that "doveadm > index" or "doveadm fts rescan" (which I see at > http://wiki2.dovecot.org/Plugins/FTS but NOT in the manpage), or...? > >> This keeps the indexes up to date and keeps searches fast. If you >> don't do this or search often, your indexes become stale. Then each >> time you do an FTS search the first thing that happens is an FTS >> re-indexing of the mail folder. Only then does it display the search >> results. >> >>> BTW, I'm using the clucene search backend. >> >> I've not used Lucene, but I believe the default behavior is similar to >> the Dovecot 1.2.x FTS indexer. > > Not sure what conclusion to draw from that, thanks. -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From tss at iki.fi Tue Dec 4 19:17:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 19:17:43 +0200 Subject: [Dovecot] When are search indexes updated? In-Reply-To: References: <508C9C8A.8000309@hardwarefreak.com> Message-ID: <5B4F4081-F687-455F-8078-6B014D204382@iki.fi> On 4.12.2012, at 18.57, Dave Abrahams wrote: > Here's a further experience report with questions inline: > > 1. "doveadm index '*'" crashes in clucene (for me), so it must be trying > to update the FTS indexes, somehow. Is that (the updating, not the > crashing) intended behavior, and if so, should it be documented? doveadm index always triggers adding any unindexed messages to Dovecot index with mbox/Maildir code. With [sm]dbox all mails are always indexed, so this part doesn't do anything with them. When fts plugin is enabled, dovecot index also triggers the fts index updating of all messages not yet in the fts index. You usually should use the -q ("queue") parameter so that doveadm index only tells indexer process to start indexing. Without -q parameter the doveadm process itself does the indexing, but this is problematic with fts-lucene if another process attempts to index the mails at the same time. -q doesn't wait for indexer to finish. > 2. "doveadm search text SOMETHINGthatWONTbeFOUND" takes a long time and > finds stuff without crashing, but doesn't seem to create the > lucene-indexes/ directory in my mdbox, and it takes a long time the > next time around. Is "doveadm search" intended to update the FTS > indexes if they're missing? Yes. It should trigger the same doveadm index -q code. Maybe you have a (permission) problem connecting to indexer process. It should write about that to stderr. > 3. Performing a search on a large mailbox through IMAP takes a long time > the first time around, during which "top" shows the big cpu hog is > /opt/local/libexec/dovecot/indexer-worker, lucene-indexes/ is > created, and subsequent searches go quickly. Nice! Is there a > reasonably easy way to start such a search on all my mailboxes from > the command line by using doveadm or the preauth tunnel? doveadm index -q / imap SEARCH body asdfg From hummel at pasteur.fr Tue Dec 4 19:33:55 2012 From: hummel at pasteur.fr (Thomas Hummel) Date: Tue, 4 Dec 2012 18:33:55 +0100 Subject: [Dovecot] dovecot backend on director ? Message-ID: <20121204173355.GB2991@parmesan.sis.pasteur.fr> Hello Timo, The last time I checked my understanding about director was that : 1. backend/"real" imap servers should not be on the same host (or the same dovecot instance) to avoid proxying loops. Is it still the case with the latest 2.1 stable release ? Is there a plan to be able to run director and real server on the same host, thus requiring only 2 hosts instead of 4 to have load balancing and a redundant director ? 2. director itself was not able or meant to check if one of the real server was down (some script was pointed long time ago in this list). Same questions. 3. you'll have to use dovecot lmtp instead of let's say procmail. Would deliver be still a choice or is lmtp the only deliver compatible choice ? In what case would lmtp be more useful than deliver ? To have some sort of "remote LDA" ? By the way, what gets indexed on deposit on the mailbox since, by definition, the user has not done any request yet ? Thanks. -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From nmilas at noa.gr Tue Dec 4 19:40:21 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 04 Dec 2012 19:40:21 +0200 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0729.5020905@noa.gr> References: <50BE0591.8030907@perkel.com> <50BE0729.5020905@noa.gr> Message-ID: <50BE3585.6000102@noa.gr> On 4/12/2012 4:15 ??, Marc Perkel wrote: > >> Just wondering if there's an open source Linux alternative to MS >> Exchange so that all the features of outlook work? >> Keep in mind that many solutions out there like Zarafa and Open-Xchange are not free (though they are open source). On the other hand, SoGo and Horde are free. Nick From dave at boostpro.com Tue Dec 4 19:42:20 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 12:42:20 -0500 Subject: [Dovecot] When are search indexes updated? In-Reply-To: <5B4F4081-F687-455F-8078-6B014D204382@iki.fi> (Timo Sirainen's message of "Tue, 4 Dec 2012 19:17:43 +0200") References: <508C9C8A.8000309@hardwarefreak.com> <5B4F4081-F687-455F-8078-6B014D204382@iki.fi> Message-ID: on Tue Dec 04 2012, Timo Sirainen wrote: > On 4.12.2012, at 18.57, Dave Abrahams wrote: > >> Here's a further experience report with questions inline: >> >> 1. "doveadm index '*'" crashes in clucene (for me), so it must be trying >> to update the FTS indexes, somehow. Is that (the updating, not the >> crashing) intended behavior, and if so, should it be documented? > > doveadm index always triggers adding any unindexed messages to Dovecot > index with mbox/Maildir code. With [sm]dbox all mails are always > indexed, so this part doesn't do anything with them. > > When fts plugin is enabled, dovecot index also triggers the fts index > updating of all messages not yet in the fts index. You usually should > use the -q ("queue") parameter so that doveadm index only tells > indexer process to start indexing. Without -q parameter the doveadm > process itself does the indexing, but this is problematic with > fts-lucene if another process attempts to index the mails at the same > time. -q doesn't wait for indexer to finish. Oh, this is hugely important information! Wish I'd had that earlier. Is that on the Wiki somewhere that I missed? Huh, -q isn't even in the manpage for doveadm index. Could you fix that, please? >> 2. "doveadm search text SOMETHINGthatWONTbeFOUND" takes a long time and >> finds stuff without crashing, but doesn't seem to create the >> lucene-indexes/ directory in my mdbox, and it takes a long time the >> next time around. Is "doveadm search" intended to update the FTS >> indexes if they're missing? > > Yes. It should trigger the same doveadm index -q code. Maybe you have > a (permission) problem connecting to indexer process. It should write > about that to stderr. Well, I'm not seeing anything like that :( I just stopped dovecot, removed my lucene-indexes, started dovecot up again, and issued "doveadm index -q / imap SEARCH body asdfg" It came back immediately with a prompt, there was no output, and I don't see an indexer-helper process. In fact, the behavior is the same without "-q" >> 3. Performing a search on a large mailbox through IMAP takes a long time >> the first time around, during which "top" shows the big cpu hog is >> /opt/local/libexec/dovecot/indexer-worker, lucene-indexes/ is >> created, and subsequent searches go quickly. Nice! Is there a >> reasonably easy way to start such a search on all my mailboxes from >> the command line by using doveadm or the preauth tunnel? > > doveadm index -q / imap SEARCH body asdfg This looks completely unlike anything I can find in "man doveadm-index"; are you sure it's right? I can delete any number of arguments after the "/" without seeming to affect its behavior. -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From tss at iki.fi Tue Dec 4 19:44:32 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 19:44:32 +0200 Subject: [Dovecot] dovecot backend on director ? In-Reply-To: <20121204173355.GB2991@parmesan.sis.pasteur.fr> References: <20121204173355.GB2991@parmesan.sis.pasteur.fr> Message-ID: <8660B0A7-8566-4015-A744-BB1155525016@iki.fi> On 4.12.2012, at 19.33, Thomas Hummel wrote: > Hello Timo, > > The last time I checked my understanding about director was that : > > 1. backend/"real" imap servers should not be on the same host (or the same dovecot instance) to > avoid proxying loops. > > Is it still the case with the latest 2.1 stable release ? Is there a plan to be > able to run director and real server on the same host, thus requiring only 2 > hosts instead of 4 to have load balancing and a redundant director ? Either: a) Run two Dovecot instances with different base_dirs and different TCP ports. This has been used by several installations. b) One Dovecot instance with proxy_maybe. I'm not completely sure if this works. I think it does. > 2. director itself was not able or meant to check if one of the real server was > down (some script was pointed long time ago in this list). > > Same questions. This probably not happening anytime soon. It's not always obvious if a backend server is down or just heavily loaded. Better to use an external script that can be tweaked. > 3. you'll have to use dovecot lmtp instead of let's say procmail. Would deliver > be still a choice or is lmtp the only deliver compatible choice ? > > In what case would lmtp be more useful than deliver ? To have some sort of > "remote LDA" ? With LMTP the mailbox access is done by the proper server. With LDA it's always done by the server that runs the LDA, again causing all the troubles that director is supposed to prevent. I've had some thoughts about changing dovecot-lda to be LMTP client by default, but that hasn't happened yet. It wouldn't be difficult to write a separate LMTP client binary (and there probably already are those). > By the way, what gets indexed on deposit on the mailbox since, by definition, > the user has not done any request yet ? Dovecot's caching decisions are remembered. So it adds those headers/etc that the user's current client(s) are interested in. http://wiki2.dovecot.org/Design/Indexes/Cache has some details about the cache decisions. From CMarcus at Media-Brokers.com Tue Dec 4 19:56:17 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 04 Dec 2012 12:56:17 -0500 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE06A4.6020004@info-systems.de> References: <50BE0591.8030907@perkel.com> <50BE06A4.6020004@info-systems.de> Message-ID: <50BE3941.7070306@Media-Brokers.com> On 2012-12-04 9:20 AM, Jakob Curdes wrote: > Am 04.12.2012 15:15, schrieb Marc Perkel: >> Just wondering if there's an open source Linux alternative to MS >> Exchange so that all the features of outlook work? > Did you have a look at zarafa? Most part of it is open source; the > outlook connector ist closed source however and requires a license fee > for more than three clients. > It uses MAPI to connect to Outlook, unlike many other solutions that > do calendar syncs etc. via the ActiveSync protocol. Zarafa is a > completely different thing than dovecot, however; it stores all mails > in a MySQL database. So does SOGo, no plugin required for Outlook. There is an extension for Thunderbird+Lightning, and it also supports most every mobile client out there.... and it uses Dovecot for the IMAP server *now*, and also includes OpenChange and Samba4. It is also supposed to be *very* lightweight, and can integrate with most any other backend you may be using. We currently use PostfixAdmin for managing email users, and we'll be able to happily keep using it for as long as we want after the migration. We will be migrating to SOGo (using Thunderbird+Lightning+Google Calendar now) very soon, and we are fully expecting to leverage the fact that SOGo includes Samba4 in the future, so that when the time comes for another Microsoft Server Upgrade, we will instead 'upgrade' to Samba4, and demote our older 2008R2 servers to member servers - if we keep them around at all. -- Best regards, Charles From bob at computerisms.ca Tue Dec 4 20:07:29 2012 From: bob at computerisms.ca (Bob Miller) Date: Tue, 04 Dec 2012 10:07:29 -0800 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0591.8030907@perkel.com> References: <50BE0591.8030907@perkel.com> Message-ID: <1354644449.2172.23.camel@worklian> If you are into building the system, you can run an IMAP server and a caldav server. Davical gives shared calendars and shared address books, as well as a todo function that nobody every seems to use. In terms of limiations; for outlook you need a 20 euro plugin to support caldav and outlook is a terrible imap client, thunderbird doesn't support the shared address book thing yet, everything works as expected in evolution. Androids and iphones work, but you need something like a funambol server to support blackberry and other super-proprietary mobile devices. You can also add other features to make it shine a little brighter than an exchange server, such as openupload or webdav storage. And, if you really want a windows networking environment, all of this stuff can be made to authenticate against Samba4 active directory... -- Computerisms Bob Miller 867-334-7117 / 867-633-3760 http://computerisms.ca On Tue, 2012-12-04 at 06:15 -0800, Marc Perkel wrote: > Just wondering if there's an open source Linux alternative to MS > Exchange so that all the features of outlook work? > From dave at boostpro.com Tue Dec 4 20:24:03 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 13:24:03 -0500 Subject: [Dovecot] doveadm fts optimize undocumented In-Reply-To: (Timo Sirainen's message of "Tue, 4 Dec 2012 19:01:08 +0200") References: Message-ID: on Tue Dec 04 2012, Timo Sirainen wrote: > On 4.12.2012, at 18.59, Dave Abrahams wrote: > >> on Tue Dec 04 2012, Timo Sirainen wrote: >> >>> On 4.12.2012, at 18.46, Dave Abrahams wrote: >>> >>>> Subject says all. Timo, would you write something up where the world >>>> will find it? Also, it would be great if doveadm fts was covered in the >>>> doveadm manpage. >>> >>> It runs the Lucene's optimize function with fts-lucene backend. Does >>> nothing with others. Basically I think it just gathers multiple Lucene >>> index files together and packs them into a single file, dropping all >>> deleted data (Lucene documentation has more details I think). Similar >>> to what "doveadm purge" does to mdbox files. fts-lucene runs the >>> optimize also internally automatically once in a while, so I'm not >>> sure if that doveadm command should necessarily even exist. >> >> I think the answer lies in your perception of benefits vs maintainance >> (including documentation) costs... ;-) > > Based on the awesome explanation I just gave, I wouldn't mind if > someone converts something based on it to a man page patch! The lack of a working Git mirror really raises the barrier for me to contribute. I was just wondering if you had tried to reinstate it with a recent version of the hggit plugin? It appears to be officially under development at https://bitbucket.org/durin42/hg-git... -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From dave at boostpro.com Tue Dec 4 20:26:19 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 13:26:19 -0500 Subject: [Dovecot] indexer-worker Panic Message-ID: I just found this in my logs. Any idea? --8<---------------cut here---------------start------------->8--- 12/4/12 12:33:43.831 PM dovecot[2660]: indexer-worker(dave): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) 12/4/12 12:33:43.831 PM dovecot[2660]: indexer-worker(dave): Error: Raw backtrace: 2 libdovecot.0.dylib 0x000000010840e6c4 default_fatal_finish + 36 -> 3 libdovecot.0.dylib 0x000000010840f3e1 i_internal_fatal_handler + 49 -> 4 libdovecot.0.dylib 0x000000010840e98e i_panic + 158 -> 5 libdovecot-storage.0.dylib 0x0000000108340693 fs_list_get_path + 467 -> 6 indexer-worker 0x00000001082e7341 master_connection_input + 513 -> 7 libdovecot.0.dylib 0x000000010841b5 12/4/12 12:33:43.831 PM dovecot[2660]: indexer-worker(dave): Error: ce io_loop_call_io + 46 -> 8 libdovecot.0.dylib 0x000000010841c737 io_loop_handler_run + 215 -> 9 libdovecot.0.dylib 0x000000010841b7e8 io_loop_run + 88 -> 10 libdovecot.0.dylib 0x00000001084079c8 master_service_run + 24 -> 11 indexer-worker 0x00000001082e7001 main + 321 -> 12 libdyld.dylib 0x00007fff93d117e1 start + 0 -> 13 ??? 0x0000000000000001 0x0 + 1 12/4/12 12:33:44.035 PM dovecot[2660]: indexer: Error: Indexer worker disconnected, discarding 5 requests for dave 12/4/12 12:33:44.036 PM dovecot[2660]: indexer-worker(dave): Fatal: master: service(indexer-worker): child 2665 killed with signal 6 (core dumps disabled) 12/4/12 12:34:17.094 PM dovecot[2660]: indexer-worker(dave): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) 12/4/12 12:34:17.094 PM dovecot[2660]: indexer-worker(dave): Error: Raw backtrace: 2 libdovecot.0.dylib 0x000000010d1dd6c4 default_fatal_finish + 36 -> 3 libdovecot.0.dylib 0x000000010d1de3e1 i_internal_fatal_handler + 49 -> 4 libdovecot.0.dylib 0x000000010d1dd98e i_panic + 158 -> 5 libdovecot-storage.0.dylib 0x000000010d10d693 fs_list_get_path + 467 -> 6 indexer-worker 0x000000010d0b7341 master_connection_input + 513 -> 7 libdovecot.0.dylib 0x000000010d1ea5 12/4/12 12:34:17.094 PM dovecot[2660]: indexer-worker(dave): Error: ce io_loop_call_io + 46 -> 8 libdovecot.0.dylib 0x000000010d1eb737 io_loop_handler_run + 215 -> 9 libdovecot.0.dylib 0x000000010d1ea7e8 io_loop_run + 88 -> 10 libdovecot.0.dylib 0x000000010d1d69c8 master_service_run + 24 -> 11 indexer-worker 0x000000010d0b7001 main + 321 -> 12 libdyld.dylib 0x00007fff93d117e1 start + 0 -> 13 ??? 0x0000000000000001 0x0 + 1 12/4/12 12:34:17.286 PM dovecot[2660]: indexer: Error: Indexer worker disconnected, discarding 5 requests for dave 12/4/12 12:34:17.286 PM dovecot[2660]: indexer-worker(dave): Fatal: master: service(indexer-worker): child 2677 killed with signal 6 (core dumps disabled) 12/4/12 12:35:48.633 PM dovecot[2660]: indexer-worker(dave): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) 12/4/12 12:35:48.633 PM dovecot[2660]: indexer-worker(dave): Error: Raw backtrace: 2 libdovecot.0.dylib 0x0000000107b606c4 default_fatal_finish + 36 -> 3 libdovecot.0.dylib 0x0000000107b613e1 i_internal_fatal_handler + 49 -> 4 libdovecot.0.dylib 0x0000000107b6098e i_panic + 158 -> 5 libdovecot-storage.0.dylib 0x0000000107a95693 fs_list_get_path + 467 -> 6 indexer-worker 0x0000000107a3d341 master_connection_input + 513 -> 7 libdovecot.0.dylib 0x0000000107b6d5 12/4/12 12:35:48.634 PM dovecot[2660]: indexer-worker(dave): Error: ce io_loop_call_io + 46 -> 8 libdovecot.0.dylib 0x0000000107b6e737 io_loop_handler_run + 215 -> 9 libdovecot.0.dylib 0x0000000107b6d7e8 io_loop_run + 88 -> 10 libdovecot.0.dylib 0x0000000107b599c8 master_service_run + 24 -> 11 indexer-worker 0x0000000107a3d001 main + 321 -> 12 libdyld.dylib 0x00007fff93d117e1 start + 0 -> 13 ??? 0x0000000000000001 0x0 + 1 12/4/12 12:35:48.838 PM dovecot[2660]: indexer: Error: Indexer worker disconnected, discarding 5 requests for dave 12/4/12 12:35:48.838 PM dovecot[2660]: indexer-worker(dave): Fatal: master: service(indexer-worker): child 2694 killed with signal 6 (core dumps disabled) --8<---------------cut here---------------end--------------->8--- -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From dave at boostpro.com Tue Dec 4 20:27:40 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 13:27:40 -0500 Subject: [Dovecot] "no longer mounted" warnings Message-ID: Dovecot seems to be warning about every volume it's ever seen in the past. Is this normal? Can I make it stop? --8<---------------cut here---------------start------------->8--- 12/4/12 12:33:38.148 PM dovecot[2658]: master: Warning: /Volumes/fs is no longer mounted. See http://wiki2.dovecot.org/Mountpoints 12/4/12 12:33:38.148 PM dovecot[2658]: master: Warning: /Volumes/dave is no longer mounted. See http://wiki2.dovecot.org/Mountpoints 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/Groups is no longer mounted. See http://wiki2.dovecot.org/Mountpoints 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/Public is no longer mounted. See http://wiki2.dovecot.org/Mountpoints 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/Users is no longer mounted. See http://wiki2.dovecot.org/Mountpoints 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/GPGTools is no longer mounted. See http://wiki2.dovecot.org/Mountpoints 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /private/tmp/ccc_dmg_mount.weHZmz is no longer mounted. See http://wiki2.dovecot.org/Mountpoints --8<---------------cut here---------------end--------------->8--- -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From tss at iki.fi Tue Dec 4 20:30:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 4 Dec 2012 20:30:09 +0200 Subject: [Dovecot] doveadm fts optimize undocumented In-Reply-To: References: Message-ID: <24F34B1B-0916-4933-8BB9-A615510B862F@iki.fi> On 4.12.2012, at 20.24, Dave Abrahams wrote: >> Based on the awesome explanation I just gave, I wouldn't mind if >> someone converts something based on it to a man page patch! > > The lack of a working Git mirror really raises the barrier for me to > contribute. I was just wondering if you had tried to reinstate it with > a recent version of the hggit plugin? It appears to be officially under > development at https://bitbucket.org/durin42/hg-git... Based on a quick read of the web page, that looks to me more like a reverse of what you want. Or alternatively it looks like something you would install yourself. In any case I'm not really planning on installing an official git mirror. From dave at boostpro.com Tue Dec 4 20:38:32 2012 From: dave at boostpro.com (Dave Abrahams) Date: Tue, 04 Dec 2012 13:38:32 -0500 Subject: [Dovecot] doveadm fts optimize undocumented In-Reply-To: <24F34B1B-0916-4933-8BB9-A615510B862F@iki.fi> (Timo Sirainen's message of "Tue, 4 Dec 2012 20:30:09 +0200") References: <24F34B1B-0916-4933-8BB9-A615510B862F@iki.fi> Message-ID: on Tue Dec 04 2012, Timo Sirainen wrote: > On 4.12.2012, at 20.24, Dave Abrahams wrote: > >>> Based on the awesome explanation I just gave, I wouldn't mind if >>> someone converts something based on it to a man page patch! >> >> The lack of a working Git mirror really raises the barrier for me to >> contribute. I was just wondering if you had tried to reinstate it with >> a recent version of the hggit plugin? It appears to be officially under >> development at https://bitbucket.org/durin42/hg-git... > > Based on a quick read of the web page, that looks to me more like a > reverse of what you want. Or alternatively it looks like something you > would install yourself. I did, actually... > In any case I'm not really planning on installing an official git > mirror. Oh, I thought you had one and it had to be taken offline because it stopped working... maybe I'm thinking of a different project. I'll see what I can do with that plugin. -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From jc at info-systems.de Tue Dec 4 21:00:06 2012 From: jc at info-systems.de (Jakob Curdes) Date: Tue, 04 Dec 2012 20:00:06 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <1354644449.2172.23.camel@worklian> References: <50BE0591.8030907@perkel.com> <1354644449.2172.23.camel@worklian> Message-ID: <50BE4836.4080207@info-systems.de> Am 04.12.2012 19:07, schrieb Bob Miller: > for outlook you need a 20 euro plugin to support caldav and > outlook is a terrible imap client, thunderbird doesn't support the > shared address book thing yet, Outlook is a terrible imap client until including office 2007, with 2010 things have changed a bit since they seem to have abandoned the PST idea which effectively meant "If I cannot find the mail on my disk I will not even ask the server for it". All clients have caching mechanisms but this one was horrible. JC From e-frog at gmx.de Tue Dec 4 21:07:14 2012 From: e-frog at gmx.de (e-frog) Date: Tue, 04 Dec 2012 20:07:14 +0100 Subject: [Dovecot] "no longer mounted" warnings In-Reply-To: References: Message-ID: <50BE49E2.5020200@gmx.de> On 04.12.2012 19:27, wrote Dave Abrahams: > > Dovecot seems to be warning about every volume it's ever seen in the > past. Is this normal? Can I make it stop? > > --8<---------------cut here---------------start------------->8--- > 12/4/12 12:33:38.148 PM dovecot[2658]: master: Warning: /Volumes/fs is no longer mounted. See http://wiki2.dovecot.org/Mountpoints Hmm... See http://wiki2.dovecot.org/Mountpoints > 12/4/12 12:33:38.148 PM dovecot[2658]: master: Warning: /Volumes/dave is no longer mounted. See http://wiki2.dovecot.org/Mountpoints > 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/Groups is no longer mounted. See http://wiki2.dovecot.org/Mountpoints > 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/Public is no longer mounted. See http://wiki2.dovecot.org/Mountpoints > 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/Users is no longer mounted. See http://wiki2.dovecot.org/Mountpoints > 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /Volumes/GPGTools is no longer mounted. See http://wiki2.dovecot.org/Mountpoints > 12/4/12 12:33:38.149 PM dovecot[2658]: master: Warning: /private/tmp/ccc_dmg_mount.weHZmz is no longer mounted. See http://wiki2.dovecot.org/Mountpoints > --8<---------------cut here---------------end--------------->8--- > From p at sys4.de Tue Dec 4 21:35:31 2012 From: p at sys4.de (Patrick Ben Koetter) Date: Tue, 4 Dec 2012 20:35:31 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE3941.7070306@Media-Brokers.com> References: <50BE0591.8030907@perkel.com> <50BE06A4.6020004@info-systems.de> <50BE3941.7070306@Media-Brokers.com> Message-ID: <20121204193531.GA29110@sys4.de> * Charles Marcus : > On 2012-12-04 9:20 AM, Jakob Curdes wrote: > >Am 04.12.2012 15:15, schrieb Marc Perkel: > >>Just wondering if there's an open source Linux alternative to MS > >>Exchange so that all the features of outlook work? > >Did you have a look at zarafa? Most part of it is open source; the > >outlook connector ist closed source however and requires a license > >fee for more than three clients. > >It uses MAPI to connect to Outlook, unlike many other solutions > >that do calendar syncs etc. via the ActiveSync protocol. Zarafa is > >a completely different thing than dovecot, however; it stores all > >mails in a MySQL database. > > So does SOGo, no plugin required for Outlook. There is an extension > for Thunderbird+Lightning, and it also supports most every mobile > client out there.... and it uses Dovecot for the IMAP server *now*, > and also includes OpenChange and Samba4. It is also supposed to be > *very* lightweight, and can integrate with most any other backend > you may be using. We currently use PostfixAdmin for managing email > users, and we'll be able to happily keep using it for as long as we > want after the migration. We've used SOGo for the last three years and we deployed it at various locations - starting from 3 up to 30.000 users. SOGo is stable, the company behind SOGo knows what they are doing. If you plan to migrate a SIEVE configuration you need scripting skills or you will end up adding them all by hand. SOGo currently stores SIEVE rules in its database and writes them into a .sieve on request. It's a one way road. That is actually the onle downside I can think of. > We will be migrating to SOGo (using Thunderbird+Lightning+Google > Calendar now) very soon, and we are fully expecting to leverage the > fact that SOGo includes Samba4 in the future, so that when the time > comes for another Microsoft Server Upgrade, we will instead > 'upgrade' to Samba4, and demote our older 2008R2 servers to member > servers - if we keep them around at all. +1 p at rick -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From daniel.parthey at informatik.tu-chemnitz.de Tue Dec 4 22:57:54 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Tue, 4 Dec 2012 21:57:54 +0100 Subject: [Dovecot] "no longer mounted" warnings In-Reply-To: <50BE49E2.5020200@gmx.de> References: <50BE49E2.5020200@gmx.de> Message-ID: <20121204205754.GA8732@daniel.localdomain> e-frog wrote: > On 04.12.2012 19:27, wrote Dave Abrahams: > See http://wiki2.dovecot.org/Mountpoints Just being curious: Is it possible to ignore all mountpoints with this command? doveadm mount add '*' ignore Where does dovecot store ignored mountpoints? Regards Daniel -- https://plus.google.com/103021802792276734820 From pixilla at macports.org Tue Dec 4 23:06:24 2012 From: pixilla at macports.org (Bradley Giesbrecht) Date: Tue, 4 Dec 2012 13:06:24 -0800 Subject: [Dovecot] "no longer mounted" warnings In-Reply-To: <20121204205754.GA8732@daniel.localdomain> References: <50BE49E2.5020200@gmx.de> <20121204205754.GA8732@daniel.localdomain> Message-ID: <51C1E2B5-D906-49D5-8033-EE629EEB83DE@macports.org> On Dec 4, 2012, at 12:57 PM, Daniel Parthey wrote: > e-frog wrote: >> On 04.12.2012 19:27, wrote Dave Abrahams: >> See http://wiki2.dovecot.org/Mountpoints > > Just being curious: > > Is it possible to ignore all mountpoints with this command? > doveadm mount add '*' ignore > > Where does dovecot store ignored mountpoints? The docs say: ... or ignore all mountpoints under /mnt: doveadm mount add '/mnt/*' ignore ... So in your case try: doveadm mount add '/Volumns/*' ignore Regards, Bradley Giesbrecht (pixilla) -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 2763 bytes Desc: not available URL: From R.E.Sonneveld at sonnection.nl Wed Dec 5 00:54:54 2012 From: R.E.Sonneveld at sonnection.nl (Rolf E. Sonneveld) Date: Tue, 04 Dec 2012 23:54:54 +0100 Subject: [Dovecot] [OT] MS Exchange Alternative? In-Reply-To: <50BE0591.8030907@perkel.com> References: <50BE0591.8030907@perkel.com> Message-ID: <50BE7F3E.4020607@sonnection.nl> Op 04-12-12 15:15, Marc Perkel schreef: > Just wondering if there's an open source Linux alternative to MS > Exchange so that all the features of outlook work? > You may want to check out Zimbra (www.zimbra.com). /rolf From sirtcp at gmail.com Wed Dec 5 07:31:26 2012 From: sirtcp at gmail.com (Muhammad Yousuf Khan) Date: Wed, 5 Dec 2012 10:31:26 +0500 Subject: [Dovecot] dotlock error In-Reply-To: References: Message-ID: Please help. my error log is flooded with thousands of entries like this Dec 4 19:48:15 mailsrv dovecot: IMAP(testmail): file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: /public/.News) util i restart the service things back to normal. however this is not true. i have given 777 to dovecot-uidlist. and i dont know why this is keep generating. please help On Tue, Dec 4, 2012 at 8:18 PM, Muhammad Yousuf Khan wrote: > i finally manage to control access on public folder by File system permission. > i have 3 test users. > > 1. tom > 2. fmaster > 3 . testmail > > tom and fmaster are a group called "news-own" and testmail user is a > readonly one. > > here is my folder structure ill share dovecot -n output at the end of > this email. > > drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 tmp > drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 new > -rwxrwxrwx 1 tom news-own 68 Dec 4 19:08 dovecot-uidlist > -rw-rw-r-T 1 fmaster news-own 16K Dec 4 19:10 dovecot.index.cache > drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:15 cur > -rw-rw-r-T 1 tom news-own 1.1K Dec 4 19:16 dovecot.index.log > > everything works fine as far as user fmaster and tom is concern as > they are member of "news-own" and this group own the mailbox now the > problem i face with readonly users. > > i am getting this error in /var/log/mail.info (against user testmail) > > file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission > denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: > /public/.News > > > at first point i saw this error and i could not subscribe to the > folder. and the said log has been generated. > > now on second stage i change the dovecot-uidlist file permission to > "1666" so that testmail user can also write to the file. > > now problem starts from here, i see two folder one is News and second > one is News-1 and i don't know from where the second folder showed up. > > and when i click on any of the folder my /var/log/mail.info start to > show below massage continuously. until i restart the dovecot service. > > file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission > denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: > /public/.News > > > i search google and i saw that people suggested to set stickey bit on > which i already did or suggested to stop "dot locking" > > so i am here to ask is there any way to solve my said problem with out > disabling dot locking? > > or if i stop dot locking what are the consequences? > > > here i my dovcecot -n > > > root at mailsrv:/public/.News# dovecot -n > # 1.2.15: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 > log_timestamp: %Y-%m-%d %H:%M:%S > ssl_cert_file: /etc/ssl/certs/postfix.pem > ssl_key_file: /etc/ssl/private/postfix.key > login_dir: /var/run/dovecot/login > login_executable: /usr/lib/dovecot/imap-login > mail_privileged_group: mail > mail_location: maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/index > mail_debug: yes > mbox_write_locks: fcntl dotlock > namespace: > type: private > separator: / > inbox: yes > list: yes > subscriptions: yes > namespace: > type: public > separator: / > prefix: Shared folders/ > location: maildir:/public > list: yes > auth default: > mechanisms: plain login > passdb: > driver: pam > userdb: > driver: passwd > socket: > type: listen > client: > path: /var/spool/postfix/private/auth > mode: 432 > user: postfix > group: postfix > > > Thanks in advance, any help or suggestion would be highly appreciated. From nick.z.edwards at gmail.com Wed Dec 5 08:12:16 2012 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Wed, 5 Dec 2012 16:12:16 +1000 Subject: [Dovecot] Quotas 2.1clarification In-Reply-To: <72936630-5A87-4F7A-930E-527A98D9500F@iki.fi> References: <72936630-5A87-4F7A-930E-527A98D9500F@iki.fi> Message-ID: Thanks On 11/23/12, Timo Sirainen wrote: > On 15.11.2012, at 6.55, Nick Edwards wrote: > >> Timo, >> >> I have much suspicion that our quota system is not working correctly >> since we migrate to 2.1 >> Currently using 2.1.10 >> Previously we had for issue of warnings >> >> quota_warning = storage=90%% /scripts/dqwarn-90.sh >> quota_warning2 = storage=75%% /scripts/dqwarn-75.sh >> >> worked great, these lines also migrated to new conf upon conversion. >> >> >> But quota conf example shows >> >> plugin { >> #quota_warning = storage=95%% quota-warning 95 %u >> #quota_warning2 = storage=80%% quota-warning 80 %u >> } >> >> # Example quota-warning service. The unix listener's permissions should >> be >> # set in a way that mail processes can connect to it. Below example >> assumes >> # that mail processes run as vmail user. If you use mode=0666, all system >> users >> # can generate quota warnings to anyone. >> #service quota-warning { >> # executable = script /usr/local/bin/quota-warning.sh >> # user = dovecot >> # unix_listener quota-warning { >> # user = vmail >> # } >> #} >> >> >> So this seems to indicate /scripts/dqwarn-75.sh should be a service >> name, which then calls the service quota-warning with that script in >> it etc etc etc surely this old 4 line method has not been replaced >> into a 20 line mess? > > Yes, it has been replaced with a more complex setup. The new way is more > efficient, safer and "cleaner", even though it's more complex to setup. > >> Is this old way still functioning as I suspect it is not, and we need >> to write up two separate new quota warning services given our warnings >> are worded differently, or should the old methods still be working as >> they did in 1.2 and we have an error elsewhere? > > If you want to run two separate scripts you need two separate services. But > it would be easier to have just one script (= one service) and give the 75 > or 90 as parameter to it. > > From tss at iki.fi Wed Dec 5 08:21:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 5 Dec 2012 08:21:54 +0200 Subject: [Dovecot] dotlock error In-Reply-To: References: Message-ID: Like it says, it's missing write permissions to /public/.News directory. Dovecot keeps recreating the dovecot-uidlist file so it's not enough to change only its permissions. On 5.12.2012, at 7.31, Muhammad Yousuf Khan wrote: > Please help. my error log is flooded with thousands of entries like this > Dec 4 19:48:15 mailsrv dovecot: IMAP(testmail): > file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission > denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: > /public/.News) > util i restart the service things back to normal. however this is not > true. i have given 777 to dovecot-uidlist. and i dont know why this is > keep generating. please help > > On Tue, Dec 4, 2012 at 8:18 PM, Muhammad Yousuf Khan wrote: >> i finally manage to control access on public folder by File system permission. >> i have 3 test users. >> >> 1. tom >> 2. fmaster >> 3 . testmail >> >> tom and fmaster are a group called "news-own" and testmail user is a >> readonly one. >> >> here is my folder structure ill share dovecot -n output at the end of >> this email. >> >> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 tmp >> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 new >> -rwxrwxrwx 1 tom news-own 68 Dec 4 19:08 dovecot-uidlist >> -rw-rw-r-T 1 fmaster news-own 16K Dec 4 19:10 dovecot.index.cache >> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:15 cur >> -rw-rw-r-T 1 tom news-own 1.1K Dec 4 19:16 dovecot.index.log >> >> everything works fine as far as user fmaster and tom is concern as >> they are member of "news-own" and this group own the mailbox now the >> problem i face with readonly users. >> >> i am getting this error in /var/log/mail.info (against user testmail) >> >> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >> /public/.News >> >> >> at first point i saw this error and i could not subscribe to the >> folder. and the said log has been generated. >> >> now on second stage i change the dovecot-uidlist file permission to >> "1666" so that testmail user can also write to the file. >> >> now problem starts from here, i see two folder one is News and second >> one is News-1 and i don't know from where the second folder showed up. >> >> and when i click on any of the folder my /var/log/mail.info start to >> show below massage continuously. until i restart the dovecot service. >> >> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >> /public/.News >> >> >> i search google and i saw that people suggested to set stickey bit on >> which i already did or suggested to stop "dot locking" >> >> so i am here to ask is there any way to solve my said problem with out >> disabling dot locking? >> >> or if i stop dot locking what are the consequences? >> >> >> here i my dovcecot -n >> >> >> root at mailsrv:/public/.News# dovecot -n >> # 1.2.15: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 >> log_timestamp: %Y-%m-%d %H:%M:%S >> ssl_cert_file: /etc/ssl/certs/postfix.pem >> ssl_key_file: /etc/ssl/private/postfix.key >> login_dir: /var/run/dovecot/login >> login_executable: /usr/lib/dovecot/imap-login >> mail_privileged_group: mail >> mail_location: maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/index >> mail_debug: yes >> mbox_write_locks: fcntl dotlock >> namespace: >> type: private >> separator: / >> inbox: yes >> list: yes >> subscriptions: yes >> namespace: >> type: public >> separator: / >> prefix: Shared folders/ >> location: maildir:/public >> list: yes >> auth default: >> mechanisms: plain login >> passdb: >> driver: pam >> userdb: >> driver: passwd >> socket: >> type: listen >> client: >> path: /var/spool/postfix/private/auth >> mode: 432 >> user: postfix >> group: postfix >> >> >> Thanks in advance, any help or suggestion would be highly appreciated. > From sirtcp at gmail.com Wed Dec 5 09:21:17 2012 From: sirtcp at gmail.com (Muhammad Yousuf Khan) Date: Wed, 5 Dec 2012 12:21:17 +0500 Subject: [Dovecot] dotlock error In-Reply-To: References: Message-ID: Thanks, i also notice that it is keep changing. but how could i manage that. because read only users are also unable to read emails. i just keep working on it for many days but no luck. and my need is very simple. a public folder with 1 owner and everyone read only access. i don't know why it is not working. On Wed, Dec 5, 2012 at 11:21 AM, Timo Sirainen wrote: > Like it says, it's missing write permissions to /public/.News directory. Dovecot keeps recreating the dovecot-uidlist file so it's not enough to change only its permissions. > > On 5.12.2012, at 7.31, Muhammad Yousuf Khan wrote: > >> Please help. my error log is flooded with thousands of entries like this >> Dec 4 19:48:15 mailsrv dovecot: IMAP(testmail): >> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >> /public/.News) >> util i restart the service things back to normal. however this is not >> true. i have given 777 to dovecot-uidlist. and i dont know why this is >> keep generating. please help >> >> On Tue, Dec 4, 2012 at 8:18 PM, Muhammad Yousuf Khan wrote: >>> i finally manage to control access on public folder by File system permission. >>> i have 3 test users. >>> >>> 1. tom >>> 2. fmaster >>> 3 . testmail >>> >>> tom and fmaster are a group called "news-own" and testmail user is a >>> readonly one. >>> >>> here is my folder structure ill share dovecot -n output at the end of >>> this email. >>> >>> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 tmp >>> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 new >>> -rwxrwxrwx 1 tom news-own 68 Dec 4 19:08 dovecot-uidlist >>> -rw-rw-r-T 1 fmaster news-own 16K Dec 4 19:10 dovecot.index.cache >>> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:15 cur >>> -rw-rw-r-T 1 tom news-own 1.1K Dec 4 19:16 dovecot.index.log >>> >>> everything works fine as far as user fmaster and tom is concern as >>> they are member of "news-own" and this group own the mailbox now the >>> problem i face with readonly users. >>> >>> i am getting this error in /var/log/mail.info (against user testmail) >>> >>> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >>> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >>> /public/.News >>> >>> >>> at first point i saw this error and i could not subscribe to the >>> folder. and the said log has been generated. >>> >>> now on second stage i change the dovecot-uidlist file permission to >>> "1666" so that testmail user can also write to the file. >>> >>> now problem starts from here, i see two folder one is News and second >>> one is News-1 and i don't know from where the second folder showed up. >>> >>> and when i click on any of the folder my /var/log/mail.info start to >>> show below massage continuously. until i restart the dovecot service. >>> >>> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >>> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >>> /public/.News >>> >>> >>> i search google and i saw that people suggested to set stickey bit on >>> which i already did or suggested to stop "dot locking" >>> >>> so i am here to ask is there any way to solve my said problem with out >>> disabling dot locking? >>> >>> or if i stop dot locking what are the consequences? >>> >>> >>> here i my dovcecot -n >>> >>> >>> root at mailsrv:/public/.News# dovecot -n >>> # 1.2.15: /etc/dovecot/dovecot.conf >>> # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 >>> log_timestamp: %Y-%m-%d %H:%M:%S >>> ssl_cert_file: /etc/ssl/certs/postfix.pem >>> ssl_key_file: /etc/ssl/private/postfix.key >>> login_dir: /var/run/dovecot/login >>> login_executable: /usr/lib/dovecot/imap-login >>> mail_privileged_group: mail >>> mail_location: maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/index >>> mail_debug: yes >>> mbox_write_locks: fcntl dotlock >>> namespace: >>> type: private >>> separator: / >>> inbox: yes >>> list: yes >>> subscriptions: yes >>> namespace: >>> type: public >>> separator: / >>> prefix: Shared folders/ >>> location: maildir:/public >>> list: yes >>> auth default: >>> mechanisms: plain login >>> passdb: >>> driver: pam >>> userdb: >>> driver: passwd >>> socket: >>> type: listen >>> client: >>> path: /var/spool/postfix/private/auth >>> mode: 432 >>> user: postfix >>> group: postfix >>> >>> >>> Thanks in advance, any help or suggestion would be highly appreciated. >> > From tss at iki.fi Wed Dec 5 09:29:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 5 Dec 2012 09:29:23 +0200 Subject: [Dovecot] dotlock error In-Reply-To: References: Message-ID: <97CABCA3-8156-4978-B3F2-DEEE1782780E@iki.fi> Put index/control files elsewhere. See http://wiki2.dovecot.org/SharedMailboxes/Public#Read-only_Maildirs On 5.12.2012, at 9.21, Muhammad Yousuf Khan wrote: > Thanks, i also notice that it is keep changing. but how could i manage > that. because read only users are also unable to read emails. i just > keep working on it for many days but no luck. > > and my need is very simple. a public folder with 1 owner and everyone > read only access. i don't know why it is not working. > > > On Wed, Dec 5, 2012 at 11:21 AM, Timo Sirainen wrote: >> Like it says, it's missing write permissions to /public/.News directory. Dovecot keeps recreating the dovecot-uidlist file so it's not enough to change only its permissions. >> >> On 5.12.2012, at 7.31, Muhammad Yousuf Khan wrote: >> >>> Please help. my error log is flooded with thousands of entries like this >>> Dec 4 19:48:15 mailsrv dovecot: IMAP(testmail): >>> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >>> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >>> /public/.News) >>> util i restart the service things back to normal. however this is not >>> true. i have given 777 to dovecot-uidlist. and i dont know why this is >>> keep generating. please help >>> >>> On Tue, Dec 4, 2012 at 8:18 PM, Muhammad Yousuf Khan wrote: >>>> i finally manage to control access on public folder by File system permission. >>>> i have 3 test users. >>>> >>>> 1. tom >>>> 2. fmaster >>>> 3 . testmail >>>> >>>> tom and fmaster are a group called "news-own" and testmail user is a >>>> readonly one. >>>> >>>> here is my folder structure ill share dovecot -n output at the end of >>>> this email. >>>> >>>> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 tmp >>>> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:08 new >>>> -rwxrwxrwx 1 tom news-own 68 Dec 4 19:08 dovecot-uidlist >>>> -rw-rw-r-T 1 fmaster news-own 16K Dec 4 19:10 dovecot.index.cache >>>> drwxrwxr-t 2 tom news-own 4.0K Dec 4 19:15 cur >>>> -rw-rw-r-T 1 tom news-own 1.1K Dec 4 19:16 dovecot.index.log >>>> >>>> everything works fine as far as user fmaster and tom is concern as >>>> they are member of "news-own" and this group own the mailbox now the >>>> problem i face with readonly users. >>>> >>>> i am getting this error in /var/log/mail.info (against user testmail) >>>> >>>> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >>>> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >>>> /public/.News >>>> >>>> >>>> at first point i saw this error and i could not subscribe to the >>>> folder. and the said log has been generated. >>>> >>>> now on second stage i change the dovecot-uidlist file permission to >>>> "1666" so that testmail user can also write to the file. >>>> >>>> now problem starts from here, i see two folder one is News and second >>>> one is News-1 and i don't know from where the second folder showed up. >>>> >>>> and when i click on any of the folder my /var/log/mail.info start to >>>> show below massage continuously. until i restart the dovecot service. >>>> >>>> file_dotlock_create(/public/.News/dovecot-uidlist) failed: Permission >>>> denied (euid=1002(testmail) egid=1002(testmail) missing +w perm: >>>> /public/.News >>>> >>>> >>>> i search google and i saw that people suggested to set stickey bit on >>>> which i already did or suggested to stop "dot locking" >>>> >>>> so i am here to ask is there any way to solve my said problem with out >>>> disabling dot locking? >>>> >>>> or if i stop dot locking what are the consequences? >>>> >>>> >>>> here i my dovcecot -n >>>> >>>> >>>> root at mailsrv:/public/.News# dovecot -n >>>> # 1.2.15: /etc/dovecot/dovecot.conf >>>> # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 >>>> log_timestamp: %Y-%m-%d %H:%M:%S >>>> ssl_cert_file: /etc/ssl/certs/postfix.pem >>>> ssl_key_file: /etc/ssl/private/postfix.key >>>> login_dir: /var/run/dovecot/login >>>> login_executable: /usr/lib/dovecot/imap-login >>>> mail_privileged_group: mail >>>> mail_location: maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/index >>>> mail_debug: yes >>>> mbox_write_locks: fcntl dotlock >>>> namespace: >>>> type: private >>>> separator: / >>>> inbox: yes >>>> list: yes >>>> subscriptions: yes >>>> namespace: >>>> type: public >>>> separator: / >>>> prefix: Shared folders/ >>>> location: maildir:/public >>>> list: yes >>>> auth default: >>>> mechanisms: plain login >>>> passdb: >>>> driver: pam >>>> userdb: >>>> driver: passwd >>>> socket: >>>> type: listen >>>> client: >>>> path: /var/spool/postfix/private/auth >>>> mode: 432 >>>> user: postfix >>>> group: postfix >>>> >>>> >>>> Thanks in advance, any help or suggestion would be highly appreciated. >>> >> > From jedelsky at master.cz Wed Dec 5 10:09:51 2012 From: jedelsky at master.cz (Jakub Jedelsky) Date: Wed, 05 Dec 2012 09:09:51 +0100 Subject: [Dovecot] dsync: error with hierarchy separator Message-ID: <50BF014F.8060703@master.cz> Hi list! I have a problem with transfering mails from mbox to maildir format. On dovecot wiki I found a dsync tool, which looks good, but returns me an error: # dsync -u mail at example.com mirror mbox:~/mail:INBOX=/var/mail/virtuser_808 dsync(root): Fatal: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) I found a solution with namespaces, but it doesn't work for me, there is still same error - I tried to add "-o separator=/" as option or add it to config file as mentioned there [1]. Can you push me to any solution? My dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.5.2.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_mechanisms = plain login digest-md5 cram-md5 disable_plaintext_auth = no mail_location = maildir:~/.maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { args = scheme=CRYPT username_format=%Lu /etc/dovecot/dovecot.passwd driver = passwd-file } plugin { autocreate = Spam autosubscribe = Spam sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ssl_cert = From johnsone at usc.edu Wed Dec 5 11:08:02 2012 From: johnsone at usc.edu (Erik A Johnson) Date: Wed, 05 Dec 2012 01:08:02 -0800 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: References: Message-ID: <5C6DA114-F90B-43BD-B36A-511D53F82578@usc.edu> FYI, the tcpdump I sent previously was with one of our previously-discussed patches in place: if (!proxy->client_proxy && net_geterror(proxy->fd_ssl) == EBADF) { I'm attaching that dump again (as tcpdump_output_witholdpatch_headeronly.txt), as well as a dump without any of the patches (tcpdump_output_withoutpatches_headeronly.txt) in case there is any difference. On December 4, 2012 6:18:23 AM PST, Ben Morrow wrote: > At 12PM +0000 on 4/12/12 Ben Morrow wrote: >> Well, it looks to me as though xnu/bsd/kern/uipc_socket.c:soreceive will >> indeed return ENOTCONN for a socket which was once successfully >> connected but has now been disconnected. This happens when the socket is >> in the DEFUNCT state, which is a state that doesn't exist in FreeBSD; >> it's not completely clear but I suspect firewalls may be able to put >> arbitrary sockets into that state. > > Investigating a little further, it should be possible to test for this > situation directly. Assuming I'm correct about what's going on here, > this should be both cleaner and safer than mucking about looking for > ENOTCONN and guessing about what's happening. > > Erik, does this make the problem go away? I left out the > proxy->client_proxy test, since AFAICT this is just as likely to happen > on a client socket. > > Ben > > #ifdef SO_ISDEFUNCT > + if (getsockopt(proxy->fd_ssl, SOL_SOCKET, SO_ISDEFUNCT, > + (void *)&err, sizeof(err)) == 0 && err) { > + errstr = t_strdup_printf( > + "%s: socket is defunct", func_name); > + break; > + } > +#endif Nope, SO_ISDEFUNCT isn't defined. -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: tcpdump_output_witholdpatch_headeronly.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: tcpdump_output_withoutpatches_headeronly.txt URL: From ben at morrow.me.uk Wed Dec 5 12:07:14 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Wed, 5 Dec 2012 10:07:14 +0000 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: <5C6DA114-F90B-43BD-B36A-511D53F82578@usc.edu> References: <5C6DA114-F90B-43BD-B36A-511D53F82578@usc.edu> Message-ID: <20121205100713.GE91986@anubis.morrow.me.uk> At 1AM -0800 on 5/12/12 Erik A Johnson wrote: > FYI, the tcpdump I sent previously was with one of our > previously-discussed patches in place: > > if (!proxy->client_proxy && net_geterror(proxy->fd_ssl) == EBADF) { > > I'm attaching that dump again (as > tcpdump_output_witholdpatch_headeronly.txt), as well as a dump without > any of the patches (tcpdump_output_withoutpatches_headeronly.txt) in > case there is any difference. Well, they're certainly different. Are you sure the second trace (withoutpatches) was of a session which went into an infinite loop? The only thing peculiar about that trace is that the server closes the connection after receiving the first packet from the client, but it does so perfectly properly: it ACKs the client's data packet, and does the FIN-FIN/ACK exchance properly. You will notice there are no [R] packets, which indicate something odd is happening at the server end. > On December 4, 2012 6:18:23 AM PST, Ben Morrow wrote: > > At 12PM +0000 on 4/12/12 Ben Morrow wrote: > >> Well, it looks to me as though xnu/bsd/kern/uipc_socket.c:soreceive will > >> indeed return ENOTCONN for a socket which was once successfully > >> connected but has now been disconnected. This happens when the socket is > >> in the DEFUNCT state, which is a state that doesn't exist in FreeBSD; > >> it's not completely clear but I suspect firewalls may be able to put > >> arbitrary sockets into that state. > > > > Investigating a little further, it should be possible to test for this > > situation directly. Assuming I'm correct about what's going on here, > > this should be both cleaner and safer than mucking about looking for > > ENOTCONN and guessing about what's happening. > > > > Erik, does this make the problem go away? I left out the > > proxy->client_proxy test, since AFAICT this is just as likely to happen > > on a client socket. > > > > Ben > > > > #ifdef SO_ISDEFUNCT > > + if (getsockopt(proxy->fd_ssl, SOL_SOCKET, SO_ISDEFUNCT, > > + (void *)&err, sizeof(err)) == 0 && err) { > > + errstr = t_strdup_printf( > > + "%s: socket is defunct", func_name); > > + break; > > + } > > +#endif > > Nope, SO_ISDEFUNCT isn't defined. Oh, sorry, that needs #include at the top. If that doesn't work, then which version of the OS are you building for? AFAICT the DEFUNCT socket flag has been present since at least 10.5, but the SO_ISDEFUNCT option was only introduced in 10.7. This is irritating, actually: it means that to properly fix this on all versions of Mac OS Dovecot would need to include the previous ENOTCONN code #ifndef SO_ISDEFUNCT. Ben From hummel at pasteur.fr Wed Dec 5 12:34:48 2012 From: hummel at pasteur.fr (Thomas Hummel) Date: Wed, 5 Dec 2012 11:34:48 +0100 Subject: [Dovecot] dovecot backend on director ? In-Reply-To: <8660B0A7-8566-4015-A744-BB1155525016@iki.fi> References: <20121204173355.GB2991@parmesan.sis.pasteur.fr> <8660B0A7-8566-4015-A744-BB1155525016@iki.fi> Message-ID: <20121205103447.GB4275@parmesan.sis.pasteur.fr> On Tue, Dec 04, 2012 at 07:44:32PM +0200, Timo Sirainen wrote: > b) One Dovecot instance with proxy_maybe. I'm not completely sure if this works. I think it does. I remember an old thread were someone (you?) said proxy_maybe was not ready (yet?) for director, causing "Proxying loops". Better choose the multiple instance solution then I guess. > With LMTP the mailbox access is done by the proper server. What do you mean by the proper server ? I don't want LMTP to be a SPOF, so I guess that if I've got for instance 2 directors, 2 real servers and mailboxes on NFS, I'd want 2 LMTP servers : on which servers should those LMTP servers run ? On the director servers (which would mean director should have the mailboxes mounted) ? Thanks. -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From fred at fredk.com Wed Dec 5 13:08:33 2012 From: fred at fredk.com (Fred Kilbourn) Date: Wed, 5 Dec 2012 05:08:33 -0600 Subject: [Dovecot] Error: unlink_directory(.../lucene-indexes) with doveadm index Message-ID: <031f01cdd2d8$de4f72d0$9aee5870$@fredk.com> Hi, Per discussion on this previous thread: http://dovecot.org/pipermail/dovecot/2012-October/068849.html I am updating search indexes on all my mailboxes via a nightly cronjob that runs: doveadm index -A '*' The problem we're running into is that random mailboxes will throw the following error during the update (sanitized to conceal actual domain name): doveadm(user at domain.com): Error: unlink_directory(/var/spool/mail/domain.com/user/sdbox/lucene-indexes) failed: Permission denied We have around 250 domains on the server, with a handful of mailboxes on average in each domain. We get this for a varying number of total mailboxes (1 to 6 every night). It is common for the same mailbox to show up a few days in a row and then stop throwing the error. The script is running as root, so there shouldn't be any file level permissions. Any thoughts on the root cause of these errors? What can I provide to help further diagnose? Thanks, Fred Kilbourn From sirtcp at gmail.com Wed Dec 5 14:10:35 2012 From: sirtcp at gmail.com (Muhammad Yousuf Khan) Date: Wed, 5 Dec 2012 17:10:35 +0500 Subject: [Dovecot] dotlock error In-Reply-To: <97CABCA3-8156-4978-B3F2-DEEE1782780E@iki.fi> References: <97CABCA3-8156-4978-B3F2-DEEE1782780E@iki.fi> Message-ID: On Wed, Dec 5, 2012 at 12:29 PM, Timo Sirainen wrote: > Put index/control files elsewhere. See http://wiki2.dovecot.org/SharedMailboxes/Public#Read-only_Maildirs Thanks :) worked, just one single glitch and days of working :(. still there is one more thing which is missing in my case. after separating control and index files. i found no conflicts or permission error. but one thing which i want to control and that is, i dont want users to delete emails from there indexes. for example. i want it to be controlled via owner of the mailbox for instance if HR is sending a new policy announcement no one shell got the right to delete it even from their index files till HR release a new version of document and delete the email manually. do i have to use ACLs in my case or filesystem permissions will be suffice? will ACLs work if i save index and control files on separate location? Please advice, to accomplish my goal do i have to use the public folder or shared mailbox ? i would appreciate your guidance for my newbie type of questions :). > [cut] From rblayzor.bulk at inoc.net Wed Dec 5 17:24:12 2012 From: rblayzor.bulk at inoc.net (Robert Blayzor) Date: Wed, 5 Dec 2012 10:24:12 -0500 Subject: [Dovecot] log_path - expansion possible? Message-ID: Does (or can) the ability to use expansion variables in Dovecot's log_path exist? ie: log_path = /var/log/dovecot/dovecot-%Y%m%d -- Robert Blayzor INOC, LLC rblayzor at inoc.net http://www.inoc.net/~rblayzor/ From tss at iki.fi Wed Dec 5 17:33:59 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 5 Dec 2012 17:33:59 +0200 Subject: [Dovecot] log_path - expansion possible? In-Reply-To: References: Message-ID: On 5.12.2012, at 17.24, Robert Blayzor wrote: > Does (or can) the ability to use expansion variables in Dovecot's log_path exist? > > ie: > > log_path = /var/log/dovecot/dovecot-%Y%m%d Not currently. It would be possible to make it work, but it would require that Dovecot gets SIGHUPed every midnight to get the configuration reloaded. But you could already do that with logrotate, which I think is a better solution anyway. From rblayzor.bulk at inoc.net Wed Dec 5 17:41:31 2012 From: rblayzor.bulk at inoc.net (Robert Blayzor) Date: Wed, 5 Dec 2012 10:41:31 -0500 Subject: [Dovecot] log_path - expansion possible? In-Reply-To: References: Message-ID: <13049E7D-7AD2-470E-AC0B-40663F1224BE@inoc.net> On Dec 5, 2012, at 10:33 AM, Timo Sirainen wrote: > Not currently. It would be possible to make it work, but it would require that Dovecot gets SIGHUPed every midnight to get the configuration reloaded. But you could already do that with logrotate, which I think is a better solution anyway. Why SIGHUP? If it's an already open file handle you could just compare the string expansion against the currently opened log/FH, and if different open a new FH? If not possible perhaps able to pipe logs to an external programs like apache's rotatelogs ? -- Robert Blayzor INOC, LLC rblayzor at inoc.net http://www.inoc.net/~rblayzor/ From tss at iki.fi Wed Dec 5 17:54:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 5 Dec 2012 17:54:34 +0200 Subject: [Dovecot] log_path - expansion possible? In-Reply-To: <13049E7D-7AD2-470E-AC0B-40663F1224BE@inoc.net> References: <13049E7D-7AD2-470E-AC0B-40663F1224BE@inoc.net> Message-ID: <5B8A79B3-63C2-4D71-A58E-339BD8814062@iki.fi> On 5.12.2012, at 17.41, Robert Blayzor wrote: > On Dec 5, 2012, at 10:33 AM, Timo Sirainen wrote: >> Not currently. It would be possible to make it work, but it would require that Dovecot gets SIGHUPed every midnight to get the configuration reloaded. But you could already do that with logrotate, which I think is a better solution anyway. > > > Why SIGHUP? If it's an already open file handle you could just compare the string expansion against the currently opened log/FH, and if different open a new FH? Sure, and it could do that with the other 1000 settings as well. I think I've seen maybe once in last 10 years the same feature request. Not really worth the extra code. > If not possible perhaps able to pipe logs to an external programs like apache's rotatelogs ? In theory, yeah, I guess .. I'd probably make it a new setting, like log_executable = /usr/bin/rotatelogs. But I don't really have time to implement this myself right not. From catalin.petrescu at gmail.com Wed Dec 5 18:47:13 2012 From: catalin.petrescu at gmail.com (Catalin Petrescu) Date: Wed, 5 Dec 2012 11:47:13 -0500 Subject: [Dovecot] NFS, deleting folder issue Message-ID: Hi there, I use dovecot on a server with some Nightmare File Systerm (aka NFS) storage. When I delete a folder, its content gets deleted, but the folder itself does not. Here's what I found: #### Step 1: From a shell, telnet to imap, then create a folder cpetrescu at cpetrescu-mobile:~$ telnet server1.localdomain 143 Trying 10.200.28.36... Connected to server1.localdomain. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 01 login testuser1 Password 01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in 02 create INBOX/F1 02 OK Create completed. #### Step2: On the server, everything is OK, the folder is there [server1: testuser1]# ls -lrtA Maildir/INBOX/ total 4 drwxr-xr-x 5 root root 4096 Dec 5 10:28 F1 [server1: testuser1]# ls -lrtA Maildir/INBOX/F1/ total 12 drwxr-xr-x 2 root root 4096 Dec 5 10:28 tmp drwxr-xr-x 2 root root 4096 Dec 5 10:28 new drwxr-xr-x 2 root root 4096 Dec 5 10:28 cur #### Step3: in the telnet session, delete the folder 03 delete INBOX/F1 03 OK Delete completed. #### Step4: On the server, the content of the folder is gone, but the folder is still there [server1: testuser1]# ls -lrtA Maildir/INBOX/ total 4 drwxr-xr-x 2 root root 4096 Dec 5 10:29 F1 [server1: testuser1]# ls -lrtA Maildir/INBOX/F1/ total 0 #### Debugging: I defined my own my_delete_dir and added it to the delete_dir list in mailbox_list_vfuncs In my_delete_dir I just call readdir on that folder, and print the files via syslog. Here's the content of F1 before calling delete_dir: Dec 05 10:29:14 imap(testuser1): my_delete_dir: d_name: "new" inode: 843617 Dec 05 10:29:14 imap(testuser1): my_delete_dir: d_name: "tmp" inode: 843623 Dec 05 10:29:14 imap(testuser1): my_delete_dir: d_name: "cur" inode: 843616 Dec 05 10:29:14 imap(testuser1): my_delete_dir: d_name: "dovecot.index.log" inode: 2363059 Dec 05 10:29:14 imap(testuser1): my_delete_dir: d_name: "." inode: 843612 Dec 05 10:29:14 imap(testuser1): my_delete_dir: d_name: ".." inode: 807717 And here's its content after calling delete_dir Dec 05 10:29:15 imap(testuser1): my_delete_dir: name: INBOX/F1 Dec 05 10:29:15 imap(testuser1): my_delete_dir: path: /data/testuser1/Maildir/INBOX/F1 Dec 05 10:29:15 imap(testuser1): my_delete_dir: ret: -1 Dec 05 10:29:15 imap(testuser1): my_delete_dir: error: "Directory not empty" trying again Dec 05 10:29:15 imap(testuser1): my_delete_dir: d_name: "." inode: 843612 Dec 05 10:29:15 imap(testuser1): my_delete_dir: d_name: ".." inode: 807717 Dec 05 10:29:15 imap(testuser1): my_delete_dir: d_name: ".nfs0000000000240eb3000000e0" inode: 2363059 Dec 05 10:29:15 imap(testuser1): my_delete_dir: ret: -1 So, the dovecot.index.log was deleted, but it's still open, and the folder can't be deleted because of the pesky .nfs* file. Now, the question: Is there a *magic* function that closes "dovecot.index.log" that I can call before delete_dir()? I tried mailbox_log_close() but it didn't help. Thanks a lot. p.s. Please don't suggest that I should not use NFS! I know that, and I don't really like NFS, but I have no other choice. Catalin Petrescu From daniel.parthey at informatik.tu-chemnitz.de Thu Dec 6 00:35:00 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 5 Dec 2012 23:35:00 +0100 Subject: [Dovecot] log_path - expansion possible? In-Reply-To: References: Message-ID: <20121205223500.GA7642@daniel.localdomain> Robert Blayzor wrote: > Does (or can) the ability to use expansion variables in Dovecot's log_path exist? > log_path = /var/log/dovecot/dovecot-%Y%m%d Dovecot is able to send logs to a (configurable) syslog_facility. Rsyslog logging daemon is able to write different files depending on time. There are available properties like $YEAR $MONTH $DAY $HOUR $MINUTE in rsyslog. Regards Daniel -- https://plus.google.com/103021802792276734820 From rblayzor.bulk at inoc.net Thu Dec 6 00:40:52 2012 From: rblayzor.bulk at inoc.net (Robert Blayzor) Date: Wed, 5 Dec 2012 17:40:52 -0500 Subject: [Dovecot] log_path - expansion possible? In-Reply-To: <20121205223500.GA7642@daniel.localdomain> References: <20121205223500.GA7642@daniel.localdomain> Message-ID: On Dec 5, 2012, at 5:35 PM, Daniel Parthey wrote: > Dovecot is able to send logs to a (configurable) syslog_facility. > Rsyslog logging daemon is able to write different files depending on time. > There are available properties like $YEAR $MONTH $DAY $HOUR $MINUTE in rsyslog. I'm aware of the syslog functionality; the same can be done with syslog-ng. But I was hoping for a something a little more flexible for local filesystem based logs. (or over NFS). As a workaround I just put something like this in cron: mv dovecot.log `date -v-1d +"dovecot-%Y%m%d"` && kill -USR1 `cat /var/run/dovecot/master.pid` -- Robert Blayzor INOC, LLC rblayzor at inoc.net http://www.inoc.net/~rblayzor/ From johnsone at usc.edu Thu Dec 6 06:30:55 2012 From: johnsone at usc.edu (Erik A Johnson) Date: Wed, 05 Dec 2012 20:30:55 -0800 Subject: [Dovecot] dovecot Digest, Vol 116, Issue 11 In-Reply-To: References: Message-ID: <8B0411CE-CF8B-4E49-B929-33FCA83D39B1@usc.edu> On December 5, 2012 2:07:14 AM PST, Ben Morrow wrote: > At 1AM -0800 on 5/12/12 Erik A Johnson wrote: >> FYI, the tcpdump I sent previously was with one of our >> previously-discussed patches in place: >> >> if (!proxy->client_proxy && net_geterror(proxy->fd_ssl) == EBADF) { >> >> I'm attaching that dump again (as >> tcpdump_output_witholdpatch_headeronly.txt), as well as a dump without >> any of the patches (tcpdump_output_withoutpatches_headeronly.txt) in >> case there is any difference. > > Well, they're certainly different. Are you sure the second trace > (withoutpatches) was of a session which went into an infinite loop? > The only thing peculiar about that trace is that the server closes the > connection after receiving the first packet from the client, but it does > so perfectly properly: it ACKs the client's data packet, and does the > FIN-FIN/ACK exchance properly. You will notice there are no [R] packets, > which indicate something odd is happening at the server end. I'm pretty sure, but I've run it again, confirmed that the imap-login process is using 100% of a CPU until I kill it, and have attached the tcpdump. Looks like one packet from SERVER to CLIENT shifted slightly in chronology, but otherwise the same. >>> #ifdef SO_ISDEFUNCT >>> + if (getsockopt(proxy->fd_ssl, SOL_SOCKET, SO_ISDEFUNCT, >>> + (void *)&err, sizeof(err)) == 0 && err) { >>> + errstr = t_strdup_printf( >>> + "%s: socket is defunct", func_name); >>> + break; >>> + } >>> +#endif >> >> Nope, SO_ISDEFUNCT isn't defined. > > Oh, sorry, that needs > > #include > > at the top. If that doesn't work, then which version of the OS are you > building for? AFAICT the DEFUNCT socket flag has been present since at > least 10.5, but the SO_ISDEFUNCT option was only introduced in 10.7. > This is irritating, actually: it means that to properly fix this on all > versions of Mac OS Dovecot would need to include the previous ENOTCONN > code #ifndef SO_ISDEFUNCT. I've got both 10.7 and 10.8 SDKs in Xcode and neither have SO_ISDEFUNCT defined in sys/socket.h (or anywhere else in the usr/include directories) -- there's a SS_DEFUNCT mask defined in sys/socketvar.h -- is that what you're looking for? -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: tcpdump_output_withoutpatches_again_headersonly.txt URL: From johnsone at usc.edu Thu Dec 6 07:43:53 2012 From: johnsone at usc.edu (Erik A Johnson) Date: Wed, 05 Dec 2012 21:43:53 -0800 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: References: Message-ID: <06E508A3-CE6D-4573-917A-A8371C2A27DE@usc.edu> On December 4, 2012 at 4:43:53 AM PST, Ben Morrow wrote: > So, it looks to me as though you have a firewall problem. You may be > able to get more information by setting the kern.ipc.sodefunctlog sysctl > to 1: this should make the kernel log to syslog (or wherever the OSX > kernel logs go) when sockets are made DEFUNCT and when reads fail for > that reason. sudo sysctl -w kern.ipc.sodefunctlog=1 gives the following in the log: 12/5/12 9:10:00.000 PM kernel[0]: sosetdefunct[60169]: (target pid 60169 level 0) so 0xffffff803159c738 [2,1] marked as defunct 12/5/12 9:10:00.000 PM kernel[0]: sodefunct[60169]: (target pid 60169 level 0) so 0xffffff803159c738 [2,1] is now defunct [rcv_si 0x0, snd_si 0x0, rcv_fl 0x9400, snd_fl 0x1400] 12/5/12 9:10:00.000 PM kernel[0]: soreceive[60169]: defunct so 0xffffff803159c738 [2,1] (57) The last line is repeated about once every 4 microseconds until I kill it. From bind at enas.net Thu Dec 6 15:46:35 2012 From: bind at enas.net (Urban Loesch) Date: Thu, 06 Dec 2012 14:46:35 +0100 Subject: [Dovecot] Documentation of Redis and Memcache Backends Message-ID: <50C0A1BB.4090102@enas.net> Hi, in the release notes of 2.1.9 I read that dovecot supports memcache and redis backends for userdb/passdb authentication. This is very interesting for me and should reduce queries and database load of our mysql servers. My idea is to use memcache or redis in our IMAP/POP3 proxies in front of our backend servers. So I would like to try out if it's possible to store proxy information of our backends. For example the backend ip adress. But in the wiki I found only a few configuration settings for redis backend. http://master.wiki2.dovecot.org/AuthDatabase/Dict Also the mentioned example config file "dovecot-dict-auth.conf.ext" with full list of configuration options does not exits in the source of 2.1.11. Have you any idea where I can find the full info or any howtos? Many thanks and regards Urban From ben at morrow.me.uk Thu Dec 6 16:34:41 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Thu, 6 Dec 2012 14:34:41 +0000 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: <8B0411CE-CF8B-4E49-B929-33FCA83D39B1@usc.edu> <06E508A3-CE6D-4573-917A-A8371C2A27DE@usc.edu> Message-ID: <20121206143441.GF91986@anubis.morrow.me.uk> At 9PM -0800 on 5/12/12 Erik A Johnson wrote: > On December 4, 2012 at 4:43:53 AM PST, Ben Morrow wrote: > > > > So, it looks to me as though you have a firewall problem. You may be > > able to get more information by setting the kern.ipc.sodefunctlog sysctl > > to 1: this should make the kernel log to syslog (or wherever the OSX > > kernel logs go) when sockets are made DEFUNCT and when reads fail for > > that reason. > > sudo sysctl -w kern.ipc.sodefunctlog=1 gives the following in the log: > > 12/5/12 9:10:00.000 PM kernel[0]: sosetdefunct[60169]: (target pid > 60169 level 0) so 0xffffff803159c738 [2,1] marked as defunct > 12/5/12 9:10:00.000 PM kernel[0]: sodefunct[60169]: (target pid 60169 > level 0) so 0xffffff803159c738 [2,1] is now defunct [rcv_si 0x0, > snd_si 0x0, rcv_fl 0x9400, snd_fl 0x1400] > 12/5/12 9:10:00.000 PM kernel[0]: soreceive[60169]: defunct so > 0xffffff803159c738 [2,1] (57) > > The last line is repeated about once every 4 microseconds until I kill it. OK, so this at least confirms I'm right about what's going on. (I'm assuming 60169 was the pid of the stuck imap-login process?) At 8PM -0800 on 5/12/12 Erik A Johnson wrote: > On December 5, 2012 2:07:14 AM PST, Ben Morrow wrote: > > > > Well, they're certainly different. Are you sure the second trace > > (withoutpatches) was of a session which went into an infinite loop? > > The only thing peculiar about that trace is that the server closes the > > connection after receiving the first packet from the client, but it does > > so perfectly properly: it ACKs the client's data packet, and does the > > FIN-FIN/ACK exchance properly. You will notice there are no [R] packets, > > which indicate something odd is happening at the server end. > > I'm pretty sure, but I've run it again, confirmed that the imap-login > process is using 100% of a CPU until I kill it, and have attached the > tcpdump. Looks like one packet from SERVER to CLIENT shifted slightly > in chronology, but otherwise the same. OK. > > At 1AM -0800 on 5/12/12 Erik A Johnson wrote: > >> > >> Nope, SO_ISDEFUNCT isn't defined. > > > > Oh, sorry, that needs > > > > #include > > > > at the top. If that doesn't work, then which version of the OS are you > > building for? AFAICT the DEFUNCT socket flag has been present since at > > least 10.5, but the SO_ISDEFUNCT option was only introduced in 10.7. > > This is irritating, actually: it means that to properly fix this on all > > versions of Mac OS Dovecot would need to include the previous ENOTCONN > > code #ifndef SO_ISDEFUNCT. > > I've got both 10.7 and 10.8 SDKs in Xcode and neither have > SO_ISDEFUNCT defined in sys/socket.h (or anywhere else in the > usr/include directories) -- there's a SS_DEFUNCT mask defined in > sys/socketvar.h -- is that what you're looking for? No, it's not: that's the kernel-internal flag, which can't be read from userland. http://opensource.apple.com/source/xnu/xnu-2050.18.24/bsd/sys/socket.h (which is supposedly for 10.8.2) has SO_ISDEFUNCT in among all the other SO_* constants, but I've just noticed it's under #ifndef PRIVATE so maybe it gets removed from the published SDK. I don't really know how Apple system headers get produced. OK, so testing directly isn't going to work. However, I still don't really like the idea of relying on select never to return early during connection setup, nor do I much like testing for this condition every time we try to read. So, how about this (assuming you're not fed up with testing things yet...) Ben --- src/lib/network.c~ 2012-12-06 14:19:33.786585330 +0000 +++ src/lib/network.c 2012-12-06 14:27:46.643586910 +0000 @@ -515,6 +515,22 @@ else return -2; } + +#ifdef __APPLE__ + /* Some Apple firewalls appear to be able to disable a socket + * immediately after accepting, by marking it DEFUNCT. Reads on + * such a socket return immediately with ENOTCONN, which causes + * loops since ENOTCONN is supposed to mean 'wait for the + * connection to finish'. This state can be detected by calling + * connect(): a valid accepted socket will fail with EISCONN, a + * DEFUNCT socket will fail with EOPNOTSUPP. + */ + if (connect(ret, &so.sa, &addrlen) >= 0) + i_panic("dummy connect to detect DEFUNCT socket succeeded"); + if (errno == EOPNOTSUPP) + return -1; +#endif + if (so.sin.sin_family == AF_UNIX) { if (addr != NULL) memset(addr, 0, sizeof(*addr)); From dave at boostpro.com Thu Dec 6 17:18:44 2012 From: dave at boostpro.com (Dave Abrahams) Date: Thu, 06 Dec 2012 10:18:44 -0500 Subject: [Dovecot] "no longer mounted" warnings References: Message-ID: on Tue Dec 04 2012, Dave Abrahams wrote: > Dovecot seems to be warning about every volume it's ever seen in the > past. Is this normal? Can I make it stop? > > 12/4/12 12:33:38.148 PM dovecot[2658]: master: Warning: /Volumes/fs is > no longer mounted. See http://wiki2.dovecot.org/Mountpoints ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Ugh, I feel like an idiot; the answer is right there in the log message. Sorry :( -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From dave at boostpro.com Thu Dec 6 17:31:14 2012 From: dave at boostpro.com (Dave Abrahams) Date: Thu, 06 Dec 2012 10:31:14 -0500 Subject: [Dovecot] [BUMP] When are search indexes updated? References: <508C9C8A.8000309@hardwarefreak.com> <5B4F4081-F687-455F-8078-6B014D204382@iki.fi> Message-ID: There are still quite a few mysteries in here. Can you help me solve them? on Tue Dec 04 2012, Dave Abrahams wrote: >>> 2. "doveadm search text SOMETHINGthatWONTbeFOUND" takes a long time and >>> finds stuff without crashing, but doesn't seem to create the >>> lucene-indexes/ directory in my mdbox, and it takes a long time the >>> next time around. Is "doveadm search" intended to update the FTS >>> indexes if they're missing? >> >> Yes. It should trigger the same doveadm index -q code. Maybe you have >> a (permission) problem connecting to indexer process. It should write >> about that to stderr. > > Well, I'm not seeing anything like that :( > > I just stopped dovecot, removed my lucene-indexes, started dovecot up > again, and issued "doveadm index -q / imap SEARCH body asdfg" > It came back immediately with a prompt, there was no output, and I don't > see an indexer-helper process. In fact, the behavior is the same > without "-q" > >>> 3. Performing a search on a large mailbox through IMAP takes a long time >>> the first time around, during which "top" shows the big cpu hog is >>> /opt/local/libexec/dovecot/indexer-worker, lucene-indexes/ is >>> created, and subsequent searches go quickly. Nice! Is there a >>> reasonably easy way to start such a search on all my mailboxes from >>> the command line by using doveadm or the preauth tunnel? >> >> doveadm index -q / imap SEARCH body asdfg > > This looks completely unlike anything I can find in "man doveadm-index"; > are you sure it's right? I can delete any number of arguments after the > "/" without seeming to affect its behavior. -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From eggert.ehmke at berlin.de Thu Dec 6 18:30:24 2012 From: eggert.ehmke at berlin.de (eehmke) Date: Thu, 6 Dec 2012 08:30:24 -0800 (PST) Subject: [Dovecot] Update configuration for separate mail directory Message-ID: <1354811424307-39163.post@n4.nabble.com> I have a small mail server with virtual users. In my /etc/dovecot/conf.d/10- mail.conf I have this setting: mail_location = maildir:/var/mail/vhosts/%d/%u which is also the home location of each user. Now I learned that this is not the prefered configuration, and in fact some of my sieve subdirectories are mistaken as mail directories. While I understand that I have to create separate mail subdirectories in each user folder, I am not sure where I have to adapt the dovecot configuration files. I could not find a guide, only some scattered hints and of course http://wiki2.dovecot.org/VirtualUsers/Home I guess I have to shut down the server for the reconfiguration, or is there a way to do it on a life system? Eggert -- View this message in context: http://dovecot.2317879.n4.nabble.com/Update-configuration-for-separate-mail-directory-tp39163.html Sent from the Dovecot mailing list archive at Nabble.com. From ben at morrow.me.uk Thu Dec 6 18:37:48 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Thu, 6 Dec 2012 16:37:48 +0000 Subject: [Dovecot] imap-login hanging when firewall blocks ssl handshaking In-Reply-To: <20121206143441.GF91986@anubis.morrow.me.uk> References: <8B0411CE-CF8B-4E49-B929-33FCA83D39B1@usc.edu> <06E508A3-CE6D-4573-917A-A8371C2A27DE@usc.edu> <20121206143441.GF91986@anubis.morrow.me.uk> Message-ID: <20121206163747.GG91986@anubis.morrow.me.uk> At 2PM +0000 on 6/12/12 Ben Morrow wrote: > > + if (connect(ret, &so.sa, &addrlen) >= 0) > + i_panic("dummy connect to detect DEFUNCT socket succeeded"); > + if (errno == EOPNOTSUPP) > + return -1; Ack, forgot to close the new socket... if (errno == EOPNOTSUPP) { close(ret); return -1; } Sorry about that... Ben From dave at boostpro.com Thu Dec 6 18:58:30 2012 From: dave at boostpro.com (Dave Abrahams) Date: Thu, 06 Dec 2012 11:58:30 -0500 Subject: [Dovecot] How can I force FTS reindexing? Message-ID: I threw out my lucene-indexes folder because it seemed to be missing something, and I figured it would get regenerated. Unfortunately, dovecot is only FTS-indexing new mails that come in. Is there a way to get it to reindex everything? -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From dave at boostpro.com Thu Dec 6 19:29:34 2012 From: dave at boostpro.com (Dave Abrahams) Date: Thu, 06 Dec 2012 12:29:34 -0500 Subject: [Dovecot] How can I force FTS reindexing? References: Message-ID: on Thu Dec 06 2012, Dave Abrahams wrote: > I threw out my lucene-indexes folder because it seemed to be missing > something, and I figured it would get regenerated. Unfortunately, > dovecot is only FTS-indexing new mails that come in. Is there a way to > get it to reindex everything? Experimentation shows "doveadm fts rescan" seeming to work. Did I guess right? -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From dave at boostpro.com Thu Dec 6 19:31:24 2012 From: dave at boostpro.com (Dave Abrahams) Date: Thu, 06 Dec 2012 12:31:24 -0500 Subject: [Dovecot] During FTS reindexing, search commands unceremoniously exit Message-ID: Is this intentional? Closing the connection without warning doesn't seem like the best response... --8<---------------cut here---------------start------------->8--- % printf "1 select \"INBOX\"\n2 search body quack\n3 logout\n" | /opt/local/libexec/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY] Logged in as dave * FLAGS (\Answered \Flagged \Deleted \Seen \Draft gnus-forward gnus-expire) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft gnus-forward gnus-expire \*)] Flags permitted. * 31 EXISTS * 0 RECENT * OK [UIDVALIDITY 1349969399] UIDs valid * OK [UIDNEXT 1376] Predicted next UID * OK [HIGHESTMODSEQ 2908] Highest 1 OK [READ-WRITE] Select completed. imap(dave): Info: Connection closed in=45 out=2027404 % --8<---------------cut here---------------end--------------->8--- -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost From jeep at rahul.net Fri Dec 7 00:25:45 2012 From: jeep at rahul.net (Jeff Lacki) Date: Thu, 06 Dec 2012 14:25:45 -0800 Subject: [Dovecot] imap-login - where does the user get filled in from? Message-ID: <20121206222545.825D712992D@aqua.rahul.net> Sorry to ask such a basic question, but I finally got some major hurdles working for imaps on port 993 and Im getting the following when I try to connect from my iphone: imap-login: Disconnected (no auth attempts in 60 secs): user=<>, rip=192.168.1.1, lip=192.168.1.22, TLS handshaking: Disconnected Im using SQL and SSL over 993. I cant seem to find where my user comes from that its blank? Your help is appreciated. Thanks /mf/home/jeep/shell/.signature From chris at rosepointnav.com Fri Dec 7 00:27:36 2012 From: chris at rosepointnav.com (Chris Dutton) Date: Thu, 6 Dec 2012 14:27:36 -0800 Subject: [Dovecot] Message Flag definitions Message-ID: Hello, I am in charge of migrating our mail system from dovecot to another server, and I am having to write a script to do this as tools like imapsync are too slow. What I am trying to find is the definitions of the flags that dovecot adds to the Maildir file name it uses for the IMAP messages. For example what the a and b mean in the following: 1176236036.P7260Q1438.sucia:2,RSab I am looking for all definitions not just a and b. Thanks Chris chris at rosepointnav.com From h.reindl at thelounge.net Fri Dec 7 00:36:41 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 06 Dec 2012 23:36:41 +0100 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121206222545.825D712992D@aqua.rahul.net> References: <20121206222545.825D712992D@aqua.rahul.net> Message-ID: <50C11DF9.6030507@thelounge.net> Am 06.12.2012 23:25, schrieb Jeff Lacki: > > Sorry to ask such a basic question, but I finally got some major > hurdles working for imaps on port 993 and Im getting the following > when I try to connect from my iphone: > > imap-login: Disconnected (no auth attempts in 60 secs): user=<>, rip=192.168.1.1, lip=192.168.1.22, TLS handshaking: Disconnected > > Im using SQL and SSL over 993. I cant seem to find where my user > comes from that its blank? the client disconnects due TLS/SSL handshake at this time no user could be known at all maybe a bad connection -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From user+dovecot at localhost.localdomain.org Fri Dec 7 00:43:38 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 06 Dec 2012 23:43:38 +0100 Subject: [Dovecot] Message Flag definitions In-Reply-To: References: Message-ID: <50C11F9A.10605@localhost.localdomain.org> On 12/06/2012 11:27 PM Chris Dutton wrote: > Hello, > > I am in charge of migrating our mail system from dovecot to another server, and I am having to write a script to do this as tools like imapsync are too slow. > > What I am trying to find is the definitions of the flags that dovecot adds to the Maildir file name it uses for the IMAP messages. > > For example what the a and b mean in the following: > > 1176236036.P7260Q1438.sucia:2,RSab > > I am looking for all definitions not just a and b. > > Thanks > > Chris > chris at rosepointnav.com > The wiki page http://wiki2.dovecot.org/MailboxFormat/Maildir provides some information and related links. Regards Pascal -- The trapper recommends today: beeffeed.1234123 at localdomain.org From jeep at rahul.net Fri Dec 7 00:45:30 2012 From: jeep at rahul.net (Jeff Lacki) Date: Thu, 06 Dec 2012 14:45:30 -0800 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <50C11DF9.6030507@thelounge.net> References: <20121206222545.825D712992D@aqua.rahul.net> <50C11DF9.6030507@thelounge.net> Message-ID: <20121206224531.136181298B8@aqua.rahul.net> Reindl Harald wrote: > Am 06.12.2012 23:25, schrieb Jeff Lacki: > > > > Sorry to ask such a basic question, but I finally got some major > > hurdles working for imaps on port 993 and Im getting the following > > when I try to connect from my iphone: > > > > imap-login: Disconnected (no auth attempts in 60 secs): user=<>, rip=192.168.1.1, lip=192.168.1.22, TLS handshaking: Disconnected > > > > Im using SQL and SSL over 993. I cant seem to find where my user > > comes from that its blank? > > the client disconnects due TLS/SSL handshake > at this time no user could be known at all > maybe a bad connection > Odd, its coming from my iphone and the user is filled out. Ill try deleting it on the phone and re-trying. Thanks /mf/home/jeep/shell/.signature From h.reindl at thelounge.net Fri Dec 7 00:50:11 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 06 Dec 2012 23:50:11 +0100 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121206224531.136181298B8@aqua.rahul.net> References: <20121206222545.825D712992D@aqua.rahul.net> <50C11DF9.6030507@thelounge.net> <20121206224531.136181298B8@aqua.rahul.net> Message-ID: <50C12123.5010503@thelounge.net> Am 06.12.2012 23:45, schrieb Jeff Lacki: > Reindl Harald wrote: > >> Am 06.12.2012 23:25, schrieb Jeff Lacki: >>> >>> Sorry to ask such a basic question, but I finally got some major >>> hurdles working for imaps on port 993 and Im getting the following >>> when I try to connect from my iphone: >>> >>> imap-login: Disconnected (no auth attempts in 60 secs): user=<>, rip=192.168.1.1, lip=192.168.1.22, TLS handshaking: Disconnected >>> >>> Im using SQL and SSL over 993. I cant seem to find where my user >>> comes from that its blank? >> >> the client disconnects due TLS/SSL handshake >> at this time no user could be known at all >> maybe a bad connection >> > > Odd, its coming from my iphone and the user is filled out. that does not matter in any way you refused to understand that if a connection is closed for whateever reason due ssl handshake there is no data information exchanged between client and server > Ill try > deleting it on the phone and re-trying check the auth-mech configured on the phone and which methods your server configuration supports long before the login the server offers auth methods and if the client is configured to a unsupported it closes the connection and apple devices are really braindead in this context -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From jeep at rahul.net Fri Dec 7 00:58:51 2012 From: jeep at rahul.net (Jeff Lacki) Date: Thu, 06 Dec 2012 14:58:51 -0800 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <50C12123.5010503@thelounge.net> References: <20121206222545.825D712992D@aqua.rahul.net> <50C11DF9.6030507@thelounge.net> <20121206224531.136181298B8@aqua.rahul.net> <50C12123.5010503@thelounge.net> Message-ID: <20121206225851.6B6EE12993D@aqua.rahul.net> Reindl Harald wrote: > > check the auth-mech configured on the phone and > which methods your server configuration supports > > long before the login the server offers auth methods and > if the client is configured to a unsupported it closes > the connection and apple devices are really braindead > in this context > I have dovecot setup for: auth_mechanisms = plain login The iphone offers the following: - password - Apple Token - MD5 Challenge-Response - NTLM - HTTP MD5 Digest Im set for password, which I assumed was plaintext which should match my plain mechanism. Im using an AES_DECRYPT in my SQL statement to get the password however, maybe this is part of my issue: password_query = SELECT AES_DECRYPT(password, 'xxx') AS password, \ userid AS user \ FROM users WHERE userid='%u' AND AES_DECRYPT(password, 'xxx')='%w' This is the first time Im attempting to use SQL with SSL. /mf/home/jeep/shell/.signature From ben at morrow.me.uk Fri Dec 7 01:22:10 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Thu, 6 Dec 2012 23:22:10 +0000 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121206222545.825D712992D@aqua.rahul.net> References: <20121206222545.825D712992D@aqua.rahul.net> Message-ID: <20121206232210.GH91986@anubis.morrow.me.uk> At 2PM -0800 on 6/12/12 Jeff Lacki wrote: > > Sorry to ask such a basic question, but I finally got some major > hurdles working for imaps on port 993 and Im getting the following > when I try to connect from my iphone: > > imap-login: Disconnected (no auth attempts in 60 secs): user=<>, > rip=192.168.1.1, lip=192.168.1.22, TLS handshaking: Disconnected Just to be sure: you have replaced the self-signed certificate Dovecot installs with one which is signed by a public CA? Ben From ben at morrow.me.uk Fri Dec 7 02:11:50 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Fri, 7 Dec 2012 00:11:50 +0000 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121206233448.A99AE1295B5@aqua.rahul.net> References: <20121206222545.825D712992D@aqua.rahul.net> <20121206232210.GH91986@anubis.morrow.me.uk> <20121206233448.A99AE1295B5@aqua.rahul.net> Message-ID: <20121207001149.GI91986@anubis.morrow.me.uk> At 3PM -0800 on 6/12/12 Jeff Lacki wrote: > Ben Morrow wrote: > > > > imap-login: Disconnected (no auth attempts in 60 secs): user=<>, > > > rip=192.168.1.1, lip=192.168.1.22, TLS handshaking: Disconnected > > > > Just to be sure: you have replaced the self-signed certificate Dovecot > > installs with one which is signed by a public CA? > > I created my own self-signed certificate with mkcert.sh that comes with > dovecot. Changed my hostname to mail.myhostname.com and the other > stuff, installed etc. An iPhone won't accept a self-signed certificate unless you install it in the system trusted certificate list. I don't know how you do that, or even if it's possible... Ben From jeep at rahul.net Fri Dec 7 02:49:45 2012 From: jeep at rahul.net (Jeff Lacki) Date: Thu, 06 Dec 2012 16:49:45 -0800 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121207001149.GI91986@anubis.morrow.me.uk> References: <20121206222545.825D712992D@aqua.rahul.net> <20121206232210.GH91986@anubis.morrow.me.uk> <20121206233448.A99AE1295B5@aqua.rahul.net> <20121207001149.GI91986@anubis.morrow.me.uk> Message-ID: <20121207004945.A2D201298B9@aqua.rahul.net> Ben Morrow wrote: > > An iPhone won't accept a self-signed certificate unless you install it > in the system trusted certificate list. I don't know how you do that, or > even if it's possible... > > Ben Yes, it can be done. You just put the file in a place in the browser, then go to it and it asks you to install it on the phone. So I did that and it shows that its installed. As I said, I was able to connect to my server and login with: openssl s_client -connect myhost.com:993 successfully, so I am assuming its a config issue somewhere else, though Im still too new to how this works to understand things fully yet. /mf/home/jeep/shell/.signature From jeep at rahul.net Fri Dec 7 04:56:01 2012 From: jeep at rahul.net (Jeff Lacki) Date: Thu, 06 Dec 2012 18:56:01 -0800 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121207004945.A2D201298B9@aqua.rahul.net> References: <20121206222545.825D712992D@aqua.rahul.net> <20121206232210.GH91986@anubis.morrow.me.uk> <20121206233448.A99AE1295B5@aqua.rahul.net> <20121207001149.GI91986@anubis.morrow.me.uk> <20121207004945.A2D201298B9@aqua.rahul.net> Message-ID: <20121207025601.682F61295D1@aqua.rahul.net> jeep at rahul.net (Jeff Lacki) wrote: > Yes, it can be done. You just put the file in a place in the browser, > then go to it and it asks you to install it on the phone. So I did > that and it shows that its installed. > > As I said, I was able to connect to my server and login with: > > openssl s_client -connect myhost.com:993 > > successfully, so I am assuming its a config issue somewhere else, > though Im still too new to how this works to understand things fully yet. > Ok I believe its solved, and it was my fault of course. I hadnt entirely setup the directory structure on my filesystem for the mailbox stuff. Once I cleaned up all the errors that I found using the openssl command above and logging in etc manually, it now seems to work. Sorry if this was wasted bandwidth, maybe it will help someone else later. Thanks for your help! Jeff /mf/home/jeep/shell/.signature From hlx at h3c.de Fri Dec 7 05:17:30 2012 From: hlx at h3c.de (Holger Hegmanns) Date: Fri, 07 Dec 2012 04:17:30 +0100 Subject: [Dovecot] namespace subscription problem Message-ID: <50C15FCA.9000407@h3c.de> Hi all, my problem seems to be a cosmetic one (again). According to the docs: subscriptions: "yes" (default) if this namespace should handle its own subscriptions. If "no", then the first parent namespace with subscriptions=yes will handle it. Therefore is no way to create the following scenario: three namespaces (private, shared, public) the private namespace has to handle its own subscriptions the private namespace setup with "prefix = INBOX." the both shared and public namespace setup with "subscriptions = no" cause there is no so called "parent" namespace. Private namespace setup with "prefix = " works fine, but that's not what I want. namespace { type = public separator = . prefix = public. location = maildir:/var/spool/dovecot/vmail/public subscriptions = no } namespace inbox { type = private separator = . prefix = INBOX. inbox = yes } namespace { type = shared separator = . prefix = user.%%u. location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = no list = children } Any chance that the private namespace can subscribe to shared mailboxes with the principals above? ... Few hours later. Added a default namespace without any prefix: namespace { prefix = separator = . hidden = yes subscriptions = yes } Subscriptions works as expected, but when I telnet to dovecot now the LSUB command shows all boxes beneath the INBOX as well as without the prefix: b lsub "" * * LSUB () "." "Sent" * LSUB () "." "Templates" * LSUB () "." "Trash" * LSUB () "." "Drafts" * LSUB () "." "INBOX.Sent" * LSUB () "." "INBOX.Templates" * LSUB () "." "INBOX.Trash" * LSUB () "." "INBOX.Drafts" * LSUB () "." "INBOX.user.bar.Sent" * LSUB () "." "user.bar.Sent" b OK Lsub completed. Completely stuck Holgert From me at n-art.de Thu Dec 6 11:13:50 2012 From: me at n-art.de (Nils) Date: Thu, 06 Dec 2012 18:13:50 +0900 Subject: [Dovecot] Removing configured SSL certificate file from disk while Dovecot is running spams syslog Message-ID: <50C061CE.7090904@n-art.de> Hi! [root at mikan ~]# dovecot --version 2.1.12 When I remove the SSL certificate from disk while Dovecot is running, it spams syslog with the following log message over and over: Dec 6 17:41:41 mikan dovecot: config: Fatal: Error in configuration file /etc/dovecot/conf.d/10-ssl.conf line 12: ssl_cert: Can't open file /etc/ssl/private/dovecot.pem: No such file or directory Dec 6 17:41:41 mikan dovecot: config: Fatal: Error in configuration file /etc/dovecot/conf.d/10-ssl.conf line 12: ssl_cert: Can't open file /etc/ssl/private/dovecot.pem: No such file or directory Dec 6 17:41:41 mikan dovecot: config: Fatal: Error in configuration file /etc/dovecot/conf.d/10-ssl.conf line 12: ssl_cert: Can't open file /etc/ssl/private/dovecot.pem: No such file or directory [...] Reporting that the certificate went away is fine and useful, but spamming the syslog over and over with hundreds of entries per second(!) is annoying. :( I know what I'm doing, so reporting it once per connection attempt or something is enough. Even if Dovecot just decides to terminate, that would be fine. But a denial of service attack on syslog is not nice. Configuration output follows below. All the best, Nils [root at mikan ~]# dovecot -n # 2.1.12: /etc/dovecot/dovecot.conf # OS: Linux 3.5.4-1-ARCH x86_64 auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes listen = *,:: login_greeting = mail_location = maildir:~/.maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = pop3 service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 10 } ssl_cert = References: <50BF014F.8060703@master.cz> Message-ID: <50C1BDDE.4000002@master.cz> On 12/05/2012 09:09 AM, Jakub Jedelsky wrote: > Hi list! > > I have a problem with transfering mails from mbox to maildir format. On > dovecot wiki I found a dsync tool, which looks good, but returns me an > error: > > # dsync -u mail at example.com mirror mbox:~/mail:INBOX=/var/mail/virtuser_808 > dsync(root): Fatal: Mail locations must use the same virtual mailbox > hierarchy separator (specify separator for the default namespace) > Hi all, problem with namespace is solved (it's good to restart dovecot after changes in config, ehm) but now I have another strange problem. I moved mails from mbox to maildir with command above (with -f and -D added) but in some cases there are not inboxes. There were ntransfered. How can I solve it? I'm trying it again and have these messages: dsync(info at ...): Error: Sync failed for mbox file /var/www/mailbackup/virtuser_505: UID inserted in the middle of mailbox (16563 > 4091, seq=1, idx_msgs=586) dsync(info at ...): Error: Sync failed for mbox file /var/www/mailbackup/virtuser_505: UID inserted in the middle of mailbox (16563 > 4091, seq=1, idx_msgs=586) dsync(info at ...): Info: Faktury: only in dest dsync(info at ...): Info: INBOX.Trash: only in dest dsync(info at ...): Info: test: only in dest dsync(info at ...): Info: Nedorucene maily: only in dest dsync(info at ...): Info: Archives: only in dest dsync(info at ...): Info: ESET Antispam: only in dest dsync(info at ...): Info: RECOVERY PROBLEMS: only in dest dsync(info at ...): Info: Spam: only in dest dsync(info at ...): Info: Drafts: only in dest dsync(info at ...): Info: INBOX_c50e4031a821c1509e2f0000b72b541e: only in dest dsync(info at ...): Info: INBOX: only in dest dsync(info at ...): Info: Sent: only in dest dsync(info at ...): Info: Trash: only in dest dsync(info at ...): Error: Sync failed for mbox file /var/www/mailbackup/virtuser_505: UID inserted in the middle of mailbox (17735 > 17149, seq=1, idx_msgs=586) dsync(info at ...): Error: Sync failed for mbox file /var/www/mailbackup/virtuser_505: UID inserted in the middle of mailbox (17735 > 17149, seq=1, idx_msgs=586) dsync(info at ...): Error: Sync failed for mbox file /var/www/mailbackup/virtuser_505: UID inserted in the middle of mailbox (18907 > 18321, seq=1, idx_msgs=586) Another boxes are moved correctly. I will be happy for any hint. Thank you. -jj From rgm at htt-consult.com Fri Dec 7 16:09:42 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Fri, 07 Dec 2012 09:09:42 -0500 Subject: [Dovecot] Switch from MySQL/CourierMail to MySQL/Dovecot Message-ID: <50C1F8A6.5010503@htt-consult.com> Hello, new here. I am a Centos/Fedora user, and for the past 3 years have been running my mail server using Postfix/MySQL/CourierMail/Squirrelmail on Fedora. The current incantation of the tutorial is at: http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 Well it is time to rebuild my mailserver; this time on Centos 6.3. My goal is to use supplied rpms, not to build my own (and rebuild everytime there is an important update). So I am pulling quotas which has been a pain anyway, and I am investigating using Dovecot in place of CourierMail. In Centos 6.3, the version of Dovecot is: 2.0.9-2 I am looking for a tutorial to assist in the setup, as I am nowhere an expert on any of this (I am a communications security expert in the IETF and IEEE 802). There are a couple items that I have come to depend on in my current setup that are musts in anything new: Virtual user/domain That is, not only virtual domains, but also users defined by domain. So in the MySQL user table, the email value is set to user at domain. Thus a user can receive/send mail from multiple domains with the same addr and only those domains defined for the user in the user table. Obviously there is no coupling of Linux user accounts and email accounts. CourierMail is storing mail under /home/vmail/domain/user/... Encrypted passwords The passwords in the user table in MySQL are encrypted. This will be used to auth the user for POPing or IMAPing and sending their mail. I have encountered a few tutorials where it seems like passwords are stored in the clear? Anyway, not much else! Well as far as the user interface is concerned. Postfix with clamav and spamassassin and maybe one or two extras. And SquirrelMail for Webmail. A better gui than phpMyAdmin for maintaining the tables would be nice, but I don't have a lot of users, so it works well enough. Can someone point me to a tutorial best suited to my needs? Also any firewall rules, as I don't want to turn off iptables (and ip6tables) and any SELinux policy rules to add. Oh, and IPv6 will be a must in the near future, so anything needed to ensure IPv6 working right as well. Thanks From Jost.Krieger+dovecot at rub.de Fri Dec 7 16:46:43 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 7 Dec 2012 15:46:43 +0100 Subject: [Dovecot] Performance problems while running doveadm purge Message-ID: <20121207144642.GA3824@ruhr-uni-bochum.de> I have a rather large and active mdbox (28 GB, 3M mess, 1200 deliveries/day). I usually have no problems working with those mails, and there is some batch processing going on (via doveadm). Every few weeks I try my luck running doveadm purge, and this a) crunches about 5GB (to be expected), b) takes rather long (ok), c) leads to long stretches of blocked mdbox, which is the problem. I always turn off the batch processing, but deliveries take so long that they sometimes give up after timeout (they will come back later), and the IMAP clients get blocked for long minutes. Sometimes even the purge run aborts because of 3-minute-timeouts. What could be going on here (2.1.10)? Jost -- | Jost.Krieger+sig at ruhr-uni-bochum.de Please help stamp out spam! | | Postmaster, JAPH, resident answer machine at RUB Comp. Center | | Sincere words are not sweet, sweet words are not sincere. | | Lao Tse, Tao Te King 81 | From raabe at froglogic.com Fri Dec 7 16:55:16 2012 From: raabe at froglogic.com (Frerich Raabe) Date: Fri, 07 Dec 2012 15:55:16 +0100 Subject: [Dovecot] Cannot STORE \Seen flag on some mails In-Reply-To: <50B5D0E0.2090906@froglogic.com> References: <50B4B7D1.5080204@froglogic.com> <50B4BACB.3020207@froglogic.com> <50B5D0E0.2090906@froglogic.com> Message-ID: <50C20354.9020609@froglogic.com> Am 11/28/2012 9:52 AM, schrieb Frerich Raabe: > Am 11/28/2012 2:26 AM, schrieb Timo Sirainen: >> On 27.11.2012, at 15.06, Frerich Raabe wrote: >>> If I relax the ACL, I can mark the mail as seen myself. I guess >>> that means the question is - why didn't the sieve_before manage to >>> set the flag in all cases. >> >> Difficult to say, but I don't think it's worth debugging with v1.2. >> Might be fixed already in v2.1.. > > Hm, maybe indeed a reason to stop tip-toeing around upgrading to v2.1... > the christmas season is coming, maybe this upgrade would be a good > proejct for the vacation. ;-) For the record, upgrading to Dovecot 2.1.10 and the Pigeonhole plugin helped as far as I can see. Upgrading wasn't too painful (the doveconf-based conversion helped even though the generated configuration file was incomplete) either. Ever since I upgraded I now longer saw the described behaviour. Just in case anybody ever has the same issue and finds this thread in some email archive. :-) -- Frerich Raabe - raabe at froglogic.com www.froglogic.com - Multi-Platform GUI Testing From CMarcus at Media-Brokers.com Fri Dec 7 17:04:17 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 07 Dec 2012 10:04:17 -0500 Subject: [Dovecot] imap-login - where does the user get filled in from? In-Reply-To: <20121207001149.GI91986@anubis.morrow.me.uk> References: <20121206222545.825D712992D@aqua.rahul.net> <20121206232210.GH91986@anubis.morrow.me.uk> <20121206233448.A99AE1295B5@aqua.rahul.net> <20121207001149.GI91986@anubis.morrow.me.uk> Message-ID: <50C20571.2080403@Media-Brokers.com> On 2012-12-06 7:11 PM, Ben Morrow wrote: > An iPhone won't accept a self-signed certificate unless you install it > in the system trusted certificate list. I don't know how you do that, > or even if it's possible... Ben Not true anymore (used to be though)... we use self-signed certs (and have been for a long time). Now, when you first connect, you get a prompt that you just have to say 'Continue' and it installs the cert permanently, although you have to do it twice (once for inbound server, and once for outbound, if the server name is different). I still for the life of me don't understand why Apple (and Thunderbird for that matter), usually so good at the whole 'user experience' thing, doesn't default to, or even allow you to manually choose an option to 'Use same username/password for sending as receiving'... -- Best regards, Charles From stan at hardwarefreak.com Fri Dec 7 23:25:02 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 07 Dec 2012 15:25:02 -0600 Subject: [Dovecot] Performance problems while running doveadm purge In-Reply-To: <20121207144642.GA3824@ruhr-uni-bochum.de> References: <20121207144642.GA3824@ruhr-uni-bochum.de> Message-ID: <50C25EAE.2060900@hardwarefreak.com> On 12/7/2012 8:46 AM, Jost Krieger wrote: > I have a rather large and active mdbox (28 GB, 3M mess, 1200 > deliveries/day). I usually have no problems working with those mails, > and there is some batch processing going on (via doveadm). > > Every few weeks I try my luck running doveadm purge, and this > a) crunches about 5GB (to be expected), > b) takes rather long (ok), > c) leads to long stretches of blocked mdbox, which is the problem. > > I always turn off the batch processing, but deliveries take so long that > they sometimes give up after timeout (they will come back later), and > the IMAP clients get blocked for long minutes. Sometimes even the purge > run aborts because of 3-minute-timeouts. > > What could be going on here (2.1.10)? As always "dovecot -n" output would be helpful as well as log entries showing timeouts or errors. Knowing your mdbox_rotate_size setting would be helpful. Also, are you purging one mailbox at a time, or all of them simultaneously. Have you looked at iostat? It may simply be that you're running out of random seek bandwidth on your storage device. I.e. the heads simply aren't fast enough to keep up with the block requests. Also, which OS and filesystem are you using? Again, "dovecot -n" would have already answered many of these questions. -- Stan From p at sys4.de Sat Dec 8 01:26:58 2012 From: p at sys4.de (Patrick Ben Koetter) Date: Sat, 8 Dec 2012 00:26:58 +0100 Subject: [Dovecot] Dovecot G+ community Message-ID: <20121207232657.GB2857@sys4.de> For those who own a G+ account and don't mind seeing colors in a browser once in a while instead of staring at a black/white terminal all day long, join the Dovecot G+ community p at rick -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From tss at iki.fi Sat Dec 8 10:50:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 8 Dec 2012 10:50:00 +0200 Subject: [Dovecot] Dovecot director doveadm with switch "-A" error In-Reply-To: <1F75A354-F909-4BAB-8843-1821332BFC12@iki.fi> References: <453DDEEC-1372-40D2-ADD5-00F56904C52A@uib.es> <8874EC16-C9A2-4689-91E6-71453FF6ED65@uib.es> <1354065305.2844.30.camel@innu> <1E3289A4-6787-4743-B3F2-D098C6748271@iki.fi> <0202B7EE-0411-46BA-ACF2-6C378C7443B4@uib.es> <1F75A354-F909-4BAB-8843-1821332BFC12@iki.fi> Message-ID: <201FC34F-3321-4130-9DE1-0C05638A091C@iki.fi> On 30.11.2012, at 3.17, Timo Sirainen wrote: >> 2 problem >> when we execute doveadm -o auth_socket_path=director-userdb quota get -A it works for the early users and then return this error on proxy: >> >> doveadm(userabc): Fatal: table formatter doesn't support multi-line values > > Oh. Hmm. I see the problem.. I'll fix it later. For now you could change the formatter with doveadm -f tab or -f flow This problem should be fixed: http://hg.dovecot.org/dovecot-2.1/rev/c1e47738e7c3 From tss at iki.fi Sat Dec 8 11:08:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 8 Dec 2012 11:08:24 +0200 Subject: [Dovecot] Performance problems while running doveadm purge In-Reply-To: <20121207144642.GA3824@ruhr-uni-bochum.de> References: <20121207144642.GA3824@ruhr-uni-bochum.de> Message-ID: <004009ED-55EF-40CC-B2AF-4ECFCFB9268F@iki.fi> On 7.12.2012, at 16.46, Jost Krieger wrote: > I have a rather large and active mdbox (28 GB, 3M mess, 1200 > deliveries/day). I usually have no problems working with those mails, > and there is some batch processing going on (via doveadm). > > Every few weeks I try my luck running doveadm purge, and this > a) crunches about 5GB (to be expected), > b) takes rather long (ok), > c) leads to long stretches of blocked mdbox, which is the problem. > > I always turn off the batch processing, but deliveries take so long that > they sometimes give up after timeout (they will come back later), and > the IMAP clients get blocked for long minutes. Sometimes even the purge > run aborts because of 3-minute-timeouts. > > What could be going on here (2.1.10)? The purging locks the mdbox only while it's writing to indexes, which should be a very short duration. The mdbox isn't locked while the m.* files are being read/written. What 3 minute timeout does purge complain about (exact error message)? Maybe get a strace output of the purge with "strace -tt -o log doveadm purge -u user at domain" and grep for SETLK in them to see how long the locks are being held. From btj at havleik.no Sun Dec 9 12:10:01 2012 From: btj at havleik.no (=?UTF-8?B?QmrDuHJu?= T Johansen) Date: Sun, 9 Dec 2012 11:10:01 +0100 Subject: [Dovecot] Copying mailbox from one mailserver to another? Message-ID: <20121209111001.3c674e44@havleik.no> I see there is a tool called dsync that can do this but what are the cons of using dsync compared to just package the mailbox using tar and then untar the mailbox on the new server? Regards, BTJ -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From arthur at psw.ro Sun Dec 9 19:03:55 2012 From: arthur at psw.ro (Arthur Titeica) Date: Sun, 09 Dec 2012 19:03:55 +0200 Subject: [Dovecot] imap dumps core when connecting with mutt Message-ID: <1693777.jcPe9tMOC4@lhart> Hello, I'm trying to investigate a problem with dovecot/imap dumping core when connecting connecting mith mutt (everything else works). imap(user at domain): Fatal: master: service(imap): child 31752 killed with signal 11 (core dumped) I managed to create a core file and passed that to gdb. The log is here [1]. I hope this helps - please tell me what else would be needed if not. Thanks. [1] http://paste.kde.org/622574/ -- Arthur Titeica From benedetto.vassallo at unipa.it Sun Dec 9 23:12:15 2012 From: benedetto.vassallo at unipa.it (Benedetto Vassallo) Date: Sun, 09 Dec 2012 21:12:15 +0000 Subject: [Dovecot] Maildir hardlinks with sieve In-Reply-To: <20121129130156.86002utrv14t9eic@webmail.unipa.it> References: <20121129130156.86002utrv14t9eic@webmail.unipa.it> Message-ID: <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> Def. Quota Benedetto Vassallo : > Hi all, > First of all, excuse me for my previous posts (Maildir hardlinks). > Today I realized the following issue. > Maildir hardlinks works OK on dovecot 2.1.10 without sieve. > If set sieve plugin in dovecot-lmtp hardlinks stop working. > Is there a way to have both sieve and hardlinks working? > Thank you > -- > Benedetto Vassallo > Sistema Informativo di Ateneo > Settore Gestione Reti Hardware e Software > U.O.B. Sviluppo e manutenzione dei sistemi > Universit? degli studi di Palermo > > Phone: +3909123860056 > Fax: +390916529124 > > ------------------------------------------------------------------------- > This message was sent using the University of Palermo web mail interface. Hi all, As I had no response, I suppose there is no way to have maildir hardlinks work if I set up sieve. Is that correct? hank you. -- Benedetto Vassallo Sistema Informativo di Ateneo Settore Gestione Reti Hardware e Software U.O.B. Sviluppo e manutenzione dei sistemi Universit? degli studi di Palermo Phone: +3909123860056 Fax: +390916529124 From stsiol at yahoo.co.uk Mon Dec 10 09:37:37 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Mon, 10 Dec 2012 07:37:37 +0000 (GMT) Subject: [Dovecot] Copying mailbox from one mailserver to another? In-Reply-To: <20121209111001.3c674e44@havleik.no> References: <20121209111001.3c674e44@havleik.no> Message-ID: <1355125057.79467.YahooMailNeo@web132202.mail.ird.yahoo.com> > I see there is a tool called dsync that can do this but what are the cons of? > using dsync compared to just package the mailbox using tar and then > untar the mailbox on the new server? >? >? > Regards, >? > BTJ ?Ditto ! still interested on this too :-) Are there any related pages on the dovecot wiki ? s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From rs at sys4.de Mon Dec 10 10:21:10 2012 From: rs at sys4.de (Robert Schetterer) Date: Mon, 10 Dec 2012 09:21:10 +0100 Subject: [Dovecot] Copying mailbox from one mailserver to another? In-Reply-To: <1355125057.79467.YahooMailNeo@web132202.mail.ird.yahoo.com> References: <20121209111001.3c674e44@havleik.no> <1355125057.79467.YahooMailNeo@web132202.mail.ird.yahoo.com> Message-ID: <50C59B76.6070102@sys4.de> Am 10.12.2012 08:37, schrieb Spyros Tsiolis: >> I see there is a tool called dsync that can do this but what are the cons of >> using dsync compared to just package the mailbox using tar and then >> untar the mailbox on the new server? >> >> >> Regards, >> >> BTJ > > > > > Ditto ! > > still interested on this too :-) > > Are there any related pages on the dovecot wiki ? > > s. > > > > ---- > "I merely function as a channel that filters > music through the chaos of noise" > - Vangelis > diff tools are not good to compare by general, it depends from where to where with what reason you use them so there i.e is imapsync , dsync, rsync etc as name says imapsync does its job over pure imap i.e good for migration from i.e other imap servers to dove dsync for backup and/or migration from dove to dove i.e with changing i.e mailbox format rsync is a file sync util, if you like to see compare tools in different sceanrios in the wiki youre free to write it at youre own Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From hawat.thufir at gmail.com Mon Dec 10 13:50:43 2012 From: hawat.thufir at gmail.com (Thufir) Date: Mon, 10 Dec 2012 03:50:43 -0800 Subject: [Dovecot] IMAP instead of Maildir on Ubuntu Precise Message-ID: <50C5CC93.1070301@gmail.com> Why is dovecot using Maildir and not IMAP. Or is it using even using Maildir at all? Currently I'm using mailman, postfix and dovecot to manage a mailing list. Mail is sent to thufir at dur.bounceme.net which the "mail server delivery agent stack provided by Ubuntu server team" of dovecot-postfix handles fine, keeping it locally, so far as it goes. The mail ends up in /home/thufir/Maildir, which the balsa mail client reads fine, as it handles Maildir fine. However, I would like to use dovecot-imapd which is installed. However, it's not clear quite how to switch over to IMAP. I see: root at dur:~# root at dur:~# nl /usr/share/dovecot/protocols.d/imapd.protocol 1 protocols = $protocols imap root at dur:~# root at dur:~# grep protocol /etc/dovecot/dovecot.conf # Enable installed protocols !include_try /usr/share/dovecot/protocols.d/*.protocol root at dur:~# which indicates to me that IMAP is configured. So, why is mail showing up using Maildir? I'm looking at: "Once you have chosen, amend the following line in the file /etc/dovecot/dovecot.conf: protocols = pop3 pop3s imap imaps" https://help.ubuntu.com/community/Dovecot Admittedly, I've not looked too closely into Dovecot man pages as I don't want to get too deep into the weeds on that if it's not even Dovecot I need to configure. I'm assuming that it's dovecot which is using Maildir: root at dur:/etc/postfix# root at dur:/etc/postfix# grep dovecot main.cf smtpd_sasl_type = dovecot smtpd_sasl_path = private/dovecot-auth mailbox_command = /usr/lib/dovecot/deliver -c /etc/dovecot/conf.d/01-mail-stack-delivery.conf -m "${EXTENSION}" root at dur:/etc/postfix# Can I force dovecot to only ever use IMAP and never use anything else? Is it maybe postfix which is using Maildir, and this is why my mail shows up as Maildir type mail? thanks, Thufir thufir at dur:~$ thufir at dur:~$ head .balsa/config -n 20 [mailbox-Inbox] Path=/var/mail/thufir Type=LibBalsaMailboxMbox Name=Inbox [mailbox-Outbox] Path=/home/thufir/Maildir/outbox Type=LibBalsaMailboxMbox Name=Outbox [mailbox-Sentbox] Path=/home/thufir/Maildir/sentbox Type=LibBalsaMailboxMbox Name=Sentbox [mailbox-Draftbox] Path=/home/thufir/Maildir/draftbox Type=LibBalsaMailboxMbox Name=Draftbox thufir at dur:~$ From CMarcus at Media-Brokers.com Mon Dec 10 13:56:37 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 10 Dec 2012 06:56:37 -0500 Subject: [Dovecot] IMAP instead of Maildir on Ubuntu Precise In-Reply-To: <50C5CC93.1070301@gmail.com> References: <50C5CC93.1070301@gmail.com> Message-ID: <50C5CDF5.8040406@Media-Brokers.com> On 2012-12-10 6:50 AM, Thufir wrote: > Why is dovecot using Maildir and not IMAP. Or is it using even using > Maildir at all? ? Maildir is a way of *storing* emails. IMAP is a protocol used by mail server *applications*, for providing *access* to email *clients* that speak the IMAP protocol. Now... maybe you can rephrase the question? ;) -- Best regards, Charles From hawat.thufir at gmail.com Mon Dec 10 13:58:45 2012 From: hawat.thufir at gmail.com (Thufir) Date: Mon, 10 Dec 2012 03:58:45 -0800 Subject: [Dovecot] IMAP instead of Maildir on Ubuntu Precise In-Reply-To: <50C5CC93.1070301@gmail.com> References: <50C5CC93.1070301@gmail.com> Message-ID: <50C5CE75.8030202@gmail.com> Well, I'm just confused now because I see, which I should've noticed first, that IMAP is a protocol while Maildir is a Mailbox (type). So, I could very well be using Mailbox with IMAP? What I want to do is to "read" messages from Thunderbird by connecting to dovecot-imapd. Pardon, I'm flailing a bit because of the terminology. thanks, Thufir On 12/10/2012 03:50 AM, Thufir wrote: > Why is dovecot using Maildir and not IMAP. From hawat.thufir at gmail.com Mon Dec 10 14:12:13 2012 From: hawat.thufir at gmail.com (Thufir) Date: Mon, 10 Dec 2012 04:12:13 -0800 Subject: [Dovecot] IMAP instead of Maildir on Ubuntu Precise In-Reply-To: <50C5CDF5.8040406@Media-Brokers.com> References: <50C5CC93.1070301@gmail.com> <50C5CDF5.8040406@Media-Brokers.com> Message-ID: Heh, yes, err, I realized that after sending the question. Let me ask it this way then: 1.) am I using IMAP? and how do I test that it's working. 2.) I can connect to the IMAP server, dovecot-imapd, on localhost? I want to read these messages with Thunderbird, and enter "localhost" to "download" the e-mails. thanks, Thufir On Mon, Dec 10, 2012 at 3:56 AM, Charles Marcus wrote: > On 2012-12-10 6:50 AM, Thufir wrote: > >> Why is dovecot using Maildir and not IMAP. Or is it using even using >> Maildir at all? >> > > ? Maildir is a way of *storing* emails. > > IMAP is a protocol used by mail server *applications*, for providing > *access* to email *clients* that speak the IMAP protocol. > > Now... maybe you can rephrase the question? ;) > > -- > > Best regards, > > Charles > > From acrow at integrafin.co.uk Mon Dec 10 14:12:19 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 10 Dec 2012 12:12:19 +0000 Subject: [Dovecot] IMAP instead of Maildir on Ubuntu Precise In-Reply-To: <50C5CE75.8030202@gmail.com> References: <50C5CC93.1070301@gmail.com> <50C5CE75.8030202@gmail.com> Message-ID: <50C5D1A3.9080909@integrafin.co.uk> On 10/12/12 11:58, Thufir wrote: > Well, I'm just confused now because I see, which I should've noticed > first, that IMAP is a protocol while Maildir is a Mailbox (type). > > So, I could very well be using Mailbox with IMAP? > > What I want to do is to "read" messages from Thunderbird by connecting > to dovecot-imapd. Pardon, I'm flailing a bit because of the terminology. > > thanks, > > Thufir > > On 12/10/2012 03:50 AM, Thufir wrote: >> Why is dovecot using Maildir and not IMAP. > > > In that case you probably want to have Dovecot using Maildir or mdbox as the underlying storage format (both are better performing than Mbox). If dovecot-imapd is running and your authentication is set up ok you should simply be able to connect to the server with Thunderbird and read your email. IMAP clients don't care how the server is storing the email, they just "talk IMAP" and don't see the format the messages are actually stored with. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From hawat.thufir at gmail.com Mon Dec 10 14:23:11 2012 From: hawat.thufir at gmail.com (Thufir) Date: Mon, 10 Dec 2012 04:23:11 -0800 Subject: [Dovecot] IMAP instead of Maildir on Ubuntu Precise In-Reply-To: <50C5D1A3.9080909@integrafin.co.uk> References: <50C5CC93.1070301@gmail.com> <50C5CE75.8030202@gmail.com> <50C5D1A3.9080909@integrafin.co.uk> Message-ID: LOL, ok, well that was a total non-issue. I connected by using "thufir at localhost" and it seems to download all the messages. Well, thanks for the help. Seems silly now. On Mon, Dec 10, 2012 at 4:12 AM, Alex Crow wrote: > On 10/12/12 11:58, Thufir wrote: > >> Well, I'm just confused now because I see, which I should've noticed >> first, that IMAP is a protocol while Maildir is a Mailbox (type). >> >> So, I could very well be using Mailbox with IMAP? >> >> What I want to do is to "read" messages from Thunderbird by connecting to >> dovecot-imapd. Pardon, I'm flailing a bit because of the terminology. >> >> thanks, >> >> Thufir >> >> On 12/10/2012 03:50 AM, Thufir wrote: >> >>> Why is dovecot using Maildir and not IMAP. >>> >> >> >> >> > In that case you probably want to have Dovecot using Maildir or mdbox as > the underlying storage format (both are better performing than Mbox). If > dovecot-imapd is running and your authentication is set up ok you should > simply be able to connect to the server with Thunderbird and read your > email. > > IMAP clients don't care how the server is storing the email, they just > "talk IMAP" and don't see the format the messages are actually stored with. > > Cheers > > Alex > > -- > This message is intended only for the addressee and may contain > confidential information. Unless you are that person, you may not > disclose its contents or use it in any way and are requested to delete > the message along with any attachments and notify us immediately. > > "Transact" is operated by Integrated Financial Arrangements plc > Domain House, 5-7 Singer Street, London EC2A 4BQ > Tel: (020) 7608 4900 Fax: (020) 7608 5300 > (Registered office: as above; Registered in England and Wales under > number: 3727592) > Authorised and regulated by the Financial Services Authority (entered on > the FSA Register; number: 190856) > > From torbjorn at dbb.su.se Mon Dec 10 17:33:08 2012 From: torbjorn at dbb.su.se (Torbjorn Astlind) Date: Mon, 10 Dec 2012 16:33:08 +0100 Subject: [Dovecot] dsync help? Message-ID: <50C600B4.4040603@dbb.su.se> Hi all, I have dovecot serving aprox 200 users through mbox, but the time has come to migrate to a new server, and to use Maildir. Using rsync from the old server I get all user data, i.e /home/*, and inboxes i.e /var/mail/* to a new server. This has worked well for some time as backup. The dsync should convert everything to Maildir, and it does... to an extent. (linebrakes for easy viewing) What I see, is that often, the /home/mail/xxx is NOT resulting in /home/xxx/Maildir/cur All mailboxes from /home/xxx, are properly converted to /home/xxx/Maildir/.name_of_ box Am I misunderstanding something? I get it to work sometimes if I delete the ~/Maildir completely before doing the dsync. All, and any help most welcome, Torbj?rn for i in `cat /home2/torbjorn/SCRIPTS/userlist.txt`; do dsync -D -v -f -u $i -c /etc/dovecot/alt_config/10-mail.MBOX.conf backup maildir:~/Maildir; done > /home2/torbjorn/SCRIPTS/mb2mdRES.txt 2>&1 the -c 10.mail.MBOX.conf contains, the parts I think are relevant for the dsync operation: mail_location = mbox:~/home:INBOX=/home/mail/%u namespace { type = private separator = '/' inbox = yes } dsync(root): Debug: Effective uid=501, gid=501, home=/home/torbjorn dsync(root): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/home:INBOX=/home/mail/torbjorn dsync(root): Debug: fs: root=/home/torbjorn/home, index=, control=, inbox=/home/mail/torbjorn, alt= dsync(root): Debug: Effective uid=501, gid=501, home=/home/torbjorn dsync(root): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir dsync(root): Debug: maildir++: root=/home/torbjorn/Maildir, index=, control=, inbox=/home/torbjorn/Maildir, alt= dsync(root): Debug: Namespace : /home/torbjorn/Maildir doesn't exist yet, using default permissions dsync(root): Debug: Namespace : Using permissions from /home/torbjorn/Maildir: mode=0700 gid=-1 dsync(torbjorn): Debug: Namespace : Using permissions from /home/torbjorn/home: mode=0700 gid=-1 From maura at eclipse.ncsc.mil Mon Dec 10 22:18:18 2012 From: maura at eclipse.ncsc.mil (Maura Dailey) Date: Mon, 10 Dec 2012 15:18:18 -0500 Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files Message-ID: <50C6438A.4010807@eclipse.ncsc.mil> I'm in a situation here at work where I'm trying to support a mixed network of OS X and RHEL desktop machines with a Postfix/Dovecot combination. - user account information is stored in LDAP - user credentials are in MIT Kerberos - server is running RHEL 6/Dovecot 2.0.9/Postfix 2.6.6 I am currently using the PAM passdb module to authenticate my users (I began to have trouble with using GSSAPI directly). After I implemented it, a few weeks later, I noticed that some users were no longer getting their mail if they hadn't logged in during the past day. Postfix's mailq showed that hundreds of messages were backing up in the queue. I eventually tracked it down to leftover Kerberos credential cache files (/tmp/krb5cc_????) sitting in /tmp on the mail server. The presence of expired credential files was preventing Postfix from delivering mail to those users' mail spools. If I delete the credential files manually, Postfix immediately delivers the queued emails. Currently, I have a cron job deleting the files manually every night. Obviously, this is a cruddy solution. I have Dovecot configured on a RHEL 6 box. The Pam stack on a RHEL 6 machine uses sssd (pam_sss.so) for authentication with Kerberos, not pam_krb5.so. I'm trying to track down which piece of the puzzle is responsible for cleaning up leftover credential caches. Is there a configuration option I can pass to Dovecot's passdb directly to clean up these cache files? Do others generally have more success using a custom PAM stack with pam_krb5.so instead of pam_sss.so? Poring over sssd's configuration options didn't reveal anything useful. I'm still not sure why Postfix even cares if there are expired credential cache files in /tmp at all. I'm back to trying GSSAPI directly again as well in the meantime on a few test clients. When I used that in the past, users were getting issued duplicate Kerberos tickets and users were forced to log into the mail server directly using SSH after a day in order to get their mail to work (seemingly a related issue). If I get those same errors again, I'll start another thread. The output of doveconf -N: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.14.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.3 (Santiago) ext4 auth_cache_size = 10 k auth_cache_ttl = 5 hours auth_default_realm = server.com auth_gssapi_hostname = hostname.server.com auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = gssapi plain auth_realms = server.com auth_username_format = %n auth_verbose = no disable_plaintext_auth = yes listen = * mail_location = maildir:/var/spool/mail/%u mail_privileged_group = mail mbox_read_locks = fcntl mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = / type = private } passdb { driver = pam } protocols = pop3 imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = yes ssl_cert = In install file we can read that: sieve__exec_timeout = 10s set timeout for executing program. But regardless of setting this value (say sieve_pipe_exec_timeout=86000) I got: --8<---------------cut here---------------start------------->8--- 2012-12-10 20:55:33 LDA(kjonca): Debug: sieve: action pipe: running program: maildrop.sh 2012-12-10 20:55:43 LDA(kjonca): Debug: program `/home/kjonca/sieve/bin/maildrop.sh' execution timed out: sending TERM signal --8<---------------cut here---------------end--------------->8--- What am I doing wrong? KJ -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewskiej-wprowadzenie/ When does summertime come to Minnesota, you ask? Well, last year, I think it was a Tuesday. From ben at morrow.me.uk Tue Dec 11 00:31:50 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Mon, 10 Dec 2012 22:31:50 +0000 Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files In-Reply-To: <50C6438A.4010807@eclipse.ncsc.mil> References: <50C6438A.4010807@eclipse.ncsc.mil> Message-ID: <20121210223149.GB39964@anubis.morrow.me.uk> At 3PM -0500 on 10/12/12 you (Maura Dailey) wrote: > I'm in a situation here at work where I'm trying to support a mixed > network of OS X and RHEL desktop machines with a Postfix/Dovecot > combination. > - user account information is stored in LDAP > - user credentials are in MIT Kerberos > - server is running RHEL 6/Dovecot 2.0.9/Postfix 2.6.6 > > I am currently using the PAM passdb module to authenticate my users (I > began to have trouble with using GSSAPI directly). After I implemented > it, a few weeks later, I noticed that some users were no longer getting > their mail if they hadn't logged in during the past day. Postfix's mailq > showed that hundreds of messages were backing up in the queue. I > eventually tracked it down to leftover Kerberos credential cache files > (/tmp/krb5cc_????) sitting in /tmp on the mail server. The presence of > expired credential files was preventing Postfix from delivering mail to > those users' mail spools. If I delete the credential files manually, > Postfix immediately delivers the queued emails. This is rather odd. Is krb5-authenticated NFS involved here, or does Postfix's delivery make any other use of Kerberos? The only other thing I can think of is that so many expired ccaches are accumulating that the user goes over their inode quota. > Currently, I have a cron job deleting the files manually every night. > Obviously, this is a cruddy solution. Well, I don't know about that: obviously, it would be a good idea to work out what's going on here, in case it causes anything else to go wrong, but a cronjob clearing out /tmp is a good idea in any case. > I have Dovecot configured on a > RHEL 6 box. The Pam stack on a RHEL 6 machine uses sssd (pam_sss.so) for > authentication with Kerberos, not pam_krb5.so. I'm trying to track down > which piece of the puzzle is responsible for cleaning up leftover > credential caches. Is there a configuration option I can pass to > Dovecot's passdb directly to clean up these cache files? There are two relevant Dovecot settings: passing setcred=yes to the pam passdb will make Dovecot call pam_setcred, and passing session=yes will make it open and immediately close a PAM session. (Probably it ought to wait until the IMAP user logs out to close the session, but currently it can't do that because of the way the passdb lookups are done.) Changing either of these may have an effect, depending on when exactly your PAM module creates and destroys ccaches. > Do others > generally have more success using a custom PAM stack with pam_krb5.so > instead of pam_sss.so? Well, I don't use RH (I use FreeBSD), but I use and would recommend Russ Allbery's pam_krb5.so, which may or may not be the same as the normal pam_krb5.so provided by your system. It has options to control whether and where ccaches are created; assuming Dovecot doesn't need krb5 creds (say, for NFS), you would probably be better off telling it not to create a permanent ccache at all. http://www.eyrie.org/~eagle/software/pam-krb5/ > Poring over sssd's configuration options didn't > reveal anything useful. I'm still not sure why Postfix even cares if > there are expired credential cache files in /tmp at all. > > I'm back to trying GSSAPI directly again as well in the meantime on a > few test clients. When I used that in the past, users were getting > issued duplicate Kerberos tickets and users were forced to log into the > mail server directly using SSH after a day in order to get their mail to > work (seemingly a related issue). If I get those same errors again, I'll > start another thread. This certainly does all sound related. What are the ccache files called: are they just /tmp/krb5cc_UID or is there a random portion as well? Are they being created with the correct permissions, and are there any security policies (SELinux or ACLs of some kind) set up which might interfere with their creation or destruction? What happens if you log in as an ordinary user (preferably using the same PAM stack as Dovecot uses), use klist to find the ccache name and 'ls -i' to find its inode number, then manually kinit again? Does the kinit succeed, and does the new ccache have a different inode number from before? Does the ccache file get removed when you log out? Ben From maura at eclipse.ncsc.mil Tue Dec 11 02:11:10 2012 From: maura at eclipse.ncsc.mil (Maura Dailey) Date: Mon, 10 Dec 2012 19:11:10 -0500 Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files In-Reply-To: <50C679A5.1090903@eclipse.ncsc.mil> References: <50C6438A.4010807@eclipse.ncsc.mil> <20121210223149.GB39964@anubis.morrow.me.uk> <50C679A5.1090903@eclipse.ncsc.mil> Message-ID: <50C67A1E.4070304@eclipse.ncsc.mil> On 12/10/2012 05:31 PM, Ben Morrow wrote: > At 3PM -0500 on 10/12/12 you (Maura Dailey) wrote: >> I'm in a situation here at work where I'm trying to support a mixed >> network of OS X and RHEL desktop machines with a Postfix/Dovecot >> combination. >> - user account information is stored in LDAP >> - user credentials are in MIT Kerberos >> - server is running RHEL 6/Dovecot 2.0.9/Postfix 2.6.6 >> >> I am currently using the PAM passdb module to authenticate my users (I >> began to have trouble with using GSSAPI directly). After I implemented >> it, a few weeks later, I noticed that some users were no longer getting >> their mail if they hadn't logged in during the past day. Postfix's mailq >> showed that hundreds of messages were backing up in the queue. I >> eventually tracked it down to leftover Kerberos credential cache files >> (/tmp/krb5cc_????) sitting in /tmp on the mail server. The presence of >> expired credential files was preventing Postfix from delivering mail to >> those users' mail spools. If I delete the credential files manually, >> Postfix immediately delivers the queued emails. > This is rather odd. Is krb5-authenticated NFS involved here, or does > Postfix's delivery make any other use of Kerberos? The only other thing > I can think of is that so many expired ccaches are accumulating that the > user goes over their inode quota. Each user has one credential cache file in /tmp on the mail server after logging into Dovecot. We aren't using randomized names, so everything is in the standard format /tmp/krb5cc_uid. We do use KRB5 authenticated (and encrypted) NFS, but we don't deliver mail to home directories. Since all users are "real" users, and our office size is small, everyone has a mail spool directory on the mail server. Postfix is configured to use Dovecot for Kerberos. The relevant lines in its /etc/postfix/main.cf are as follows: smtpd_sasl_type = dovecot smtpd_sasl_path = private/auth smtpd_sasl_auth_enable = yes smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_client_restrictions = permit_mynetworks, permit_sasl_authenticated, reject smtpd_sasl_security_options = noanonymous >> Currently, I have a cron job deleting the files manually every night. >> Obviously, this is a cruddy solution. > Well, I don't know about that: obviously, it would be a good idea to > work out what's going on here, in case it causes anything else to go > wrong, but a cronjob clearing out /tmp is a good idea in any case. Fair enough. And of course, I get a cache file every time I use sudo or log in through a GUI. Those aren't cleaned up either! Maybe I should be deleting credential cache files on all the machines every night. Those cache files have never given me a problem, though. >> I have Dovecot configured on a >> RHEL 6 box. The Pam stack on a RHEL 6 machine uses sssd (pam_sss.so) for >> authentication with Kerberos, not pam_krb5.so. I'm trying to track down >> which piece of the puzzle is responsible for cleaning up leftover >> credential caches. Is there a configuration option I can pass to >> Dovecot's passdb directly to clean up these cache files? > There are two relevant Dovecot settings: passing setcred=yes to the pam > passdb will make Dovecot call pam_setcred, and passing session=yes will > make it open and immediately close a PAM session. (Probably it ought to > wait until the IMAP user logs out to close the session, but currently it > can't do that because of the way the passdb lookups are done.) Changing > either of these may have an effect, depending on when exactly your PAM > module creates and destroys ccaches. I've tried session=yes by itself, but I don't think I've tried it with setcred=yes. I'll throw it in there and give it a try after I send this email. >> Do others >> generally have more success using a custom PAM stack with pam_krb5.so >> instead of pam_sss.so? > Well, I don't use RH (I use FreeBSD), but I use and would recommend Russ > Allbery's pam_krb5.so, which may or may not be the same as the normal > pam_krb5.so provided by your system. It has options to control whether > and where ccaches are created; assuming Dovecot doesn't need krb5 creds > (say, for NFS), you would probably be better off telling it not to > create a permanent ccache at all. > > http://www.eyrie.org/~eagle/software/pam-krb5/ I haven't had to configure pam_krb5.so directly before (we use the Red Hat/Fedora configured default, pam_sss.so, which claims to be a one stop shop for LDAP/Kerberos/NIS,etc.), but it does seem to have more options. We certainly don't need credential caches to stick around for email users. All the mail spools are stored on locally mounted storage on the mail server. >> Poring over sssd's configuration options didn't >> reveal anything useful. I'm still not sure why Postfix even cares if >> there are expired credential cache files in /tmp at all. >> >> I'm back to trying GSSAPI directly again as well in the meantime on a >> few test clients. When I used that in the past, users were getting >> issued duplicate Kerberos tickets and users were forced to log into the >> mail server directly using SSH after a day in order to get their mail to >> work (seemingly a related issue). If I get those same errors again, I'll >> start another thread. > This certainly does all sound related. What are the ccache files called: > are they just /tmp/krb5cc_UID or is there a random portion as well? Are > they being created with the correct permissions, and are there any > security policies (SELinux or ACLs of some kind) set up which might > interfere with their creation or destruction? No random portion (the only application we have configured with random ccache names is SSH), just the usual /tmp/krb5cc_uid. Permissions appear correct, they belong to the appropriate user and group accounts. The SELinux permissions are set to: system_u:object_r:user_tmp_t:s0. This is different from the machine's credential cache (system_u:object_r:gssd_tmp_t:s0), but I've disabled and re-enabled SELinux during different parts of my testing and didn't notice any errors. Using GSSAPI directly doesn't create any cached credential files on the server. However, I just verified that I'm still sporadically getting the duplicate tickets (two lines for imap/hostname.server.com at SERVER.COM, with identical expiration dates). It comes and goes. I have a few users testing it for me, and they'll let me know if their logins break tomorrow like they have in the past once the normal log in period elapses. Since the "fix" for that problem is to log into the mail server, I have a hard time testing for the problem myself (being logged into the mail server nearly continuously just now). > What happens if you log in as an ordinary user (preferably using the > same PAM stack as Dovecot uses), use klist to find the ccache name and > 'ls -i' to find its inode number, then manually kinit again? Does the > kinit succeed, and does the new ccache have a different inode number > from before? Does the ccache file get removed when you log out? I've noticed that the ccache files for regular users do not get deleted when they log out. On another user's workstation, I found a ccache file for my account from a week ago (my current session was using a randomly generated SSH ccache file). I ran a command with sudo to force it to reauthenticate with pam_sss, and the timestamp on the ccache file was updated and the inode changed. My best guess is that pam_sss.so just doesn't do ccache cleanup. > Ben > Thanks for taking a look, I appreciate all the suggestions. This problem's been driving me up a wall for weeks now. I only just managed to narrow down the cause in the last few days. If I can't get a fix working in Dovecot, I'll try tackling it from a different perspective. I understand why Dovecot might not be cleaning up credential files (especially if it's just calling PAM normally), but I definitely do not understand why Postfix is behaving the way it does. If I can just get GSSAPI to work, I could probably bypass the problem as well. - Maura Dailey maura at eclipse.ncsc.mil From kjonca at o2.pl Tue Dec 11 12:18:06 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Tue, 11 Dec 2012 11:18:06 +0100 Subject: [Dovecot] doveadm-lda - segfault Message-ID: <87obi0j3j5.fsf@alfa.kjonca> I have simple old message: --8<---------------cut here---------------start------------->8--- X-Mozilla-Status: 0011 X-Mozilla-Status2: 00000000 Date: Wed, 26 Jan 2000 13:38:41 +0100 From: Kamil Jonca To: Somebody X Subject: Re: Opisy Message-ID: <20000126133839.B2888 at localhost.localdomain> References: Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-2 Content-Transfer-Encoding: 8bit X-Mailer: Mutt 0.95.5us In-Reply-To: ; from Somebody X on Wed, Jan 26, 2000 at 01:37:52PM +0000 X-Operating-System: 'Linux localhost.localdomain 2.2.9-27mdk #1 Mon Jan 24 15:49:34 CET 2000 i686 unknown' X-Geek: GIT d s+:- a-- C++ UL P+ L++ E W N+ w- PS+ PE++ PGP t-- X-- R- tv- b+ D+ G e h-- r- z? Lines: 30 X-KJONCA-Clamav-Status: No jd;fladflsd;lc dfgn;sdhgfad abffhahgl fadn;al sdfnad;hfa fna;lhfla -- shfkah --8<---------------cut here---------------end--------------->8--- When I try to dovecot-lda < message.txt (for sieve refiltering) I got segmentation fault. Does it is bug in lda, or message does not keep standards? KJ -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewskiej-wprowadzenie/ Sanity and insanity overlap a fine grey line. From web at guzman.com.ar Tue Dec 11 15:25:41 2012 From: web at guzman.com.ar (Ricardo) Date: Tue, 11 Dec 2012 10:25:41 -0300 Subject: [Dovecot] Switch from MySQL/CourierMail to MySQL/Dovecot In-Reply-To: <50C1F8A6.5010503@htt-consult.com> References: <50C1F8A6.5010503@htt-consult.com> Message-ID: 2012/12/7 Robert Moskowitz : > Hello, new here. > > I am a Centos/Fedora user, and for the past 3 years have been running my > mail server using Postfix/MySQL/CourierMail/Squirrelmail on Fedora. The > current incantation of the tutorial is at: > > http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 > > Well it is time to rebuild my mailserver; this time on Centos 6.3. My goal > is to use supplied rpms, not to build my own (and rebuild everytime there is > an important update). So I am pulling quotas which has been a pain anyway, > and I am investigating using Dovecot in place of CourierMail. In Centos > 6.3, the version of Dovecot is: 2.0.9-2 > > I am looking for a tutorial to assist in the setup, as I am nowhere an > expert on any of this (I am a communications security expert in the IETF and > IEEE 802). There are a couple items that I have come to depend on in my > current setup that are musts in anything new: > > Virtual user/domain > > That is, not only virtual domains, but also users defined by domain. So in > the MySQL user table, the email value is set to user at domain. Thus a user > can receive/send mail from multiple domains with the same addr and only > those domains defined for the user in the user table. > > Obviously there is no coupling of Linux user accounts and email accounts. > CourierMail is storing mail under /home/vmail/domain/user/... > > Encrypted passwords > > The passwords in the user table in MySQL are encrypted. This will be used > to auth the user for POPing or IMAPing and sending their mail. I have > encountered a few tutorials where it seems like passwords are stored in the > clear? > > Anyway, not much else! Well as far as the user interface is concerned. > Postfix with clamav and spamassassin and maybe one or two extras. And > SquirrelMail for Webmail. A better gui than phpMyAdmin for maintaining the > tables would be nice, but I don't have a lot of users, so it works well > enough. > > Can someone point me to a tutorial best suited to my needs? > > Also any firewall rules, as I don't want to turn off iptables (and > ip6tables) and any SELinux policy rules to add. > > Oh, and IPv6 will be a must in the near future, so anything needed to ensure > IPv6 working right as well. > > Thanks > > Hola a todos disculpen por mi idioma espa?ol.. aqui eh llegado hacer andar mi servidor de correo, aqu? te paso un link que esta muy bien explicado aver si te sirve http://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot-mysql/ con postfixadmin anduvo b?rbaro. solo lo prob? un rato, no lo tengo en producci?n. si te animas a configurar y si te anduvo av?sanos por aqu? o si te falta algo te paso mi archivo.conf saludos Ricardo From rgm at htt-consult.com Tue Dec 11 15:44:28 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Tue, 11 Dec 2012 08:44:28 -0500 Subject: [Dovecot] Switch from MySQL/CourierMail to MySQL/Dovecot In-Reply-To: References: <50C1F8A6.5010503@htt-consult.com> Message-ID: <50C738BC.2030701@htt-consult.com> On 12/11/2012 08:25 AM, Ricardo wrote: > 2012/12/7 Robert Moskowitz : >> Hello, new here. >> >> I am a Centos/Fedora user, and for the past 3 years have been running my >> mail server using Postfix/MySQL/CourierMail/Squirrelmail on Fedora. The >> current incantation of the tutorial is at: >> >> http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 >> >> Well it is time to rebuild my mailserver; this time on Centos 6.3. My goal >> is to use supplied rpms, not to build my own (and rebuild everytime there is >> an important update). So I am pulling quotas which has been a pain anyway, >> and I am investigating using Dovecot in place of CourierMail. In Centos >> 6.3, the version of Dovecot is: 2.0.9-2 >> >> I am looking for a tutorial to assist in the setup, as I am nowhere an >> expert on any of this (I am a communications security expert in the IETF and >> IEEE 802). There are a couple items that I have come to depend on in my >> current setup that are musts in anything new: >> >> Virtual user/domain >> >> That is, not only virtual domains, but also users defined by domain. So in >> the MySQL user table, the email value is set to user at domain. Thus a user >> can receive/send mail from multiple domains with the same addr and only >> those domains defined for the user in the user table. >> >> Obviously there is no coupling of Linux user accounts and email accounts. >> CourierMail is storing mail under /home/vmail/domain/user/... >> >> Encrypted passwords >> >> The passwords in the user table in MySQL are encrypted. This will be used >> to auth the user for POPing or IMAPing and sending their mail. I have >> encountered a few tutorials where it seems like passwords are stored in the >> clear? >> >> Anyway, not much else! Well as far as the user interface is concerned. >> Postfix with clamav and spamassassin and maybe one or two extras. And >> SquirrelMail for Webmail. A better gui than phpMyAdmin for maintaining the >> tables would be nice, but I don't have a lot of users, so it works well >> enough. >> >> Can someone point me to a tutorial best suited to my needs? >> >> Also any firewall rules, as I don't want to turn off iptables (and >> ip6tables) and any SELinux policy rules to add. >> >> Oh, and IPv6 will be a must in the near future, so anything needed to ensure >> IPv6 working right as well. >> >> Thanks >> >> > Hola a todos > > disculpen por mi idioma espa?ol.. Sorry, I am dyslexic and basically flunked High School Spanish some 45 years ago... (they really did not know what dyslexia was back then) Really wish I COULD understand what you wrote. > > aqui eh llegado hacer andar mi servidor de correo, aqu? te paso un > link que esta muy bien explicado aver si te sirve > > > http://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot-mysql/ Someone else (in another conversation) sent me this link last night. I am reading it and figuring out how to apply it to Centos. I ASSuME that you are pointing me to this link as a tutorial :) !! > > con postfixadmin anduvo b?rbaro. solo lo prob? un rato, no lo tengo en > producci?n. si te animas a configurar y si te anduvo av?sanos por aqu? > o si te falta algo te paso mi archivo.conf > > > saludos > > Ricardo > From ben at morrow.me.uk Tue Dec 11 15:52:17 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Tue, 11 Dec 2012 13:52:17 +0000 Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files In-Reply-To: <50C67A1E.4070304@eclipse.ncsc.mil> References: <50C6438A.4010807@eclipse.ncsc.mil> <20121210223149.GB39964@anubis.morrow.me.uk> <50C679A5.1090903@eclipse.ncsc.mil> <50C67A1E.4070304@eclipse.ncsc.mil> Message-ID: <20121211135217.GC39964@anubis.morrow.me.uk> At 7PM -0500 on 10/12/12 you (Maura Dailey) wrote: > On 12/10/2012 05:31 PM, Ben Morrow wrote: > > At 3PM -0500 on 10/12/12 you (Maura Dailey) wrote: > >> I'm in a situation here at work where I'm trying to support a mixed > >> network of OS X and RHEL desktop machines with a Postfix/Dovecot > >> combination. > >> - user account information is stored in LDAP > >> - user credentials are in MIT Kerberos > >> - server is running RHEL 6/Dovecot 2.0.9/Postfix 2.6.6 > >> > >> I am currently using the PAM passdb module to authenticate my users (I > >> began to have trouble with using GSSAPI directly). After I implemented > >> it, a few weeks later, I noticed that some users were no longer getting > >> their mail if they hadn't logged in during the past day. Postfix's mailq > >> showed that hundreds of messages were backing up in the queue. I > >> eventually tracked it down to leftover Kerberos credential cache files > >> (/tmp/krb5cc_????) sitting in /tmp on the mail server. The presence of > >> expired credential files was preventing Postfix from delivering mail to > >> those users' mail spools. If I delete the credential files manually, > >> Postfix immediately delivers the queued emails. > > This is rather odd. Is krb5-authenticated NFS involved here, or does > > Postfix's delivery make any other use of Kerberos? The only other thing > > I can think of is that so many expired ccaches are accumulating that the > > user goes over their inode quota. > > Each user has one credential cache file in /tmp on the mail server after > logging into Dovecot. We aren't using randomized names, so everything is > in the standard format /tmp/krb5cc_uid. We do use KRB5 authenticated > (and encrypted) NFS, but we don't deliver mail to home directories. > Since all users are "real" users, and our office size is small, everyone > has a mail spool directory on the mail server. Hmm. I don't have much experience with KrbNFS, and none at all on Linux, but the implementations I've seen seem to be terribly flaky about passing krb5 creds to the kernel. (What they ought to do is implement AFS' aklog and setpag; they're irritating, but at least they're well-understood...) In any case, it's likely that the delivery process looks in the user's home directory even if delivery is to a separate mail spool, unless you've taken steps to prevent this. For instance, Postfix's local(8) checks for ~/.forward by default, LDAs like procmail or maildrop look for similar per-user RC files, and Dovecot's LDA looks for (at least) ~/.dovecot.sieve. Is it possible that the NFS code returns a different error for 'no ccache present' vs 'ccache present but the creds have expired', such that Postfix will carry on delvering if it gets the first error but not the second? > > Well, I don't use RH (I use FreeBSD), but I use and would recommend Russ > > Allbery's pam_krb5.so, which may or may not be the same as the normal > > pam_krb5.so provided by your system. It has options to control whether > > and where ccaches are created; assuming Dovecot doesn't need krb5 creds > > (say, for NFS), you would probably be better off telling it not to > > create a permanent ccache at all. > > > > http://www.eyrie.org/~eagle/software/pam-krb5/ > I haven't had to configure pam_krb5.so directly before (we use the Red > Hat/Fedora configured default, pam_sss.so, which claims to be a one stop > shop for LDAP/Kerberos/NIS,etc.), but it does seem to have more options. > We certainly don't need credential caches to stick around for email > users. All the mail spools are stored on locally mounted storage on the > mail server. Where do users' private IMAP folders live? Are they in the mail spool as well, or are they in the user's home directory? Once a user has logged in Dovecot will change directory to their home directory (as returned by the userdb), so you may find you *do* need ccaches if they are on KrbNFS. > > This certainly does all sound related. What are the ccache files called: > > are they just /tmp/krb5cc_UID or is there a random portion as well? Are > > they being created with the correct permissions, and are there any > > security policies (SELinux or ACLs of some kind) set up which might > > interfere with their creation or destruction? > No random portion (the only application we have configured with random > ccache names is SSH), just the usual /tmp/krb5cc_uid. (I assume you're aware of the potential DoS here, given that /tmp is world-writable and sticky? I'm not sure if there's anything you can do about it if you're using KrbNFS, though.) > Permissions appear > correct, they belong to the appropriate user and group accounts. The > SELinux permissions are set to: system_u:object_r:user_tmp_t:s0. This is > different from the machine's credential cache > (system_u:object_r:gssd_tmp_t:s0), but I've disabled and re-enabled > SELinux during different parts of my testing and didn't notice any errors. I know nothing whatever about SELinux, but this might be relevant. gssd handles client-side credentials for NFS, so if it ends up unable to snoop on a user's ccache you will have problems. (This is why you can't rename them to something secure, and is the problem aklog solves.) > Using GSSAPI directly doesn't create any cached credential files on the > server. However, I just verified that I'm still sporadically getting the > duplicate tickets (two lines for imap/hostname.server.com at SERVER.COM, > with identical expiration dates). That's odd, but it shouldn't be a problem. A valid ticket is a valid ticket, regardless of whatever other tickets might exist. > It comes and goes. I have a few users > testing it for me, and they'll let me know if their logins break > tomorrow like they have in the past once the normal log in period > elapses. Since the "fix" for that problem is to log into the mail > server, I have a hard time testing for the problem myself (being logged > into the mail server nearly continuously just now). It sounds to me as though clearing out dead ccaches, maybe even with an hourly-or-more cronjob that only deletes them if they've expired, will fix the problem for the moment. A more fundamental fix will require understanding when your PAM modules delete ccaches, and possibly turning off Postfix features like ~/.forward if you're not using them. AFAICS the only piece of Dovecot configuration that might be relevant at this point is that a user's Dovecot home directory does not have to be the same as their 'real' home directory, so you can (if necessary) move all Dovecot-related files onto a local disk. See http://wiki2.dovecot.org/AuthDatabase/Passwd . Ben From web at guzman.com.ar Tue Dec 11 16:32:56 2012 From: web at guzman.com.ar (Ricardo) Date: Tue, 11 Dec 2012 11:32:56 -0300 Subject: [Dovecot] Switch from MySQL/CourierMail to MySQL/Dovecot In-Reply-To: <50C738BC.2030701@htt-consult.com> References: <50C1F8A6.5010503@htt-consult.com> <50C738BC.2030701@htt-consult.com> Message-ID: 2012/12/11 Robert Moskowitz : > > On 12/11/2012 08:25 AM, Ricardo wrote: >> >> 2012/12/7 Robert Moskowitz : >>> >>> Hello, new here. >>> >>> I am a Centos/Fedora user, and for the past 3 years have been running my >>> mail server using Postfix/MySQL/CourierMail/Squirrelmail on Fedora. The >>> current incantation of the tutorial is at: >>> >>> >>> http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 >>> >>> Well it is time to rebuild my mailserver; this time on Centos 6.3. My >>> goal >>> is to use supplied rpms, not to build my own (and rebuild everytime there >>> is >>> an important update). So I am pulling quotas which has been a pain >>> anyway, >>> and I am investigating using Dovecot in place of CourierMail. In Centos >>> 6.3, the version of Dovecot is: 2.0.9-2 >>> >>> I am looking for a tutorial to assist in the setup, as I am nowhere an >>> expert on any of this (I am a communications security expert in the IETF >>> and >>> IEEE 802). There are a couple items that I have come to depend on in my >>> current setup that are musts in anything new: >>> >>> Virtual user/domain >>> >>> That is, not only virtual domains, but also users defined by domain. So >>> in >>> the MySQL user table, the email value is set to user at domain. Thus a user >>> can receive/send mail from multiple domains with the same addr and only >>> those domains defined for the user in the user table. >>> >>> Obviously there is no coupling of Linux user accounts and email accounts. >>> CourierMail is storing mail under /home/vmail/domain/user/... >>> >>> Encrypted passwords >>> >>> The passwords in the user table in MySQL are encrypted. This will be >>> used >>> to auth the user for POPing or IMAPing and sending their mail. I have >>> encountered a few tutorials where it seems like passwords are stored in >>> the >>> clear? >>> >>> Anyway, not much else! Well as far as the user interface is concerned. >>> Postfix with clamav and spamassassin and maybe one or two extras. And >>> SquirrelMail for Webmail. A better gui than phpMyAdmin for maintaining >>> the >>> tables would be nice, but I don't have a lot of users, so it works well >>> enough. >>> >>> Can someone point me to a tutorial best suited to my needs? >>> >>> Also any firewall rules, as I don't want to turn off iptables (and >>> ip6tables) and any SELinux policy rules to add. >>> >>> Oh, and IPv6 will be a must in the near future, so anything needed to >>> ensure >>> IPv6 working right as well. >>> >>> Thanks >>> >>> >> Hola a todos >> >> disculpen por mi idioma espa?ol.. > > > Sorry, I am dyslexic and basically flunked High School Spanish some 45 years > ago... > > (they really did not know what dyslexia was back then) > > Really wish I COULD understand what you wrote. > > >> >> aqui eh llegado hacer andar mi servidor de correo, aqu? te paso un >> link que esta muy bien explicado aver si te sirve >> >> >> >> http://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot-mysql/ > > > Someone else (in another conversation) sent me this link last night. I am > reading it and figuring out how to apply it to Centos. > > I ASSuME that you are pointing me to this link as a tutorial :) !! > > >> >> con postfixadmin anduvo b?rbaro. solo lo prob? un rato, no lo tengo en >> producci?n. si te animas a configurar y si te anduvo av?sanos por aqu? >> o si te falta algo te paso mi archivo.conf >> >> >> saludos >> >> Ricardo >> > Hello My English language can be bad by translate Google know how to apologize. If you pass as a tutorial but some things will not go well so I had to change. I lacking of webmail, was thinking do with Rouncube, me quede alli without installing. I encourage you to improve this tutotial to it or update it, you decide to contribute with something? I tried them on Ubuntu server 12.04 x 32 works perfect... I miss the DNS and MX not is how to configure that part you have any idea how to configure? And also install Debian 6.06 ne but the dovecot dovecot-mysql - core dovecot-pop3d imapd not installed by dependency problems... If you arrive to run well you can share your settings! Best regards Ricardo From maura at eclipse.ncsc.mil Tue Dec 11 20:38:33 2012 From: maura at eclipse.ncsc.mil (Maura Dailey) Date: Tue, 11 Dec 2012 13:38:33 -0500 Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files In-Reply-To: <20121211135217.GC39964@anubis.morrow.me.uk> References: <50C6438A.4010807@eclipse.ncsc.mil> <20121210223149.GB39964@anubis.morrow.me.uk> <50C679A5.1090903@eclipse.ncsc.mil> <50C67A1E.4070304@eclipse.ncsc.mil> <20121211135217.GC39964@anubis.morrow.me.uk> Message-ID: <50C77DA9.1000901@eclipse.ncsc.mil> On 12/11/2012 08:52 AM, Ben Morrow wrote: > At 7PM -0500 on 10/12/12 you (Maura Dailey) wrote: >> On 12/10/2012 05:31 PM, Ben Morrow wrote: >>> At 3PM -0500 on 10/12/12 you (Maura Dailey) wrote: >>>> I'm in a situation here at work where I'm trying to support a mixed >>>> network of OS X and RHEL desktop machines with a Postfix/Dovecot >>>> combination. >>>> - user account information is stored in LDAP >>>> - user credentials are in MIT Kerberos >>>> - server is running RHEL 6/Dovecot 2.0.9/Postfix 2.6.6 >>>> >>>> I am currently using the PAM passdb module to authenticate my users (I >>>> began to have trouble with using GSSAPI directly). After I implemented >>>> it, a few weeks later, I noticed that some users were no longer getting >>>> their mail if they hadn't logged in during the past day. Postfix's mailq >>>> showed that hundreds of messages were backing up in the queue. I >>>> eventually tracked it down to leftover Kerberos credential cache files >>>> (/tmp/krb5cc_????) sitting in /tmp on the mail server. The presence of >>>> expired credential files was preventing Postfix from delivering mail to >>>> those users' mail spools. If I delete the credential files manually, >>>> Postfix immediately delivers the queued emails. >>> This is rather odd. Is krb5-authenticated NFS involved here, or does >>> Postfix's delivery make any other use of Kerberos? The only other thing >>> I can think of is that so many expired ccaches are accumulating that the >>> user goes over their inode quota. >> Each user has one credential cache file in /tmp on the mail server after >> logging into Dovecot. We aren't using randomized names, so everything is >> in the standard format /tmp/krb5cc_uid. We do use KRB5 authenticated >> (and encrypted) NFS, but we don't deliver mail to home directories. >> Since all users are "real" users, and our office size is small, everyone >> has a mail spool directory on the mail server. > Hmm. I don't have much experience with KrbNFS, and none at all on Linux, > but the implementations I've seen seem to be terribly flaky about > passing krb5 creds to the kernel. (What they ought to do is implement > AFS' aklog and setpag; they're irritating, but at least they're > well-understood...) Flaky is an understatement. Especially when you have to support Mac OS X users. After months of intermittent RPC errors, I had to revert them to NFS3. At least the RHEL users can use NFS4 and get the speed bump. > In any case, it's likely that the delivery process looks in the user's > home directory even if delivery is to a separate mail spool, unless > you've taken steps to prevent this. For instance, Postfix's local(8) > checks for ~/.forward by default, LDAs like procmail or maildrop look > for similar per-user RC files, and Dovecot's LDA looks for (at least) > ~/.dovecot.sieve. Is it possible that the NFS code returns a different > error for 'no ccache present' vs 'ccache present but the creds have > expired', such that Postfix will carry on delvering if it gets the first > error but not the second? That is a very good point. We're using Postfix's local, which probably doesn't even know it needs credentials. It looks like I can change the forward_path, or set allow_mail_to_commands and allow_mail_to_files to disallow forwarding. As I said, we're a small office, so I doubt anyone will complain. I've set up forwarding for users on travel before in /etc/aliases. > >>> Well, I don't use RH (I use FreeBSD), but I use and would recommend Russ >>> Allbery's pam_krb5.so, which may or may not be the same as the normal >>> pam_krb5.so provided by your system. It has options to control whether >>> and where ccaches are created; assuming Dovecot doesn't need krb5 creds >>> (say, for NFS), you would probably be better off telling it not to >>> create a permanent ccache at all. >>> >>> http://www.eyrie.org/~eagle/software/pam-krb5/ >> I haven't had to configure pam_krb5.so directly before (we use the Red >> Hat/Fedora configured default, pam_sss.so, which claims to be a one stop >> shop for LDAP/Kerberos/NIS,etc.), but it does seem to have more options. >> We certainly don't need credential caches to stick around for email >> users. All the mail spools are stored on locally mounted storage on the >> mail server. > Where do users' private IMAP folders live? Are they in the mail spool as > well, or are they in the user's home directory? Once a user has logged > in Dovecot will change directory to their home directory (as returned by > the userdb), so you may find you *do* need ccaches if they are on KrbNFS. User's IMAP folders live in their mail spools. I've been watching the maillogs all morning, and I've noticed that my test users (who are using GSSAPI without leaving credential files behind) are getting the error message "Error: chdir(/home/user/) failed: Permission denied (euid=1000(user) egid=2002(group) missing +x perm: /home, euid is not dir owner)," so your premise that the credential files might have been reused for Kerberos seems to be correct. However, I'd much rather prevent Dovecot AND Postfix from looking in /home. I will try your tip that you gave at the end of your email, overriding the user's home directory. >>> This certainly does all sound related. What are the ccache files called: >>> are they just /tmp/krb5cc_UID or is there a random portion as well? Are >>> they being created with the correct permissions, and are there any >>> security policies (SELinux or ACLs of some kind) set up which might >>> interfere with their creation or destruction? >> No random portion (the only application we have configured with random >> ccache names is SSH), just the usual /tmp/krb5cc_uid. > (I assume you're aware of the potential DoS here, given that /tmp is > world-writable and sticky? I'm not sure if there's anything you can do > about it if you're using KrbNFS, though.) Oh yeah, I'm painfully aware of how vulnerable we are to this now. Even if I find a fix, I'm pretty sure the cron job stays. If I can get direct GSSAPI logins (which don't create credential cache files) to work on the Macs, then I can proceed to lock down /tmp some more. Right now, if I create an empty file /tmp/krb5cc_myuid and chown it to root, sudo breaks. I assume the same is true even if I just create it as a different user. >> Permissions appear >> correct, they belong to the appropriate user and group accounts. The >> SELinux permissions are set to: system_u:object_r:user_tmp_t:s0. This is >> different from the machine's credential cache >> (system_u:object_r:gssd_tmp_t:s0), but I've disabled and re-enabled >> SELinux during different parts of my testing and didn't notice any errors. > I know nothing whatever about SELinux, but this might be relevant. gssd > handles client-side credentials for NFS, so if it ends up unable to > snoop on a user's ccache you will have problems. (This is why you can't > rename them to something secure, and is the problem aklog solves.) The targeted policy in RHEL really simplifies SELinux deployment. I've only ever had a few problems with it (usually whenever they start covering a service for the first time). In this case, PAM can clobber the files without a problem, so it's probably the case that user_tmp_t is generous enough. >> Using GSSAPI directly doesn't create any cached credential files on the >> server. However, I just verified that I'm still sporadically getting the >> duplicate tickets (two lines for imap/hostname.server.com at SERVER.COM, >> with identical expiration dates). > That's odd, but it shouldn't be a problem. A valid ticket is a valid > ticket, regardless of whatever other tickets might exist. I suspect it's the kind of thing you notice when you're debugging things and not otherwise. It did make me wonder if I'd somehow screwed up my keytab file, but it looks clean and all the key numbers match. >> It comes and goes. I have a few users >> testing it for me, and they'll let me know if their logins break >> tomorrow like they have in the past once the normal log in period >> elapses. Since the "fix" for that problem is to log into the mail >> server, I have a hard time testing for the problem myself (being logged >> into the mail server nearly continuously just now). > It sounds to me as though clearing out dead ccaches, maybe even with an > hourly-or-more cronjob that only deletes them if they've expired, will > fix the problem for the moment. A more fundamental fix will require > understanding when your PAM modules delete ccaches, and possibly turning > off Postfix features like ~/.forward if you're not using them. > > AFAICS the only piece of Dovecot configuration that might be relevant at > this point is that a user's Dovecot home directory does not have to be > the same as their 'real' home directory, so you can (if necessary) move > all Dovecot-related files onto a local disk. See > http://wiki2.dovecot.org/AuthDatabase/Passwd . That does sound like a useful feature. In the past, I've seen Dovecot spit out spurious errors about accessing user home directories. I'll have to check if I'm still getting those, because this sounds like a fix for that. I should be getting some good data from my GSSAPI test users later today or tomorrow. One woman claimed she has duplicate emails, but I suspect that's because I migrated her to IMAP. > Ben > I really do appreciate all the help. - Maura Dailey maura at eclipse.ncsc.mil From user+dovecot at localhost.localdomain.org Tue Dec 11 21:20:59 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Tue, 11 Dec 2012 20:20:59 +0100 Subject: [Dovecot] doveadm-lda - segfault In-Reply-To: <87obi0j3j5.fsf@alfa.kjonca> References: <87obi0j3j5.fsf@alfa.kjonca> Message-ID: <50C7879B.7030207@localhost.localdomain.org> On 12/11/2012 11:18 AM Kamil Jo?ca wrote: > When I try to > > dovecot-lda < message.txt > > (for sieve refiltering) I got segmentation fault. > Does it is bug in lda, or message does not keep standards? > KJ I've saved your example message and delivered it twice (Dovecot 2.1.11 and 2.0.21). I'm unable to reproduce the crash. Please read http://dovecot.org/bugreport.html and provide the necessary details. Regards, Pascal -- The trapper recommends today: 5e1f1e55.1234620 at localdomain.org From kjonca at o2.pl Tue Dec 11 23:05:33 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Tue, 11 Dec 2012 22:05:33 +0100 Subject: [Dovecot] doveadm-lda - segfault References: <87obi0j3j5.fsf@alfa.kjonca> <50C7879B.7030207@localhost.localdomain.org> Message-ID: <87ip88i9k2.fsf@alfa.kjonca> Pascal Volk writes: > On 12/11/2012 11:18 AM Kamil Jo?ca wrote: >> When I try to >> >> dovecot-lda < message.txt >> >> (for sieve refiltering) I got segmentation fault. >> Does it is bug in lda, or message does not keep standards? >> KJ > > I've saved your example message and delivered it twice (Dovecot 2.1.11 > and 2.0.21). I'm unable to reproduce the crash. > > Please read http://dovecot.org/bugreport.html and provide the necessary > details. dovecot -n --8<---------------cut here---------------start------------->8--- # 2.1.12 (f13f2725882e): /etc/dovecot/dovecot.conf # OS: Linux 3.6.7+1 x86_64 Debian wheezy/sid auth_debug = yes auth_mechanisms = plain digest-md5 cram-md5 login auth_username_format = %n auth_verbose = yes log_path = /var/log/dovecot namespace { hidden = no inbox = yes list = yes location = maildir:~/Mail/0:LAYOUT=fs:INBOX=~/Mail/0/INBOX prefix = separator = / subscriptions = yes type = private } passdb { args = scheme=PLAIN /etc/security/dovecot.pwd driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mail_log_fields = uid box msgid size from flags sieve = ~/.dovecot.sieve sieve_execute_bin_dir = %h/sieve/bin sieve_execute_exec_timeout = 86400s sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.filter sieve_filter_bin_dir = %h/sieve/bin sieve_filter_exec_timeout = 86400s sieve_pipe_bin_dir = %h/sieve/bin sieve_pipe_exec_timeout = 86400s sieve_plugins = sieve_extprograms } protocols = " imap lmtp" service auth { user = root } ssl_cert = 8--- Dovecot taken from deb http://xi.rename-it.nl/debian/ testing-auto/dovecot-2.1 main + manually compiled sieve exptrograms plugin. Maybe its worth noticing that adding line --8<---------------cut here---------------start------------->8--- Return-path: --8<---------------cut here---------------end--------------->8--- to example message makes dovecot-lda working. -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewskiej-wprowadzenie/ You can no more win a war than you can win an earthquake. -- Jeannette Rankin From ben at morrow.me.uk Tue Dec 11 23:30:35 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Tue, 11 Dec 2012 21:30:35 +0000 Subject: [Dovecot] doveadm-lda - segfault In-Reply-To: <87ip88i9k2.fsf@alfa.kjonca> References: <87obi0j3j5.fsf@alfa.kjonca> <50C7879B.7030207@localhost.localdomain.org> <87ip88i9k2.fsf@alfa.kjonca> Message-ID: <20121211213034.GD39964@anubis.morrow.me.uk> At 10PM +0100 on 11/12/12 Kamil Jo?ca wrote: > > Dovecot taken from deb http://xi.rename-it.nl/debian/ testing-auto/dovecot-2.1 main > + manually compiled sieve exptrograms plugin. > > Maybe its worth noticing that > adding line > > --8<---------------cut here---------------start------------->8--- > Return-path: > --8<---------------cut here---------------end--------------->8--- > to example message makes dovecot-lda working. Which revision of the extprograms plugin are you using? As of changeset 47 the Return-Path manipulation has been removed, so if there was a bug in that code rebuilding with the latest version may make it go away. Otherwise, can you get a backtrace? It would be more use if you can rebuild with debug symbols, but even without it should give some useful information. Ben From kjonca at o2.pl Wed Dec 12 00:03:15 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Tue, 11 Dec 2012 23:03:15 +0100 Subject: [Dovecot] doveadm-lda - segfault References: <87obi0j3j5.fsf@alfa.kjonca> <50C7879B.7030207@localhost.localdomain.org> <87ip88i9k2.fsf@alfa.kjonca> <20121211213034.GD39964@anubis.morrow.me.uk> Message-ID: <87a9tki6vw.fsf@alfa.kjonca> Ben Morrow writes: > At 10PM +0100 on 11/12/12 Kamil Jo?ca wrote: >> >> Dovecot taken from deb http://xi.rename-it.nl/debian/ testing-auto/dovecot-2.1 main >> + manually compiled sieve exptrograms plugin. >> >> Maybe its worth noticing that >> adding line >> >> --8<---------------cut here---------------start------------->8--- >> Return-path: >> --8<---------------cut here---------------end--------------->8--- >> to example message makes dovecot-lda working. > > Which revision of the extprograms plugin are you using? As of changeset > 47 the Return-Path manipulation has been removed, so if there was a bug > in that code rebuilding with the latest version may make it go away. I think that is most recent which can I get with --8<---------------cut here---------------start------------->8--- hg clone http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/ --8<---------------cut here---------------end--------------->8--- If I understand hg commands "hg branches -v" gives me: --8<---------------cut here---------------start------------->8--- default 47:3bd6ed27ae26 --8<---------------cut here---------------end--------------->8--- > > Otherwise, can you get a backtrace? It would be more use if you can > rebuild with debug symbols, but even without it should give some useful > information. I don't know if I did it properly (how to compile it with debug symbols?) --8<---------------cut here---------------start------------->8--- gdb -c ~/core /usr/lib/dovecot/dovecot-lda GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/dovecot-lda...(no debugging symbols found)...done. [New LWP 25303] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/usr/lib/dovecot//dovecot-lda'. Program terminated with signal 11, Segmentation fault. #0 0x00007f99d591fe6f in mail_storage_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 (gdb) bt full #0 0x00007f99d591fe6f in mail_storage_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007f99d58f1561 in maildir_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00007f99d592723b in mailbox_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #3 0x00007f99d377c0c1 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #4 0x00007f99d37724bb in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #5 0x00007f99d377385f in sieve_result_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #6 0x00007f99d3782f65 in sieve_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #7 0x00007f99d39c4112 in ?? () from /usr/lib/dovecot/modules/lib90_sieve_plugin.so No symbol table info available. #8 0x00007f99d5bb98d5 in mail_deliver () from /usr/lib/dovecot/libdovecot-lda.so.0 No symbol table info available. #9 0x000000000040295a in main () No symbol table info available. --8<---------------cut here---------------end--------------->8--- -- http://blogdebart.pl/2009/12/22/mamy-chorych-dzieci/ They have been at a great feast of languages, and stolen the scraps. -- William Shakespeare, "Love's Labour's Lost" From stephan at rename-it.nl Wed Dec 12 00:22:11 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 11 Dec 2012 23:22:11 +0100 Subject: [Dovecot] [vnd.dovecot.pipe] - timeout settings In-Reply-To: <87d2yhk6e8.fsf@alfa.kjonca> References: <87d2yhk6e8.fsf@alfa.kjonca> Message-ID: <50C7B213.3040406@rename-it.nl> On 12/10/2012 9:18 PM, Kamil Jo?ca wrote: > In install file we can read that: > sieve__exec_timeout = 10s > set timeout for executing program. > > > But regardless of setting this value (say sieve_pipe_exec_timeout=86000) > I got: > > --8<---------------cut here---------------start------------->8--- > 2012-12-10 20:55:33 LDA(kjonca): Debug: sieve: action pipe: running program: maildrop.sh > 2012-12-10 20:55:43 LDA(kjonca): Debug: program `/home/kjonca/sieve/bin/maildrop.sh' execution timed out: sending TERM signal > --8<---------------cut here---------------end--------------->8--- > > What am I doing wrong? Nothing really. This is a bug. This should fix it: http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/ Regards, Stephan. From kjonca at o2.pl Wed Dec 12 00:15:57 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Tue, 11 Dec 2012 23:15:57 +0100 Subject: [Dovecot] doveadm-lda - segfault References: <87obi0j3j5.fsf@alfa.kjonca> <50C7879B.7030207@localhost.localdomain.org> <87ip88i9k2.fsf@alfa.kjonca> <20121211213034.GD39964@anubis.morrow.me.uk> <87a9tki6vw.fsf@alfa.kjonca> Message-ID: <876248i6aq.fsf@alfa.kjonca> kjonca at o2.pl (Kamil Jo?ca) writes: > I don't know if I did it properly (how to compile it with debug > symbols?) After sending previous post I realized that debug symbols should be in dovecot-dbg package. Below backtrace: gdb -c ~/core /usr/lib/dovecot/dovecot-lda GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/dovecot-lda...Reading symbols from /usr/lib/debug/usr/lib/dovecot/dovecot-lda...done. done. [New LWP 25303] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/usr/lib/dovecot//dovecot-lda'. Program terminated with signal 11, Segmentation fault. #0 0x00007f99d591fe6f in mail_storage_try_copy (mail=0x198dbb0, _ctx=0x7fff8914fc28) at mail-copy.c:56 56 mail-copy.c: No such file or directory. (gdb) bt full #0 0x00007f99d591fe6f in mail_storage_try_copy (mail=0x198dbb0, _ctx=0x7fff8914fc28) at mail-copy.c:56 ctx = 0x19a6610 pmail = 0x198dbb0 from_envelope = 0x0 input = guid = received_date = -1 #1 mail_storage_copy (ctx=ctx at entry=0x19a6610, mail=mail at entry=0x198dbb0) at mail-copy.c:93 No locals. #2 0x00007f99d58f1561 in maildir_copy (ctx=0x19a6610, mail=0x198dbb0) at maildir-copy.c:148 _t = mbox = __FUNCTION__ = "maildir_copy" #3 0x00007f99d592723b in mailbox_copy (_ctx=_ctx at entry=0x7fff8914fd30, mail=mail at entry=0x198dbb0) at mail-storage.c:1721 ctx = 0x19a6610 box = 0x19942c0 keywords = 0x0 ret = #4 0x00007f99d377c0c1 in act_store_execute (action=, aenv=0x1980960, tr_context=0x1980a88) at sieve-actions.c:551 trans = 0x1980a88 mail = 0x198dbb0 real_mail = save_ctx = 0x0 keywords = 0x0 result = true #5 0x00007f99d37724bb in _sieve_result_implicit_keep (result=result at entry=0x1980930, rollback=) at sieve-result.c:996 rac = success = true rsef = rsef_first = 0x0 tr_context = 0x1980a88 act_keep = {def = 0x7f99d39b9500, ext = 0x0, location = 0x0, context = 0x0, mail = 0x198dbb0, executed = false} #6 0x00007f99d377385f in sieve_result_execute (result=0x1980930, keep=keep at entry=0x0) at sieve-result.c:1230 implicit_keep = true success = true commit_ok = true rac = 0x0 first_action = 0x1 #7 0x00007f99d3782f65 in sieve_execute (sbin=, msgdata=, senv=, ehandler=ehandler at entry=0x1975140, flags=flags at entry=SIEVE_RUNTIME_FLAG_NOGLOBAL, keep=keep at entry=0x0) at sieve.c:508 result = 0x1980930 ret = 1 #8 0x00007f99d39c4112 in lda_sieve_singlescript_execute (srctx=0x7fff8914ffa0) at lda-sieve-plugin.c:436 sbin = 0x19782a0 rtflags = SIEVE_RUNTIME_FLAG_NOGLOBAL debug = false svinst = 0x1971440 script = 0x1974d30 user_script = cpflags = SIEVE_COMPILE_FLAG_NOGLOBAL ret = ehandler = 0x1975140 error = #9 lda_sieve_deliver_mail (mdctx=0x7fff891501b0, storage_r=0x7fff89150140) at lda-sieve-plugin.c:812 count = i = _data_stack_cur_id = 2 srctx = {svinst = 0x1971440, mdctx = 0x7fff891501b0, scripts = 0x1944ff0, script_count = 1, user_script = 0x1974d30, main_script = 0x1974d30, msgdata = 0x7fff8914ff70, scriptenv = 0x7fff89150000, user_ehandler = 0x1975140, master_ehandler = 0x1974c20, userlog = 0x1945070 "/home/kjonca/.dovecot.sieve.log"} svenv = {hostname = 0x194f2e0 "alfa.kjonca", base_dir = 0x195be78 "/var/run/dovecot", username = 0x195b440 "kjonca", home_dir = 0x195c4a8 "/home/kjonca", flags = SIEVE_FLAG_HOME_RELATIVE} svinst = 0x1971440 msgdata = {mail = 0x196b010, return_path = 0x0, orig_envelope_to = 0x1944c90 "kjonca at alfa.kjonca", final_envelope_to = 0x1944c90 "kjonca at alfa.kjonca", auth_user = 0x195b440 "kjonca", id = 0x196d660 "<20000126133839.B2888 at localhost.localdomain>"} scriptenv = {action_log_format = 0x194f358 "msgid=%m: %$", user = 0x195b380, default_mailbox = 0x403583 "INBOX", postmaster_address = 0x194f2d0 "root at localhost", mailbox_autocreate = false, mailbox_autosubscribe = false, script_context = 0x7fff891501b0, smtp_open = 0x7f99d39c3030 , smtp_close = 0x7f99d39c3010 , duplicate_check = 0x7f99d39c2fc0 , duplicate_mark = 0x7f99d39c2ff0 , reject_mail = 0x7f99d39c2fb0 , exec_status = 0x7fff8914ff20, trace_stream = 0x0, trace_config = {level = SIEVE_TRLVL_NONE, flags = 0}} estatus = {message_saved = false, message_forwarded = false, tried_default_save = true, keep_original = false, last_storage = 0x195a6c0} master_ehandler = 0x1974c20 user_location = 0x1974d30 "\020M\227\001" ---Type to continue, or q to quit--- default_location = 0x1974d30 "\020M\227\001" sieve_before = sieve_after = 0x0 setting_name = script_sequence = {arr = {buffer = 0x1944fb8, element_size = 8}, v = 0x1944fb8, v_modifiable = 0x1944fb8} debug = 64 error = SIEVE_ERROR_NONE ret = 0 #10 0x00007f99d5bb98d5 in mail_deliver (ctx=ctx at entry=0x7fff891501b0, storage_r=storage_r at entry=0x7fff89150140) at mail-deliver.c:390 ret = #11 0x000000000040295a in main (argc=1, argv=0x194c370) at main.c:434 set_roots = {0x604420, 0x0} ctx = {pool = 0x194cb60, set = 0x194f280, session = 0x194cb80, dup_ctx = 0x196a9e0, session_id = 0x0, src_mail = 0x196b010, src_envelope_sender = 0x0, dest_user = 0x195b380, dest_addr = 0x1944c90 "kjonca at alfa.kjonca", final_dest_addr = 0x1944c90 "kjonca at alfa.kjonca", dest_mailbox_name = 0x403583 "INBOX", dest_mail = 0x0, var_expand_table = 0x0, tried_default_save = false, saved_mail = false, save_dest_mail = false, mailbox_full = false, dsn = false} service_flags = user = 0x194c497 "kjonca" errstr = path = storage_service = 0x194dfa0 service_user = 0x194e948 service_input = {module = 0x40357f "lda", service = 0x40357f "lda", username = 0x194c497 "kjonca", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} storage = user_source = 0x7fff89150150 "" destaddr_source = 0x40354d "user at hostname" process_euid = stderr_rejection = false ret = c = error = (gdb) quit -- http://blogdebart.pl/2012/06/24/hiena/ You can't carve your way to success without cutting remarks. From stephan at rename-it.nl Wed Dec 12 00:42:00 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 11 Dec 2012 23:42:00 +0100 Subject: [Dovecot] Maildir hardlinks with sieve In-Reply-To: <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> References: <20121129130156.86002utrv14t9eic@webmail.unipa.it> <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> Message-ID: <50C7B6B8.4080107@rename-it.nl> On 12/9/2012 10:12 PM, Benedetto Vassallo wrote: > > Def. Quota Benedetto Vassallo : > > Hi all, > As I had no response, I suppose there is no way to have maildir > hardlinks work if I set up sieve. > Is that correct? Apparently, not at this time. I think it should be fixable, but that will require some investigation. I won't have time for this until this weekend. Regards, Stephan. From jtam.home at gmail.com Wed Dec 12 05:13:37 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 11 Dec 2012 19:13:37 -0800 (PST) Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files In-Reply-To: References: Message-ID: Ben Morrow writes: > In any case, it's likely that the delivery process looks in the user's > home directory even if delivery is to a separate mail spool, unless > you've taken steps to prevent this. I can confirm this. I think the reason is that dovecot changes to the user's home directory so that it has a place to dump core. This causes problem for my setup since I user per-user NFS mounts, so a delivery to an internal mailing list caused hundreds of NFS automounts. I patched this behaviour out, but there is probably a more elegant solution (unset MAIL_STORAGE_SERVICE_FLAG_ENABLE_CORE_DUMPS? How?). Joseph Tam --- ./src/lib-storage/mail-storage-service.c~ Sat May 19 08:42:12 2012 +++ ./src/lib-storage/mail-storage-service.c Mon Jun 25 22:00:57 2012 @@ -615,21 +615,21 @@ - if ((user->flags & MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP) != 0 && - (user->flags & MAIL_STORAGE_SERVICE_FLAG_ENABLE_CORE_DUMPS) == 0) { - /* we don't want to write core files to any users' home - directories since they could contain information about other - users' mails as well. so do no chdiring to home. */ - } else if (*home != '\0' && - (user->flags & MAIL_STORAGE_SERVICE_FLAG_NO_CHDIR) == 0) { - /* If possible chdir to home directory, so that core file - could be written in case we crash. */ - if (chdir(home) < 0) { - if (errno == EACCES) { - i_error("%s", eacces_error_get("chdir", - t_strconcat(home, "/", NULL))); - } if (errno != ENOENT) - i_error("chdir(%s) failed: %m", home); - else if (mail_set->mail_debug) - i_debug("Home dir not found: %s", home); - } - } +// if ((user->flags & MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP) != 0 && +// (user->flags & MAIL_STORAGE_SERVICE_FLAG_ENABLE_CORE_DUMPS) == 0) { +// /* we don't want to write core files to any users' home +// directories since they could contain information about other +// users' mails as well. so do no chdiring to home. */ +// } else if (*home != '\0' && +// (user->flags & MAIL_STORAGE_SERVICE_FLAG_NO_CHDIR) == 0) { +// /* If possible chdir to home directory, so that core file +// could be written in case we crash. */ +// if (chdir(home) < 0) { +// if (errno == EACCES) { +// i_error("%s", eacces_error_get("chdir", +// t_strconcat(home, "/", NULL))); +// } if (errno != ENOENT) +// i_error("chdir(%s) failed: %m", home); +// else if (mail_set->mail_debug) +// i_debug("Home dir not found: %s", home); +// } +// } From oub at mat.ucm.es Tue Dec 11 21:11:37 2012 From: oub at mat.ucm.es (Uwe Brauer) Date: Tue, 11 Dec 2012 20:11:37 +0100 Subject: [Dovecot] dovcot+offlineimap+gmail: INBOX empty, mail doubled Message-ID: <87zk1k2yl2.fsf@gilgamesch.quim.ucm.es> Hello I have used for years offlineimap-6.2.0 dovecot-imapd 1:1.2.9 in Kubuntu 10.04 Together with a imap server of my university. Yesterday we switched to google, which I know, is not a real imap server. I have 2 problems and the first I think has to do with either an old version of offlineimap or a bad configuration file: - All folders are downloaded+ Gmail[All Mail] so doubling my mail. - My INBOX folder is empty, however this is the only folder for which offlinemap gives the following warning: Syncing INBOX: Gmail -> MappedIMAP WARNING: UID validity problem for folder INBOX (repo UniLocal) (saved 1309334376; got 1355232397); skipping it So maybe this is also a offlineimap fault. In any case I have googled around and found out that I am not the only person suffering this problem. I have attached my configuration file in the hope that may be somebody could give me a hint. Thanks in advance Uwe Brauer --8<------------------------schnipp------------------------->8--- [general] accounts = Uni ui = Noninteractive.Basic maxsyncaccounts = 1 [Account Uni] localrepository = UniLocal remoterepository = UniRemote [Repository UniLocal] type = IMAP ssl = no remotehost = localhost remoteuser = myuser remotepass = mypasswd maxconnections = 2 [Repository UniRemote] type = Gmail # ssl =no ssl =yes #remotehost = ucimap.ucm.es remotehost = imap.gmail.com remoteuser = myuser remotepass = mypasswd # nametrans = lambda foldername: re.sub ('^\[gmail\]', 'bak', # re.sub ('sent_mail', 'sent', # re.sub ('starred', 'flagged', # re.sub (' ', '_', foldername.lower())))) folderfilter = lambda foldername: foldername in ['INBOX'] idlefolders = ['INBOX'] folderfilter = lambda foldername: foldername not in '[Gmail]/All Mail' sslcacertfile = /etc/ssl/certs/ca-certificates.crt maxconnections = 1 realdelete = yes # Don't sync shared folders # folderfilter = lambda foldername: not re.search('Shared Folders', foldername) # automatic stuff maxsyncaccounts = 1 quick = 10 autorefresh = 5 keepalive = 60 holdconnectionopen = yes # This will suppress anything but errors ui = quiet --8<------------------------schnapp------------------------->8--- --8<------------------------schnipp------------------------->8--- version_ignore=yes first_valid_uid = 1 log_path = /var/log/dovecot.log ssl_cert_file = /etc/ssl/certs/dovecot.pem ssl_key_file = /etc/ssl/private/dovecot.pem # mail_location = maildir:/var/spool/mail/%u # not sure about the following mail_location = maildir:/var/spool/mail/%u:INBOX=/var/spool/mail/%u maildir_copy_with_hardlinks = yes protocol imap { listen = 127.0.0.1:143 ssl_listen = 127.0.0.1:943 } auth default { mechanisms = plain # defines users/passwords passdb passwd-file { args = /etc/dovecot/passwd } userdb static { args = uid=mail gid=mail home=/var/spool/mail/%u } } --8<------------------------schnapp------------------------->8--- From dale.gallagher at gmail.com Wed Dec 12 11:00:27 2012 From: dale.gallagher at gmail.com (Dale Gallagher) Date: Wed, 12 Dec 2012 11:00:27 +0200 Subject: [Dovecot] Manually creating dovecot- files after isync/mbsync mirror Message-ID: Hi everyone I'm using isync 1.0.5 patched to do recursive folder listing and mirroring mail from an external party's IMAP server to a local Maildir, which will be accessed by Dovecot 2.0.9. In order to prevent IMAP clients from re-downloading their mail, when connecting to Dovecot, I'm busy writing a script to generate appropriate dovecot-uidlist and dovecot-uidvalidity files, per Maildir. isync stores the uid in the filename, so that's extractable, per message, and the uidvalidity and current max uid are stored in a file .uidvalidity, in each Maildir. I've read the docs here: http://wiki2.dovecot.org/MailboxFormat/Maildir Regarding the dovecot-uidlist header (first line) - I've tried to search for and figure out what exactly is meant by the "mailbox global uid" and once I do, how to manually generate the 128 bit hex variation of it? Could someone elaborate on this, please. How would omitting the global uid field, beginning with G, affect remote clients' syncing of mail? Is this field mandatory? I also see that Dovecot's uidvalidity is of the form 4df8a4e2, whereas isync uses an integer. I'd appreciate it if someone could elaborate on what Dovecot uses and whether I can convert one to the other? I'll post the full solution, once complete, and working. Thanks. Dale From tss at iki.fi Wed Dec 12 13:11:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 12 Dec 2012 13:11:14 +0200 Subject: [Dovecot] SPECIAL-USE and mailbox names in various IMAP clients Message-ID: <33DF7C74-6AF2-4FB1-B25F-7298AD01CDDB@iki.fi> http://imapwiki.org/SpecialUse Please fill out for all clients with all languages you know of. Knowing the mailbox names can be helpful with Dovecot's mailbox_alias plugin. From rigasathanasios78 at hotmail.com Wed Dec 12 09:14:25 2012 From: rigasathanasios78 at hotmail.com (anarchos78) Date: Tue, 11 Dec 2012 23:14:25 -0800 (PST) Subject: [Dovecot] Dovecote Warnings Message-ID: <1355296465918-39221.post@n4.nabble.com> Greetings, I have setup Postfix/Dovecote on Ubuntu 12.04 (apt-get install mail-stack-delivery). While everything is working fine in the mail server I have niticed the following errors: srv dovecot: config: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:13: listen=..:port has been replaced by service { inet_listener { port } }: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:13: protocol { listen } has been replaced by service { inet_listener { address } }: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:14: protocol { ssl_listen } has been replaced by service { inet_listener { address } }: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:14: ssl_listen=..:port has been replaced by service { inet_listener { port } }: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:21: listen=..:port has been replaced by service { inet_listener { port } }: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:21: protocol { listen } has been replaced by service { inet_listener { address } }: 2 Time(s) srv dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/01-mail-stack-delivery.conf:22: protocol { ssl_listen } has been replaced by service { inet_listener { address } }: 2 Time(s) *The "01-mail-stack-delivery.conf" file looks like this:* # Some general options protocols = imap pop3 sieve disable_plaintext_auth = yes ssl = yes ssl_cert = was automatically rejected:%n%r } # Plugins configuration plugin { sieve=~/.dovecot.sieve sieve_dir=~/sieve } # Authentication configuration auth_mechanisms = plain login service auth { # Postfix smtp-auth unix_listener /var/spool/postfix/private/dovecot-auth { mode = 0660 user = postfix group = postfix } } What is going wrong with Dovecote. I am a newcomer and i need little help. Many thanks, Tom Greece -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecote-Warnings-tp39221.html Sent from the Dovecot mailing list archive at Nabble.com. From daniel.parthey at informatik.tu-chemnitz.de Wed Dec 12 14:41:50 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 12 Dec 2012 13:41:50 +0100 Subject: [Dovecot] Dovecote Warnings In-Reply-To: <1355296465918-39221.post@n4.nabble.com> References: <1355296465918-39221.post@n4.nabble.com> Message-ID: <20121212124150.GA7601@daniel.localdomain> anarchos78 wrote: > I have setup Postfix/Dovecote on Ubuntu 12.04 (apt-get install > mail-stack-delivery). While everything is working fine in the mail server I > have noticed the following errors: > > srv dovecot: config: Warning: NOTE: You can get a new clean config file > with: doveconf -n > dovecot-new.conf: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:13: listen=..:port has been > replaced by service { inet_listener { port } }: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:13: protocol { listen } has > been replaced by service { inet_listener { address } }: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:14: protocol { ssl_listen } > has been replaced by service { inet_listener { address } }: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:14: ssl_listen=..:port has > been replaced by service { inet_listener { port } }: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:21: listen=..:port has been > replaced by service { inet_listener { port } }: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:21: protocol { listen } has > been replaced by service { inet_listener { address } }: 2 Time(s) > > srv dovecot: config: Warning: Obsolete setting in > /etc/dovecot/conf.d/01-mail-stack-delivery.conf:22: protocol { ssl_listen } > has been replaced by service { inet_listener { address } }: 2 Time(s) The listen and ssl_listen directive is obsolete inside of the protocol section of current dovecot versions. If this config 01-mail-stack-delivery.conf comes with package mail-stack-delivery, then you should file a bug in the ubuntu launchpad so that the config gets adapted to the new dovecot version. Dovecot listens on the default ports by default, so you might just remove the "listen" and "ssl_listen" lines from your config. Regards Daniel -- https://plus.google.com/103021802792276734820 From listas at adminlinux.com.br Wed Dec 12 15:52:44 2012 From: listas at adminlinux.com.br (3.listas@adminlinux.com.br) Date: Wed, 12 Dec 2012 11:52:44 -0200 Subject: [Dovecot] Too many imap connections in state "idling" Message-ID: <50C88C2C.5040703@adminlinux.com.br> Hi, I have a "Ubuntu12.04 + dovecot-2.0.19" configuration in my server. My mailbox server is shared by ~ 10k domains. It works fine with ~50k accounts. On average, my server has about 6K simultaneous imap connections during office hours. But I've noticed that this server has an average of approximately 4k connections in state "idling". On other Dovecot servers the average connections in state "idling" is only 10%. My doveconf -n: http://thiagoh.prv.digirati.com.br/doveconf-n.txt Can someone help me? Thanks -- Thiago Henrique adminlinux.com.br From benedetto.vassallo at unipa.it Wed Dec 12 16:59:52 2012 From: benedetto.vassallo at unipa.it (Benedetto Vassallo) Date: Wed, 12 Dec 2012 15:59:52 +0100 Subject: [Dovecot] Maildir hardlinks with sieve In-Reply-To: <50C7B6B8.4080107@rename-it.nl> References: <20121129130156.86002utrv14t9eic@webmail.unipa.it> <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> <50C7B6B8.4080107@rename-it.nl> Message-ID: <20121212155952.20965a6wg3z7r36w@webmail.unipa.it> Def. Quota Stephan Bosch : > On 12/9/2012 10:12 PM, Benedetto Vassallo wrote: >> >> Def. Quota Benedetto Vassallo : >> >> Hi all, >> As I had no response, I suppose there is no way to have maildir >> hardlinks work if I set up sieve. >> Is that correct? > > Apparently, not at this time. I think it should be fixable, but that > will require some investigation. I won't have time for this until > this weekend. > > Regards, > > Stephan. > > > OK, I'll wait for your news. Thanks alot. -- Benedetto Vassallo Sistema Informativo di Ateneo Settore Gestione Reti Hardware e Software U.O.B. Sviluppo e manutenzione dei sistemi Universit? degli studi di Palermo Phone: +3909123860056 Fax: +390916529124 ------------------------------------------------------------------------- This message was sent using the University of Palermo web mail interface. From pixilla at macports.org Wed Dec 12 18:28:15 2012 From: pixilla at macports.org (Bradley Giesbrecht) Date: Wed, 12 Dec 2012 08:28:15 -0800 Subject: [Dovecot] SPECIAL-USE and mailbox names in various IMAP clients In-Reply-To: <33DF7C74-6AF2-4FB1-B25F-7298AD01CDDB@iki.fi> References: <33DF7C74-6AF2-4FB1-B25F-7298AD01CDDB@iki.fi> Message-ID: On Dec 12, 2012, at 3:11 AM, Timo Sirainen wrote: > http://imapwiki.org/SpecialUse > > Please fill out for all clients with all languages you know of. Knowing the mailbox names can be helpful with Dovecot's mailbox_alias plugin. Is there online documentation for testing an email clients support of SPECIAL-USE? Regards, Bradley Giesbrecht (pixilla) -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 2763 bytes Desc: not available URL: From klimenko.n at theitidea.ru Wed Dec 12 21:13:56 2012 From: klimenko.n at theitidea.ru (=?UTF-8?B?0J3QuNC60L7Qu9Cw0Lkg0JrQu9C40LzQtdC90LrQvg==?=) Date: Wed, 12 Dec 2012 23:13:56 +0400 Subject: [Dovecot] number of imap connection Message-ID: <50C8D774.8090102@theitidea.ru> Hi to all. how to calculate the expected number of imap processes? how many imap processes must be used for each user? i have 6-7 connection for each one user is it normal behavior? thx. From h.reindl at thelounge.net Wed Dec 12 21:42:52 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 12 Dec 2012 20:42:52 +0100 Subject: [Dovecot] number of imap connection In-Reply-To: <50C8D774.8090102@theitidea.ru> References: <50C8D774.8090102@theitidea.ru> Message-ID: <50C8DE3C.80601@thelounge.net> Am 12.12.2012 20:13, schrieb ??????? ????????: > i have 6-7 connection for each one user > is it normal behavior? per folder one connection -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From ecasarero at gmail.com Wed Dec 12 21:51:24 2012 From: ecasarero at gmail.com (Eduardo Casarero) Date: Wed, 12 Dec 2012 16:51:24 -0300 Subject: [Dovecot] rare ssl issue Message-ID: I'am having a rare situation with ssl connections. I can connect to 993/995 but the connection never starts. >From the client side i test with: $ openssl s_client -connect example.com:993 CONNECTED(00000003) and stays like that... waiting. In the other side i see in dovecot logs: Disconnected: Inactivity (no auth attempts): rip=x.x.x.x, lip=x.x.x.x, TLS handshaking this happens from some networks only, so i think that mi isp (where the server is hosted) is doing some kind of shaping. But if i try to connect to port 465 for example, or 443 it works like a charm. i am talking to my isp, but i thougth that someone may have a hint or any comment that could help. regards, eduardo. From rigasathanasios78 at hotmail.com Wed Dec 12 16:10:42 2012 From: rigasathanasios78 at hotmail.com (anarchos78) Date: Wed, 12 Dec 2012 06:10:42 -0800 (PST) Subject: [Dovecot] Dovecote Warnings In-Reply-To: <20121212124150.GA7601@daniel.localdomain> References: <1355296465918-39221.post@n4.nabble.com> <20121212124150.GA7601@daniel.localdomain> Message-ID: <1355321442457-39226.post@n4.nabble.com> Many thanks for your reply. So what you saying is to remove the lines bellow (from the "01-mail-stack-delivery.conf" file) am i correct? # IMAP configuration protocol imap { listen = *:143 ssl_listen = *:993 mail_max_userip_connections = 10 imap_client_workarounds = delay-newmail } # POP3 configuration protocol pop3 { listen = *:110 ssl_listen = *:995 mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Many thanks again Tom Greece -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecot-Warnings-tp39221p39226.html Sent from the Dovecot mailing list archive at Nabble.com. From dale.gallagher at gmail.com Thu Dec 13 10:04:30 2012 From: dale.gallagher at gmail.com (Dale Gallagher) Date: Thu, 13 Dec 2012 10:04:30 +0200 Subject: [Dovecot] More detail re dovecot-uidlist and -uidvalidity files Message-ID: Regarding the dovecot-uidlist header (first line) - I've tried to search for and figure out what exactly is meant by the "mailbox global uid" and once I do, how to manually generate the 128 bit hex variation of it? Could someone elaborate on this, please. How would omitting the global uid field, beginning with G, affect remote clients' syncing of mail? Is this field mandatory? Would "3 V$uid_validity N$next_uid" be sufficient to ensure that clients don't re-download everything? I also see that Dovecot's dovecot-uidvalidity is of the form 4df8a4e2, whereas the IMAP syncing utility which I'm using (isync) uses an integer. I'd appreciate it if someone could elaborate on what Dovecot uses and whether I need to convert one to the other (ie. after syncing with isync, do I need to convert it to work with Dovecot? Thanks. From skdovecot at smail.inf.fh-brs.de Thu Dec 13 10:33:04 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 13 Dec 2012 09:33:04 +0100 (CET) Subject: [Dovecot] number of imap connection In-Reply-To: <50C8DE3C.80601@thelounge.net> References: <50C8D774.8090102@theitidea.ru> <50C8DE3C.80601@thelounge.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 12 Dec 2012, Reindl Harald wrote: > Am 12.12.2012 20:13, schrieb ??????? ????????: >> i have 6-7 connection for each one user >> is it normal behavior? > > per folder one connection To phrase it differently: The user's MUA has a built-in limit (or not) how many connection it opens to the IMAP server simultaneously. Dunno about recent changes in IMAP, but for each watched folder to get the "New Message" indicator you used to need one connection (IDLE); plus one connection you work with activly. However, Dovecot can limit the connections: # Maximum number of IMAP connections allowed for a user from each IP address. # NOTE: The username is compared case-sensitively. #mail_max_userip_connections = 10 Regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUMmSwGoxLS8a3A9mAQJ4oAf9HqwKRfk4++eEbJapVFixTSEcFt3nJrfG 5Yr8YRtuudqot0v5yblDnSu2JL78L+s4yIFOZqT2Ten7xfDXENYVpFOrG0HKJv8K ym5XUnP5EWSJ135Z+Tw6db6XYeiz3oHax9qcb2W/V/VLqzzCaThahRFooqLvquiF RB74lxVWiGc5JKm6oKOC7L7lOLRS4wkraJwW54jGKQ/g9/MV9FqwoNB62Z6A1VNL cXGOdQIfhy52TS9EwdMNy7CcA5RcGC96faoM9AagFXOq/5bQJ9A7XnYFtUHLC66/ MJGtEO4B9z0vkTkI1NYcGOvPWta+E9T1z4ej3R7oji0P0MxCTQFWng== =qiGI -----END PGP SIGNATURE----- From jtam.home at gmail.com Thu Dec 13 13:56:52 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 13 Dec 2012 03:56:52 -0800 (PST) Subject: [Dovecot] dovecot-lda (2.1.12) segfaults Message-ID: We uograded our dovecot from version 2.1.10 -> 2.10.12, but within the first hour of use, dovecot-lda would segfault during delivery. This left a lock file lying around causing the user's mail readers to hang; much hilarity ensues. All further deliveries to the same user will result in a crash. The only thing that fixes this condition is to blow away the user's INBOX cache index. Reindexing with "doveadm index" does not fix anything. I've installed a test version with one user's problematic INBOX cache indices and ran gdb dovecot-lda (gdb) run -t testuser size < sizeof(*field_hdr) + (gdb) bt #0 0xff2a0440 in mail_cache_header_fields_read (cache=0x5c120) at mail-cache-fields.c:323 #1 0xff29e8bc in mail_cache_compress_locked (cache=0x5c120, trans=0x63ce8, unlock=0xffbfeeef) at mail-cache-compress.c:361 #2 0xff29efd0 in mail_cache_compress (cache=0x5c120, trans=0x63ce8) at mail-cache-compress.c:489 #3 0xff2a3df4 in mail_cache_transaction_compress (ctx=0x5dac0) at mail-cache-transaction.c:180 #4 0xff2a4084 in mail_cache_transaction_open_if_needed (ctx=0x5dac0) at mail-cache-transaction.c:241 #5 0xff2a6e60 in mail_cache_field_want_add (ctx=0x5dac0, seq=1, field_idx=12) at mail-cache-transaction.c:1048 #6 0xff27e8e8 in index_mail_parse_header_register_all_wanted (mail=0x5e6b0) at index-mail-headers.c:175 #7 0xff27ec90 in index_mail_parse_header_init (mail=0x5e6b0, headers=0x0) at index-mail-headers.c:230 #8 0xff27f5c8 in index_mail_cache_parse_init (_mail=0x5e6b0, input=0x63760) at index-mail-headers.c:376 #9 0xff2299cc in mbox_save_get_input_stream (ctx=0x5dde8, input=0x62ed0) at mbox-save.c:411 #10 0xff22a084 in mbox_save_begin (_ctx=0x5dde8, input=0x62ed0) at mbox-save.c:520 #11 0xff24e9c0 in mailbox_save_begin (ctx=0xffbff514, input=0x62ed0) at mail-storage.c:1652 #12 0xff23f138 in mail_storage_try_copy (_ctx=0xffbff514, mail=0x54cd8) at mail-copy.c:68 #13 0xff23f23c in mail_storage_copy (ctx=0x5dde8, mail=0x54cd8) at mail-copy.c:93 #14 0xff24ec28 in mailbox_copy (_ctx=0xffbff670, mail=0x54cd8) at mail-storage.c:1721 #15 0xff24ec98 in mailbox_save_using_mail (ctx=0xffbff670, mail=0x54cd8) at mail-storage.c:1730 #16 0xff388070 in mail_deliver_save (ctx=0xffbff8a8, mailbox=0x13fe8 "INBOX", flags=0, keywords=0x0, storage_r=0xffbff83c) at mail-deliver.c:317 #17 0xff38869c in mail_deliver (ctx=0xffbff8a8, storage_r=0xffbff83c) at mail-deliver.c:403 #18 0x00012d08 in main (argc=3, argv=0xffbff964) at main.c:434 I dumped the value of field_hdr, and it has some bogus value (gdb) p field_hdr $1 = (const struct mail_cache_header_fields *) 0x20 Other observations - blowing away the indices does not fix it permanantly. The the LDA will eventually start crashing again. - the problematic indices do not cause problems with 2.1.10. Reverting to 2.1.10 restores proper mail delivery. Is this enough debug info to work your magic, Timo? I can supply the cache data if you neded it. It's compiled on a Solaris10. Joseph Tam From jtam.home at gmail.com Thu Dec 13 14:12:16 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 13 Dec 2012 04:12:16 -0800 (PST) Subject: [Dovecot] number of imap connection In-Reply-To: References: Message-ID: writes: > how to calculate the expected number of imap processes? Set your mail_max_userip_connections to a large value (~20) and run "doveadm who" periodically to look at your user's actual connection counts. > how many imap processes must be used for each user? > i have 6-7 connection for each one user > is it normal behavior? It's typical. Some popular mail readers open about 5, some more, some less. I set my mail_max_userip_connections at 12 even though there are some users who regularly bump up against this. They don't seem to notice -- dovecot probably bumps off the least recently used connection and their mail reader reconnects if it needs to open that mailbox again. Joseph Tam From ben at morrow.me.uk Thu Dec 13 17:23:21 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Thu, 13 Dec 2012 15:23:21 +0000 Subject: [Dovecot] More detail re dovecot-uidlist and -uidvalidity files In-Reply-To: References: Message-ID: <20121213152321.GF39964@anubis.morrow.me.uk> At 10AM +0200 on 13/12/12 you (Dale Gallagher) wrote: > Regarding the dovecot-uidlist header (first line) - I've tried to search > for and figure out what exactly is meant by the "mailbox global uid" and > once I do, how to manually generate the 128 bit hex variation of it? Could > someone elaborate on this, please. > > How would omitting the global uid field, beginning with G, affect remote > clients' syncing of mail? Is this field mandatory? Would "3 V$uid_validity > N$next_uid" be sufficient to ensure that clients don't re-download > everything? > > I also see that Dovecot's dovecot-uidvalidity is of the form 4df8a4e2, > whereas the IMAP syncing utility which I'm using (isync) uses an integer. > I'd appreciate it if someone could elaborate on what Dovecot uses and > whether I need to convert one to the other (ie. after syncing with isync, > do I need to convert it to work with Dovecot? Have you tried using dsync instead of isync to copy the mailboxes across? dsync -o mail_location=imapc: -o imapc_host=old.imap.server \ -o imapc_user=USER -o imapc_password=PASSWORD \ backup maildir:/home/user/Maildir The last parameter is the destination for the copy, in mail_location format. This will (should) preserve all IMAP-visible information in the Dovecot index files. See also http://wiki2.dovecot.org/Migration/Dsync . Ben From listas at adminlinux.com.br Thu Dec 13 19:35:15 2012 From: listas at adminlinux.com.br (3.listas@adminlinux.com.br) Date: Thu, 13 Dec 2012 15:35:15 -0200 Subject: [Dovecot] Too many imap connections in state "idling" In-Reply-To: <50C88C2C.5040703@adminlinux.com.br> References: <50C88C2C.5040703@adminlinux.com.br> Message-ID: <50CA11D3.5040406@adminlinux.com.br> Is it normal this large amount of connections in state 'idling' ? Thanks -- Thiago Henrique adminlinux.com.br On 12-12-2012 11:52, 3.listas at adminlinux.com.br wrote: > Hi, > > I have a "Ubuntu12.04 + dovecot-2.0.19" configuration in my server. My > mailbox server is shared by ~ 10k domains. It works fine with ~50k > accounts. > > On average, my server has about 6K simultaneous imap connections > during office hours. But I've noticed that this server has an average > of approximately 4k connections in state "idling". > > On other Dovecot servers the average connections in state "idling" is > only 10%. > > My doveconf -n: > http://thiagoh.prv.digirati.com.br/doveconf-n.txt > > Can someone help me? > > Thanks From daniel.parthey at informatik.tu-chemnitz.de Fri Dec 14 01:43:09 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 14 Dec 2012 00:43:09 +0100 Subject: [Dovecot] Dovecote Warnings In-Reply-To: <1355321442457-39226.post@n4.nabble.com> References: <1355296465918-39221.post@n4.nabble.com> <20121212124150.GA7601@daniel.localdomain> <1355321442457-39226.post@n4.nabble.com> Message-ID: <20121213234309.GA7630@daniel.localdomain> anarchos78 wrote: > Many thanks for your reply. So what you saying is to remove the lines bellow > (from the "01-mail-stack-delivery.conf" file) am i correct? Yes, you can comment it out: > # IMAP configuration > protocol imap { > #listen = *:143 > #ssl_listen = *:993 > mail_max_userip_connections = 10 > imap_client_workarounds = delay-newmail > } > > # POP3 configuration > protocol pop3 { > #listen = *:110 > #ssl_listen = *:995 > mail_max_userip_connections = 10 > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } And see what happens when you do a config check with doveconf -n If removing the deprecated options does not suffice, you should configure each port in the new syntax as inet_listeners inside of a service { } section: http://wiki2.dovecot.org/Services#inet_listeners Regards Daniel -- https://plus.google.com/103021802792276734820 From btj at havleik.no Fri Dec 14 09:59:32 2012 From: btj at havleik.no (=?UTF-8?B?QmrDuHJu?= T Johansen) Date: Fri, 14 Dec 2012 08:59:32 +0100 Subject: [Dovecot] Copying just the folders to new Dovecot server? Message-ID: <20121214085932.7ba74ebe@havleik.no> I am setting up a new Dovecot server and I want to start from scratch, i.e. with an empty mailbox. But I want to have the same folders in my new mailbox that I have in my old. Is there a way to create these folders without manually creating one by one? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bj?rn T Johansen btj at havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" ----------------------------------------------------------------------------------------------- -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From skdovecot at smail.inf.fh-brs.de Fri Dec 14 10:40:53 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 14 Dec 2012 09:40:53 +0100 (CET) Subject: [Dovecot] Too many imap connections in state "idling" In-Reply-To: <50CA11D3.5040406@adminlinux.com.br> References: <50C88C2C.5040703@adminlinux.com.br> <50CA11D3.5040406@adminlinux.com.br> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 13 Dec 2012, 3.listas at adminlinux.com.br wrote: > Is it normal this large amount of connections in state 'idling' ? If they actually using the "IDLE" command to wait for PUSH mails on much more folders than on the other server? Regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUMrmFmoxLS8a3A9mAQKmjgf/RbVzZet2+PUDQpMkrquB8zURR+WaBpxa OCnNahjCV3kkuyLSciU8cq54vQhfPEXoyeqoQric/QmMOIZwhaVclLGpnSGa6lGR fjk6x1PgcUDpqncktTJ+aUuJYTiigQbZ1wLWUfCHNZMXx5smReUMV+IdYV/0UH2a NCnQMX7+FfUWOfZdU6QbomgTXAEgjUD+YRo0JqQ6ja/ELWfbUrYAXwhGXAXyskJT 0eygy3FSEBJQMaIO+o5Dco7AbaCGs19xRagZWGZV5/1j17dHqOHwLdp8MnO4wCI8 4IPzuTUbAY0gnCEJLcSYmQG1FzNi5SjPfMV/dypB7wcPdIx4rIzsww== =OQSw -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Fri Dec 14 10:51:34 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 14 Dec 2012 09:51:34 +0100 (CET) Subject: [Dovecot] Copying just the folders to new Dovecot server? In-Reply-To: <20121214085932.7ba74ebe@havleik.no> References: <20121214085932.7ba74ebe@havleik.no> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 14 Dec 2012, Bj?rn T Johansen wrote: > I am setting up a new Dovecot server and I want to start from scratch, i.e. with an empty mailbox. But I want to have the same folders in my new mailbox that I have in my old. Is > there a way to create these folders without manually creating one by one? Depending on your storage backend you can pre-create the folders. E.g. if you use Maildir, you create mkdir .Folder.Subfolder.Subfolder/new mkdir .Folder.Subfolder.Subfolder/cur mkdir .Folder.Subfolder.Subfolder/tmp touch .Folder.Subfolder.Subfolder/maildirfolder For current versions of Dovecot, you can use the doveadm tool: doveadm mailbox create [-A|-u user] [-S socket_path] [-s] mailbox ... Regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUMrolmoxLS8a3A9mAQJ1fQgAgMkr8Y3hjJp0Tz8fBxl2uztNtN3+5kLC rMCssNVRm5JT26H3ZIzANRJkR/oGZI9clxvDU/42GTJDQfFLOxb2WTEEp1D0Bk6u dIwctUoeBbLYVB7u8soxBXoK/uTazOfpNG7zBkVs9q6xxjW2GpL1H193sxDYLIeE h1KMBduWno8eMlL9BdoY+SWaO5us61KbpOheD53ewSkDlHIev+TG4GKUyG1O0OBr 6ShFXMSh0YqxMkGdPIeNLmV5kZTSHWOq1g430JuXcv2vQar8FFoTtOjw33H/FtTT ipK0xpXSnU8zX1z+rFHSmRc3IZFISHo0EEkLiW6L9oXVPrB5HxAq0g== =acka -----END PGP SIGNATURE----- From btj at havleik.no Fri Dec 14 11:12:39 2012 From: btj at havleik.no (=?UTF-8?B?QmrDuHJu?= T Johansen) Date: Fri, 14 Dec 2012 10:12:39 +0100 Subject: [Dovecot] Copying just the folders to new Dovecot server? In-Reply-To: References: <20121214085932.7ba74ebe@havleik.no> Message-ID: <20121214101239.7658cc28@havleik.no> On Fri, 14 Dec 2012 09:51:34 +0100 (CET) Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 14 Dec 2012, Bj?rn T Johansen wrote: > > > I am setting up a new Dovecot server and I want to start from scratch, i.e. with an empty mailbox. But I want to have the same folders in my new mailbox that I have in my old. Is > > there a way to create these folders without manually creating one by one? > > Depending on your storage backend you can pre-create the folders. E.g. if > you use Maildir, you create > > mkdir .Folder.Subfolder.Subfolder/new > mkdir .Folder.Subfolder.Subfolder/cur > mkdir .Folder.Subfolder.Subfolder/tmp > > touch .Folder.Subfolder.Subfolder/maildirfolder > > For current versions of Dovecot, you can use the doveadm tool: > > doveadm mailbox create [-A|-u user] [-S socket_path] [-s] mailbox ... > > Regards, > > - -- > Steffen Kaiser Thx but I then still need to do it manually.. But I think I will do it manually anyway, so I can do some cleanup at the same time... :) BTJ -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From bernics.gabor at penta.hu Fri Dec 14 13:48:34 2012 From: bernics.gabor at penta.hu (=?UTF-8?Q?Bernics_G=C3=A1bor_=7C_Penta_Uni=C3=B3_Zrt=2E?=) Date: Fri, 14 Dec 2012 12:48:34 +0100 Subject: [Dovecot] can't connect to server Message-ID: Hello, I can't connect to a dovecot server (Debian 6.0, default version of Dovecot), I started the daemon but I didn't see errors on console. dovecot-lda works. logs: 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: Loading modules from directory: /usr/lib/dovecot/modules/lda 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: Module loaded: /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so 2012-12-14 12:47:10 auth(default): Info: master in: USER<------>1<----->bernics.gabor at penta.hu<>service=deliver 2012-12-14 12:47:10 auth-worker(default): Info: sql(bernics.gabor at penta.hu): query: SELECT email AS user, password FROM users WHERE email 2012-12-14 12:47:10 auth(default): Info: password(bernics.gabor at penta.hu): Credentials: 54617661737a69737a656c 2012-12-14 12:47:10 auth(default): Info: master out: USER<----->1<----->bernics.gabor at penta.hu 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: Quota root: name=user backend=dict args=:proxy::quotadict 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: dict quota: user=bernics.gabor at penta.hu, uri=proxy::quotadict, noenforcing=0 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: maildir: data=/home/vmail/mail/penta.hu/bernics.gabor at penta.hu/Maildir 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: maildir++: root=/home/vmail/mail/penta.hu/bernics.gabor at penta.hu/Maildir, inde 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: dict quota: user=bernics.gabor at penta.hu, uri=proxy::quotadict, noenforcing=0 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: sieve: user's script path /home/vmail/penta.hu/bernics.gabor at penta.hu/Maildir/ 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: sieve: using sieve path for user's script: /etc/dovecot/dovecot.sieve 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: sieve: executed before user's script(1): /etc/dovecot/dovecot.sieve.before 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: sieve: opening script /etc/dovecot/dovecot.sieve.before 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: sieve: opening script /etc/dovecot/dovecot.sieve 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: Namespace : Using permissions from /home/vmail/mail/penta.hu/bernics.gabor at pen 2012-12-14 12:47:10 deliver(bernics.gabor at penta.hu): Info: sieve: msgid=<20121214114708.5BD7917402D at mail2.penta.hu>: stored mail into mai config: http://pastebin.com/4imMFZSi Best Regards, Gabor From skdovecot at smail.inf.fh-brs.de Fri Dec 14 14:57:06 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 14 Dec 2012 13:57:06 +0100 (CET) Subject: [Dovecot] can't connect to server In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 14 Dec 2012, Bernics G?bor | Penta Uni? Zrt. wrote: > I can't connect to a dovecot server (Debian 6.0, default > version of Dovecot), I started the daemon but I didn't see errors on > console. > > dovecot-lda works. > config: > http://pastebin.com/4imMFZSi Please use dovecot -n to show us the running config and version of Dovecot. It this command gives you "no such command", search for it using: find /usr -name dovecot -type f Did you grabbed the logs from /var/log/dovecot/dovecot-info.log ? If not what's in there? You'll find the correct log file path in the above output. Did you tried to run /etc/init.d/dovecot restart from command line? Or maybe: restart dovecot In either of the above steps you should find an error, if Dovecot is not running. Regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUMsiImoxLS8a3A9mAQIRXwgAi7OhdIKN/SocELjoOWitra0VQALxEaAe W9J5ZeqtRL2EVh/agQGDP66UVkuBbGmd/NogjcvYKHotII6na/q02Q2Cy/wM/b+X CDrdIoDB89spryQ0mkat0aCi2+mt9rOsQOSdzKmzuBN+EkJHS+W3hwcv2Y5JC+/3 0q9El+E5CgwcmRzFmehcnLr/vig8/7bu4Pci0geUh4u6zk/PZLxyl98jgrAz5t12 bQyvAam/tWY5mSK6O6XJzlPvR/7LNFZ0wYMjzK92J1VwLN8HZ7qo+mUSQeqOdWYM Wrcb2NNqq3XDL8aajUyYXneJAJdZrxmwpSZ1r8vxElb6yUy+PF0YXw== =jXSW -----END PGP SIGNATURE----- From bajnokk at niif.hu Fri Dec 14 16:37:09 2012 From: bajnokk at niif.hu (Kristof Bajnok) Date: Fri, 14 Dec 2012 15:37:09 +0100 Subject: [Dovecot] Clear-text ldap passwords: {CLEAR} scheme? Message-ID: <50CB3995.20303@niif.hu> Hi, if I read the documentation correctly, the clear-text password storage scheme in Dovecot is called PLAIN. Unfortunately, in Sun LDAP Directory Server I have to specify them as "{CLEAR}" [1]. Is it somehow possible to make Dovecot recognise "{clear}foobar" passwords as plaintext? Now I get: auth: Error: ldap(username): Unknown scheme clear Thanks, Kristof [1]: http://docs.oracle.com/cd/E19850-01/816-6699-10/confattr.html#passwordStorageScheme%20%28Password%20Storage%20Scheme%29 From jbates at brightok.net Fri Dec 14 16:46:49 2012 From: jbates at brightok.net (Jack Bates) Date: Fri, 14 Dec 2012 08:46:49 -0600 Subject: [Dovecot] BUG: mishandling of username if it's a keyword? Message-ID: <50CB3BD9.3040101@brightok.net> Dec 14 14:33:03 test2 dovecot: auth: Debug: auth client connected (pid=24143) Dec 14 14:33:14 test2 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=pop3#011secured#011session=D6dl6dDQdAAAAAAAAAAAAAAAAAAAAAAB#011lip=::1#011rip=::1#011lport=110#011rport=38004#011resp= Dec 14 14:33:14 test2 dovecot: auth: Debug: static(home,::1,): lookup Dec 14 14:33:14 test2 dovecot: auth: Debug: client passdb out: OK#0111#011user=home Dec 14 14:33:14 test2 dovecot: auth: Debug: master in: REQUEST#0112033451009#01124143#0111#011243997dcca92c2dc1d1e401c78b4ea4f Dec 14 14:33:14 test2 dovecot: auth: Debug: master userdb out: USER#0112033451009#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir Dec 14 14:33:14 test2 dovecot: pop3-login: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=24145, secured, session= Dec 14 14:33:14 test2 dovecot: pop3: Debug: Added userdb setting: mail_location=maildir:~/Maildir Dec 14 14:33:14 test2 dovecot: pop3(uid=503): Error: user uid=503: Couldn't drop privileges: User is missing UID (see mail_uid setting) Dec 14 14:33:14 test2 dovecot: pop3(uid=503): Error: Internal error occurred. Refer to server log for more information. compared to: Dec 14 14:37:25 test2 dovecot: pop3-login: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=24190, secured, session=<5Zdb+NDQdQAAAAAAAAAAAAAAAAAAAAAB> Dec 14 14:37:25 test2 dovecot: pop3: Debug: Added userdb setting: mail_location=maildir:~/Maildir Dec 14 14:37:25 test2 dovecot: pop3(home2): Debug: Effective uid=503, gid=503, home=/nfs/maildir/vmail/home2 userdb { args = uid=vmail gid=vmail home=/nfs/maildir/vmail/%u mail_location=maildir:~/Maildir driver = static } This was tested on a static passdb/userdb on a test server as well as production. version 2.1.10. When I have time, I'll dig into it myself after an upgrade to 2.1.12. Jack From jbates at brightok.net Fri Dec 14 18:00:00 2012 From: jbates at brightok.net (Jack Bates) Date: Fri, 14 Dec 2012 10:00:00 -0600 Subject: [Dovecot] BUG: mishandling of username if it's a keyword? In-Reply-To: <50CB3BD9.3040101@brightok.net> References: <50CB3BD9.3040101@brightok.net> Message-ID: <50CB4D00.5090603@brightok.net> Additional info by switching the home= and uid= settings in the config. userdb { args = home=/nfs/maildir/vmail/%u uid=vmail gid=vmail mail_location=maildir:~/Maildir driver = static } We got the effective id, but then home was unset and the user became the home setting. lol Dec 14 15:56:20 test2 dovecot: auth: Debug: master userdb out: USER#0112586836993#011home=/nfs/maildir/vmail/home#011uid=503#011gid=503#011mail_location=maildir:~/Maildir Dec 14 15:56:20 test2 dovecot: pop3-login: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=24686, secured, session= Dec 14 15:56:20 test2 dovecot: pop3: Debug: Added userdb setting: mail_location=maildir:~/Maildir Dec 14 15:56:20 test2 dovecot: pop3(home=/nfs/maildir/vmail/home): Debug: Effective uid=503, gid=503, home= Dec 14 15:56:20 test2 dovecot: pop3(home=/nfs/maildir/vmail/home): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Dec 14 15:56:20 test2 dovecot: pop3(home=/nfs/maildir/vmail/home): Error: user home=/nfs/maildir/vmail/home: Initialization failed: Namespace '': Home directory not set for user. Can't expand ~/ for mail root dir in: ~/Maildir Dec 14 15:56:20 test2 dovecot: pop3(home=/nfs/maildir/vmail/home): Error: Invalid user settings. Refer to server log for more information. Jack From jbates at brightok.net Fri Dec 14 18:04:50 2012 From: jbates at brightok.net (Jack Bates) Date: Fri, 14 Dec 2012 10:04:50 -0600 Subject: [Dovecot] BUG: mishandling of username if it's a keyword? In-Reply-To: <50CB4D00.5090603@brightok.net> References: <50CB3BD9.3040101@brightok.net> <50CB4D00.5090603@brightok.net> Message-ID: <50CB4E22.2020300@brightok.net> Dec 14 14:33:14 test2 dovecot: auth: Debug: master userdb out: USER#0112033451009#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir Dec 14 14:37:25 test2 dovecot: auth: Debug: master userdb out: USER#011477757441#011home2#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home2#011mail_location=maildir:~/Maildir Dec 14 15:44:23 test2 dovecot: auth: Debug: master userdb out: USER#0113466592257#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir Looking at the proper home2 account, it appears that the username "home" is being left out. This is definitely an issue with auth userdb. This was on 2.1.12. I upgraded. Jack On 12/14/2012 10:00 AM, Jack Bates wrote: > Additional info by switching the home= and uid= settings in the config. > > userdb { > args = home=/nfs/maildir/vmail/%u uid=vmail gid=vmail > mail_location=maildir:~/Maildir > driver = static > } > > We got the effective id, but then home was unset and the user became > the home setting. lol > From anmeyer at anup.de Fri Dec 14 18:24:01 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Fri, 14 Dec 2012 17:24:01 +0100 Subject: [Dovecot] need help with dovecot-lda Message-ID: <20121214172401.502960ec@itxnew.bitcorner.intern> Hello all! Some month ago I upgraded our dovecot installation from version 1.0.5 to version 2.1.7 without having any trouble. Postfix is delivering email directly per virtual transport to the maildirs and mailboxes of the users in /var/spool/vhosts/domains/.... Now I want to use dovecot-lda and created a new entry in the master.cf of postfix. dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f ${sender} -d ${recipient} It is not clear to me, how the dovecot-lda is started bei dovecot and you it finds the socket dovecot postfix created. The dovecot.conf looks like this; # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.22.5-31-bigsmp i686 openSUSE 10.3 (i586) ext3 auth_verbose = yes disable_plaintext_auth = no log_path = /var/log/dovecot1 mail_location = mbox:/var/spool/vhosts/%d/dovecotprivate/%n:INBOX=/var/spool/vhosts/%d/%n !include /etc/dovecot/conf.d/*.conf passdb { args = /etc/dovecot/passwd driver = passwd-file } userdb { args = /etc/dovecot/passwd driver = passwd-file } ssl_cert = < /etc/dovecot/ssl/hostcert.pem ssl_key = < /etc/dovecot/ssl/hostkey.pem #verbose_ssl = yes plugin { quota = maildir:User quota quota_rule = *:storage=500MB # 10% of 1GB = 100MB quota_rule2 = Trash:storage=+10%% # 20% of 1GB = 200MB # quota_rule3 = Spam:storage=+20%% autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = Sent } I set soft_bounce = yes in main.cf of postfix and delivery of mail fails with Dec 14 16:13:34 delta postfix/virtual[14082]: BBC0F1B31294: to=, relay=virtual, delay=395, delays=395/0.01/0/0.13, dsn=4.1.1, status=SOFTBOUNCE (unknown user: "xyz at anup.de") This is the relevant part of the main.cf: dovecot_destination_recipient_limit = 1 virtual_mailbox_domains = anup.de bit-corner.de bitcorner.de baubetreuung-meyer.de saxelektro.de virtual_mailbox_base = /var/spool/vhosts #virtual_mailbox_maps = hash:/etc/postfix/vmailbox #virtual_minimum_uid = 100 #virtual_uid_maps = static:5000 #virtual_gid_maps = static:5000 virtual_mailbox_limit = 524288000 virtual_transport = dovecot I don't get it right. As far as I understand postfix uses virtual_transport = dovecot and hands the mail over to the socket dovecot. But how does dovecot know where to look for the socket. I am missing somthing but don't know what. Any help is appreciated! Andreas From ben at morrow.me.uk Fri Dec 14 19:52:40 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Fri, 14 Dec 2012 17:52:40 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121214172401.502960ec@itxnew.bitcorner.intern> References: <20121214172401.502960ec@itxnew.bitcorner.intern> Message-ID: <20121214175240.GG39964@anubis.morrow.me.uk> At 5PM +0100 on 14/12/12 Andreas Meyer wrote: > > Some month ago I upgraded our dovecot installation from version 1.0.5 > to version 2.1.7 without having any trouble. Postfix is delivering > email directly per virtual transport to the maildirs and mailboxes of > the users in /var/spool/vhosts/domains/.... > > Now I want to use dovecot-lda and created a new entry in the master.cf > of postfix. > > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f > ${sender} -d ${recipient} > > It is not clear to me, how the dovecot-lda is started bei dovecot and > you it finds the socket dovecot postfix created. The process listening on that 'dovecot' pipe is a Postfix pipe(8) process. When a delivery request comes in from elsewhere in Postfix, it invokes /usr/libexec/dovecot/dovecot-lda as a new child process. This new lda process will contact the dovecot-auth service if it needs to, but is otherwise not connected to the running Dovecot server at all. If you want Dovecot to listen for deliveries (which has some efficiency advantages), you want to use LMTP. > I set soft_bounce = yes in main.cf of postfix and delivery of mail fails with > > Dec 14 16:13:34 delta postfix/virtual[14082]: BBC0F1B31294: > to=, relay=virtual, delay=395, delays=395/0.01/0/0.13, > dsn=4.1.1, status=SOFTBOUNCE (unknown user: "xyz at anup.de") What happens if you run echo "foo" | /usr/libexec/dovecot/dovecot-lda \ -f xyz at anup.de -d xyz at anup.de in the shell (as the vmail user)? Does it fail with exit code 67? This is EX_NOUSER, and is the standard way for LDAs to signal 'I don't know how to deliver to this user'. Either xyz at anup.de is not a valid address at that domain, or you haven't made the auth-userdb socket available to the vmail user. See http://wiki2.dovecot.org/LDA, under the section 'Virtual users'. Ben From tss at iki.fi Fri Dec 14 20:29:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 14 Dec 2012 20:29:57 +0200 Subject: [Dovecot] BUG: mishandling of username if it's a keyword? In-Reply-To: <50CB4E22.2020300@brightok.net> References: <50CB3BD9.3040101@brightok.net> <50CB4D00.5090603@brightok.net> <50CB4E22.2020300@brightok.net> Message-ID: <4398973B-60DF-4002-8FC5-3C456D59ABB2@iki.fi> Yes, it's a bug. Most importantly: I don't think this is a security hole, except maybe in some very specific installations. It only affects usernames that are the same as one of the "extra fields" in userdb. Such user needs to log in with a valid username and password before this happens. What happens is that when userdb sets the extra field, it thinks it's replacing an existing field and removes the username. So the username gets replaced by the next field. This often does mean that the user can log in using a wrong username (e.g. user is "uid=1000"), but there's really no way to set that to any specific username. So users can't read each others' mails. But because the username is different from expected, it could cause some confusion. I was also a bit worried that it still could allow users to create such accounts for some webmail providers, but pretty much all of them use user at domain style account names, and those aren't affected. So practically no possibility of this affecting anyone where admin doesn't explicitly create such account. I'll get this fixed when I have a bit of time. The fix isn't as easy as I'd like and it affects a large part of the authentication.. On 14.12.2012, at 18.04, Jack Bates wrote: > Dec 14 14:33:14 test2 dovecot: auth: Debug: master userdb out: USER#0112033451009#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir > Dec 14 14:37:25 test2 dovecot: auth: Debug: master userdb out: USER#011477757441#011home2#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home2#011mail_location=maildir:~/Maildir > Dec 14 15:44:23 test2 dovecot: auth: Debug: master userdb out: USER#0113466592257#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir > > Looking at the proper home2 account, it appears that the username "home" is being left out. This is definitely an issue with auth userdb. > > This was on 2.1.12. I upgraded. > > Jack > > On 12/14/2012 10:00 AM, Jack Bates wrote: >> Additional info by switching the home= and uid= settings in the config. >> >> userdb { >> args = home=/nfs/maildir/vmail/%u uid=vmail gid=vmail mail_location=maildir:~/Maildir >> driver = static >> } >> >> We got the effective id, but then home was unset and the user became the home setting. lol >> > From jbates at brightok.net Fri Dec 14 20:37:12 2012 From: jbates at brightok.net (Jack Bates) Date: Fri, 14 Dec 2012 12:37:12 -0600 Subject: [Dovecot] BUG: mishandling of username if it's a keyword? In-Reply-To: <4398973B-60DF-4002-8FC5-3C456D59ABB2@iki.fi> References: <50CB3BD9.3040101@brightok.net> <50CB4D00.5090603@brightok.net> <50CB4E22.2020300@brightok.net> <4398973B-60DF-4002-8FC5-3C456D59ABB2@iki.fi> Message-ID: <50CB71D8.1020209@brightok.net> It looks as if some things make extra passes. I'm still tracing it, but could we modify userdb_template_export to skip the user part? It's interesting as I noticed that user=%u in a static config still ends up having an issue, which implies it was processed twice (once to home, and again to mess up). My problem is that I am moving an existing userbase and my user "home" isn't going to be happy to change. lol I'll keep looking. I know it has to be treated carefully given that USER can be changed and it will effect all userdb types. Currently I'm testing with both ldap w/ prefetch and static userdb. Jack On 12/14/2012 12:29 PM, Timo Sirainen wrote: > Yes, it's a bug. Most importantly: I don't think this is a security hole, except maybe in some very specific installations. It only affects usernames that are the same as one of the "extra fields" in userdb. Such user needs to log in with a valid username and password before this happens. What happens is that when userdb sets the extra field, it thinks it's replacing an existing field and removes the username. So the username gets replaced by the next field. This often does mean that the user can log in using a wrong username (e.g. user is "uid=1000"), but there's really no way to set that to any specific username. So users can't read each others' mails. But because the username is different from expected, it could cause some confusion. > > I was also a bit worried that it still could allow users to create such accounts for some webmail providers, but pretty much all of them use user at domain style account names, and those aren't affected. So practically no possibility of this affecting anyone where admin doesn't explicitly create such account. > > I'll get this fixed when I have a bit of time. The fix isn't as easy as I'd like and it affects a large part of the authentication.. > > On 14.12.2012, at 18.04, Jack Bates wrote: > >> Dec 14 14:33:14 test2 dovecot: auth: Debug: master userdb out: USER#0112033451009#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir >> Dec 14 14:37:25 test2 dovecot: auth: Debug: master userdb out: USER#011477757441#011home2#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home2#011mail_location=maildir:~/Maildir >> Dec 14 15:44:23 test2 dovecot: auth: Debug: master userdb out: USER#0113466592257#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir >> >> Looking at the proper home2 account, it appears that the username "home" is being left out. This is definitely an issue with auth userdb. >> >> This was on 2.1.12. I upgraded. >> >> Jack >> >> On 12/14/2012 10:00 AM, Jack Bates wrote: >>> Additional info by switching the home= and uid= settings in the config. >>> >>> userdb { >>> args = home=/nfs/maildir/vmail/%u uid=vmail gid=vmail mail_location=maildir:~/Maildir >>> driver = static >>> } >>> >>> We got the effective id, but then home was unset and the user became the home setting. lol >>> > From tss at iki.fi Fri Dec 14 20:41:05 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 14 Dec 2012 20:41:05 +0200 Subject: [Dovecot] BUG: mishandling of username if it's a keyword? In-Reply-To: <50CB71D8.1020209@brightok.net> References: <50CB3BD9.3040101@brightok.net> <50CB4D00.5090603@brightok.net> <50CB4E22.2020300@brightok.net> <4398973B-60DF-4002-8FC5-3C456D59ABB2@iki.fi> <50CB71D8.1020209@brightok.net> Message-ID: <9B7F708A-C33E-4AB5-B87C-15208855E57E@iki.fi> If you just want to quickly work around it, I think you could give "userdb" parameter to auth_stream_reply_init() which is TRUE for the userdb_reply and FALSE the passdb reply. Then in auth_stream_reply_remove() and _find() and _exists() skip the first parameter if userdb=TRUE. Hmm. That's probably what I'll do for v2.1, and a bit larger cleanup for v2.2. On 14.12.2012, at 20.37, Jack Bates wrote: > It looks as if some things make extra passes. I'm still tracing it, but could we modify userdb_template_export to skip the user part? > > It's interesting as I noticed that user=%u in a static config still ends up having an issue, which implies it was processed twice (once to home, and again to mess up). > > My problem is that I am moving an existing userbase and my user "home" isn't going to be happy to change. lol > > I'll keep looking. I know it has to be treated carefully given that USER can be changed and it will effect all userdb types. Currently I'm testing with both ldap w/ prefetch and static userdb. > > Jack > > On 12/14/2012 12:29 PM, Timo Sirainen wrote: >> Yes, it's a bug. Most importantly: I don't think this is a security hole, except maybe in some very specific installations. It only affects usernames that are the same as one of the "extra fields" in userdb. Such user needs to log in with a valid username and password before this happens. What happens is that when userdb sets the extra field, it thinks it's replacing an existing field and removes the username. So the username gets replaced by the next field. This often does mean that the user can log in using a wrong username (e.g. user is "uid=1000"), but there's really no way to set that to any specific username. So users can't read each others' mails. But because the username is different from expected, it could cause some confusion. >> >> I was also a bit worried that it still could allow users to create such accounts for some webmail providers, but pretty much all of them use user at domain style account names, and those aren't affected. So practically no possibility of this affecting anyone where admin doesn't explicitly create such account. >> >> I'll get this fixed when I have a bit of time. The fix isn't as easy as I'd like and it affects a large part of the authentication.. >> >> On 14.12.2012, at 18.04, Jack Bates wrote: >> >>> Dec 14 14:33:14 test2 dovecot: auth: Debug: master userdb out: USER#0112033451009#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir >>> Dec 14 14:37:25 test2 dovecot: auth: Debug: master userdb out: USER#011477757441#011home2#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home2#011mail_location=maildir:~/Maildir >>> Dec 14 15:44:23 test2 dovecot: auth: Debug: master userdb out: USER#0113466592257#011uid=503#011gid=503#011home=/nfs/maildir/vmail/home#011mail_location=maildir:~/Maildir >>> >>> Looking at the proper home2 account, it appears that the username "home" is being left out. This is definitely an issue with auth userdb. >>> >>> This was on 2.1.12. I upgraded. >>> >>> Jack >>> >>> On 12/14/2012 10:00 AM, Jack Bates wrote: >>>> Additional info by switching the home= and uid= settings in the config. >>>> >>>> userdb { >>>> args = home=/nfs/maildir/vmail/%u uid=vmail gid=vmail mail_location=maildir:~/Maildir >>>> driver = static >>>> } >>>> >>>> We got the effective id, but then home was unset and the user became the home setting. lol >>>> >> > From anmeyer at anup.de Fri Dec 14 22:30:02 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Fri, 14 Dec 2012 21:30:02 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121214175240.GG39964@anubis.morrow.me.uk> References: <20121214172401.502960ec@itxnew.bitcorner.intern> <20121214175240.GG39964@anubis.morrow.me.uk> Message-ID: <20121214213002.7106fd57@itxnew.bitcorner.intern> Hello! Ben Morrow wrote: > At 5PM +0100 on 14/12/12 Andreas Meyer wrote: > > > > Some month ago I upgraded our dovecot installation from version 1.0.5 > > to version 2.1.7 without having any trouble. Postfix is delivering > > email directly per virtual transport to the maildirs and mailboxes of > > the users in /var/spool/vhosts/domains/.... > > > > Now I want to use dovecot-lda and created a new entry in the master.cf > > of postfix. > > > > dovecot unix - n n - - pipe > > flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f > > ${sender} -d ${recipient} > > > > It is not clear to me, how the dovecot-lda is started bei dovecot and > > you it finds the socket dovecot postfix created. > > The process listening on that 'dovecot' pipe is a Postfix pipe(8) > process. When a delivery request comes in from elsewhere in Postfix, it > invokes /usr/libexec/dovecot/dovecot-lda as a new child process. This > new lda process will contact the dovecot-auth service if it needs to, > but is otherwise not connected to the running Dovecot server at all. > > If you want Dovecot to listen for deliveries (which has some efficiency > advantages), you want to use LMTP. > > > I set soft_bounce = yes in main.cf of postfix and delivery of mail fails with > > > > Dec 14 16:13:34 delta postfix/virtual[14082]: BBC0F1B31294: > > to=, relay=virtual, delay=395, delays=395/0.01/0/0.13, > > dsn=4.1.1, status=SOFTBOUNCE (unknown user: "xyz at anup.de") > > What happens if you run > > echo "foo" | /usr/libexec/dovecot/dovecot-lda \ > -f xyz at anup.de -d xyz at anup.de > > in the shell (as the vmail user)? Does it fail with exit code 67? This > is EX_NOUSER, and is the standard way for LDAs to signal 'I don't know > how to deliver to this user'. Either xyz at anup.de is not a valid address > at that domain, or you haven't made the auth-userdb socket available to > the vmail user. See http://wiki2.dovecot.org/LDA, under the section > 'Virtual users'. I did this in the shell: delta:/ # su vmail delta:/ # whoami root delta:/ # echo "test" | /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de and the mail was delivered to the mailbox without error. Maybe the vmail user is the problem? When I send an email from my desktop I get this in the mail.log: Dec 14 21:19:42 delta postfix/virtual[16185]: A6E511B3128A: to=, relay=virtual, delay=0.15, delays=0.08/0.01/0/0.06, dsn=4.1.1, status=SOFTBOUNCE (unknown user: "anmeyer at anup.de") The line of the /etc/shadow for vmail looks like this: vmail::13940:0:99999:7::: Why is root not switching to vmail? May vmail be the problem? delta:/ # id vmail uid=110(vmail) gid=110(vmail) Gruppen=110(vmail) Andreas From p.heinlein at heinlein-support.de Sat Dec 15 09:44:36 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Sat, 15 Dec 2012 08:44:36 +0100 Subject: [Dovecot] mdbox: more then one altstorage Message-ID: <50CC2A64.30309@heinlein-support.de> The mdbox-format with the altstorage-feature is quite nice and important. But we're having much more then >> 30 TB of maildata and doing an fsck on huge partitions takes too much (down-) time for our mailsystem. It would be much easier, if Dovecot would be able to use at least THREE storage-paths for his m-Files (and not just TWO like now). Having an altstorage1 and altstorage2, we would be able to move away all mails from on altstorage-mountpoint, we could put this storage-moungpoint into "maintenance" and do an fsck without Downtime for Dovecot. It would be nice having a doveadm-feature to put a altstorage-path in "maintenance-mode", so to move easily away all m-files to other alt-storage-paths and to let Dovecot know not to use this locked partition. Having even more then 3 storage-paths would be nice for huge setups: In this case we could easily use different SMALLER partitions without having just two or three huge partitions > 15 TB. The architecture of the altstorage-system is nice and simple. Wouldn't it be easily possible to look (at least) in three, then just in two places for a m-file? What about a "hash_dir"-system for the storage? What about a configuration-parameter like altstorage_dirs=4 which would mean, that there are 4 storage-mountpoints that could be addressed by "%m": mail_location = mdbox:/vmail/%d/%n/mdbox:altstorage/alt/%m/%d/%n In this case, Dovecot could easily use all existing partitions automatically "round-robin". Or maybe it would be better to tell Dovecot the partitions by: altstorage_dirs_existing = 1,2,3,4 altstorage_dirs_newmail = 1,4 so it would be very easy to tell Dovecot in which partitions he has to look for m-files and where he is allowed to save round-robin new e-mails. With this setup it's easy to put a partition in maintenance mode. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Sat Dec 15 09:52:39 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Sat, 15 Dec 2012 08:52:39 +0100 Subject: [Dovecot] Dovecot "sleep" for short snapshots Message-ID: <50CC2C47.9000400@heinlein-support.de> Making consistent backups from Dovecot with mdbox requires a snapshoted filesystem with (at least) a short Downtime for Dovecot. I'd like to avoid killing several thenthousand IMAP-sessions for 60 seconds. Users don't like that... And the admin dislakes that too... What about a "short sleep" mechanism for Dovecot, where all writes are finished and new writes are easily delayed? I'd like to following process: *) "doveadm sleep" puts Dovecot in sleep-Mode: -- All existing writes are finished (before "doveadm sleep" is allowed to exit) -- All new writes are simply delayed -- All readonly-operations could work normally, so users can fetch and read mails *) The the admin can create a LVM-/SAN-snapshot of the filesystems *) "doveadm unsleep" will finish the magic Overall the whole process will take just some seconds. Users will recognize a simple write-delay, but they can work normally and the aren't unconnected at all. If the snapshot is really fast the users won't recognize the whole situation at all. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From stan at hardwarefreak.com Sat Dec 15 10:23:29 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 15 Dec 2012 02:23:29 -0600 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CC2A64.30309@heinlein-support.de> References: <50CC2A64.30309@heinlein-support.de> Message-ID: <50CC3381.1050608@hardwarefreak.com> On 12/15/2012 1:44 AM, Peer Heinlein wrote: > But we're having much more then >> 30 TB of maildata and doing an fsck > on huge partitions takes too much (down-) time for our mailsystem. Peer are you using NFS or a cluster filesystem? Linux on the hosts or other? -- Stan From anmeyer at anup.de Sat Dec 15 12:40:12 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 11:40:12 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121214175240.GG39964@anubis.morrow.me.uk> References: <20121214172401.502960ec@itxnew.bitcorner.intern> <20121214175240.GG39964@anubis.morrow.me.uk> Message-ID: <20121215114012.5b585a61@itxnew.bitcorner.intern> Hello! Ben Morrow wrote: > At 5PM +0100 on 14/12/12 Andreas Meyer wrote: > > dovecot unix - n n - - pipe > > flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f > > ${sender} -d ${recipient} > What happens if you run > > echo "foo" | /usr/libexec/dovecot/dovecot-lda \ > -f xyz at anup.de -d xyz at anup.de # id vmail uid=5000(vmail) gid=5000(vmail) Gruppen=5000(vmail) # su vmail echo "foo" | /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de an empty email with 0 B gets delivered to the maildir of anmeyer at anup.de # echo "foo" | /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de email with foo in the body is delivered to the maildir. # delta:/var/spool/vhosts/anup.de/anmeyer/new # ll insgesamt 4 -rw------- 1 vmail vmail 0 15. Dez 11:26 1355567160.M902698P23725.delta,S=0,W=0 -rw------- 1 vmail vmail 4 15. Dez 11:26 1355567171.M334599P23728.delta,S=4,W=5 > in the shell (as the vmail user)? Does it fail with exit code 67? This > is EX_NOUSER, and is the standard way for LDAs to signal 'I don't know > how to deliver to this user'. Either xyz at anup.de is not a valid address > at that domain, or you haven't made the auth-userdb socket available to > the vmail user. See http://wiki2.dovecot.org/LDA, under the section > 'Virtual users'. I already added service auth { unix_listener auth-userdb { mode = 0600 user = vmail # User running dovecot-lda group = vmail # Or alternatively mode 0660 + dovecot-lda user in this group } } to the dovecot.conf. How does dovecot know there is a socket in /var/spool/postfix/private/dovecot? And how does dovecot-lda know to look there. Am I missunderstanding something? If I send an email from the desktop I have in the mail.log Dec 15 11:35:25 delta postfix/virtual[23910]: E0BC61B3128A: to=, relay=virtual, delay=0.18, delays=0.09/0.01/0/0.09, dsn=4.1.1, status=SOFTBOUNCE (unknown user: "anmeyer at anup.de") and the mail is stuck in the queue # mailq -Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient------- E0BC61B3128A 559 Sat Dec 15 11:35:24 anmeyer at anup.de (unknown user: "anmeyer at anup.de") anmeyer at anup.de I am lost. I don't if the mail is handed over to dovecot-lda and if so why it can't find the passwd-file. > > Ben > Andreas From ben at morrow.me.uk Sat Dec 15 14:25:25 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 12:25:25 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121214213002.7106fd57@itxnew.bitcorner.intern> <20121215114012.5b585a61@itxnew.bitcorner.intern> Message-ID: <20121215122524.GA16098@anubis.morrow.me.uk> At 9PM +0100 on 14/12/12 Andreas Meyer wrote: > Ben Morrow wrote: > > At 5PM +0100 on 14/12/12 Andreas Meyer wrote: > > > > > > Some month ago I upgraded our dovecot installation from version 1.0.5 > > > to version 2.1.7 without having any trouble. Postfix is delivering > > > email directly per virtual transport to the maildirs and mailboxes of > > > the users in /var/spool/vhosts/domains/.... > > > I set soft_bounce = yes in main.cf of postfix and delivery of mail > > > fails with > > > > > > Dec 14 16:13:34 delta postfix/virtual[14082]: BBC0F1B31294: > > > to=, relay=virtual, delay=395, delays=395/0.01/0/0.13, > > > dsn=4.1.1, status=SOFTBOUNCE (unknown user: "xyz at anup.de") > > > > What happens if you run > > > > echo "foo" | /usr/libexec/dovecot/dovecot-lda \ > > -f xyz at anup.de -d xyz at anup.de > > > > in the shell (as the vmail user)? Does it fail with exit code 67? This > > is EX_NOUSER, and is the standard way for LDAs to signal 'I don't know > > how to deliver to this user'. Either xyz at anup.de is not a valid address > > at that domain, or you haven't made the auth-userdb socket available to > > the vmail user. See http://wiki2.dovecot.org/LDA, under the section > > 'Virtual users'. > > I did this in the shell: > > delta:/ # su vmail > delta:/ # whoami > root So su didn't work. That's often the case with daemon users, because they often don't have a login shell. Read the manpage for your system's su to find out if you can override that, and how (I can't help you here, since your su is probably different from mine). You may have more luck with sudo, if you've got it installed. > delta:/ # echo "test" | /usr/libexec/dovecot/dovecot-lda -f > anmeyer at anup.de -d anmeyer at anup.de > > and the mail was delivered to the mailbox without error. Maybe the > vmail user is the problem? That is delivered to 'anmayer at anup.de', which looks a lot more like a real address than 'xyz at anup.de'. > When I send an email from my desktop I get this in the mail.log: > Dec 14 21:19:42 delta postfix/virtual[16185]: A6E511B3128A: > to=, relay=virtual, delay=0.15, > delays=0.08/0.01/0/0.06, dsn=4.1.1, status=SOFTBOUNCE (unknown user: > "anmeyer at anup.de") So it's likely the vmail user can't read the userdb; do you not get any logs from dovecot-lda? (You may not if Dovecot is using custom logs rather than syslog, and vmail doesn't have write access.) > The line of the /etc/shadow for vmail looks like this: > vmail::13940:0:99999:7::: How is that relevant? AFAIK the login shell lives in /etc/passwd on shadow-password systems. At 11AM +0100 on 15/12/12 Andreas Meyer wrote: > > # id vmail > uid=5000(vmail) gid=5000(vmail) Gruppen=5000(vmail) > > # su vmail echo "foo" | /usr/libexec/dovecot/dovecot-lda -f > anmeyer at anup.de -d anmeyer at anup.de > an empty email with 0 B gets delivered to the maildir of anmeyer at anup.de That command-line attempts to run 'echo "foo"' as the vmail user, and dovecot-lda as root (and I don't know if the arguments to su are correct; on my system they wouldn't be). You *really* need to learn how to use your operating system before you try anything relatively complicated like setting up a mail server. > > in the shell (as the vmail user)? Does it fail with exit code 67? This > > is EX_NOUSER, and is the standard way for LDAs to signal 'I don't know > > how to deliver to this user'. Either xyz at anup.de is not a valid address > > at that domain, or you haven't made the auth-userdb socket available to > > the vmail user. See http://wiki2.dovecot.org/LDA, under the section > > 'Virtual users'. > > I already added > > service auth { > unix_listener auth-userdb { > mode = 0600 > user = vmail # User running dovecot-lda > group = vmail # Or alternatively mode 0660 + dovecot-lda user in > this group You're supposed to understand the comments and then remove them, not copy them blindly without reading them. > } > } > > to the dovecot.conf. Well, that looks OK to me; but the only way to test it is to manually run dovecot-lda as vmail. Is there an auth-userdb socket in your dovecot sockets directory? Does it have the right permissions? > How does dovecot know there is a socket in > /var/spool/postfix/private/dovecot? And how does dovecot-lda know to > look there. Am I missunderstanding something? Yes, you are misunderstanding something. It works (something) like this: - A mail comes in to Postfix. - Postfix decides this mail is local. - Postfix sends the mail through /var/spool/postfix/private/dovecot to a Postfix pipe(8) process on the other end. - That pipe(8) process runs dovecot-lda, as the vmail user. - dovecot-lda reads dovecot.conf. - dovecot-lda contacts the Dovecot auth process using the auth-userdb socket. - If the user exists, it delivers the mail to their mailbox. No Dovecot process needs to know anything at all about the Postfix socket, it's just for internal communication between different bits of Postfix. Have you read the Postfix documentation? > I am lost. I don't if the mail is handed over to dovecot-lda and if so > why it can't find the passwd-file. If the mail was handed over to dovecot-lda, it ought to be logging *something*. Find out where those logs should go; if they aren't appearing, you need to fix that. Syslog is IMHO a better bet than custom log files. Ben From anmeyer at anup.de Sat Dec 15 15:12:29 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 14:12:29 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215122524.GA16098@anubis.morrow.me.uk> References: <20121215114012.5b585a61@itxnew.bitcorner.intern> <20121215122524.GA16098@anubis.morrow.me.uk> Message-ID: <20121215141229.31b35fca@itxnew.bitcorner.intern> Hello! > > I already added > > > > service auth { > > unix_listener auth-userdb { > > mode = 0600 > > user = vmail # User running dovecot-lda > > group = vmail # Or alternatively mode 0660 + dovecot-lda user in > > this group > > You're supposed to understand the comments and then remove them, not > copy them blindly without reading them. That's ok, I'll remove the comments. But there is no auth-userdb socket in the sockets directtory of dovecot. > > } > > } > > > > to the dovecot.conf. > > Well, that looks OK to me; but the only way to test it is to manually > run dovecot-lda as vmail. Is there an auth-userdb socket in your dovecot > sockets directory? Does it have the right permissions? No, no such socket in /var/run/dovecot # ll insgesamt 4 srwxrwxrwx 1 root root 0 8. Jun 2012 dict-server drwxr-x--- 2 root dovecot 4096 22. Jun 19:58 login > > How does dovecot know there is a socket in > > /var/spool/postfix/private/dovecot? And how does dovecot-lda know to > > look there. Am I missunderstanding something? > > Yes, you are misunderstanding something. It works (something) like this: > > - A mail comes in to Postfix. > - Postfix decides this mail is local. > - Postfix sends the mail through /var/spool/postfix/private/dovecot > to a Postfix pipe(8) process on the other end. > - That pipe(8) process runs dovecot-lda, as the vmail user. > - dovecot-lda reads dovecot.conf. > - dovecot-lda contacts the Dovecot auth process using the > auth-userdb socket. > - If the user exists, it delivers the mail to their mailbox. > > No Dovecot process needs to know anything at all about the Postfix > socket, it's just for internal communication between different bits of > Postfix. Have you read the Postfix documentation? Thank you for that explanation! > > I am lost. I don't if the mail is handed over to dovecot-lda and if so > > why it can't find the passwd-file. > > If the mail was handed over to dovecot-lda, it ought to be logging > *something*. Find out where those logs should go; if they aren't > appearing, you need to fix that. Syslog is IMHO a better bet than custom > log files. I have a dovecot-lda-errors.log and a dovecot-lda.log # cat dovecot-lda-errors.log Dec 14 23:28:20 lda: Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: No such file or directory Dec 14 23:28:20 lda: Fatal: Internal error occurred. Refer to server log for more information. # echo "foo" | /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de # cat dovecot-lda.log Dec 14 21:04:07 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 14 21:16:46 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 14 21:18:25 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 14 21:20:44 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 14 21:58:13 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 10:14:50 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 10:14:59 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 10:24:19 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 10:24:27 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 11:14:58 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 11:26:01 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 11:26:11 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Dec 15 14:07:40 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' So the question is how do I get this auth-userdb socket? > > Ben > Andreas From anmeyer at anup.de Sat Dec 15 15:18:49 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 14:18:49 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215141229.31b35fca@itxnew.bitcorner.intern> References: <20121215114012.5b585a61@itxnew.bitcorner.intern> <20121215122524.GA16098@anubis.morrow.me.uk> <20121215141229.31b35fca@itxnew.bitcorner.intern> Message-ID: <20121215141849.69585aff@itxnew.bitcorner.intern> Andreas Meyer wrote: > > Well, that looks OK to me; but the only way to test it is to manually > > run dovecot-lda as vmail. Is there an auth-userdb socket in your dovecot > > sockets directory? Does it have the right permissions? > > No, no such socket in /var/run/dovecot I just found out the sockets of dovecot reside in /usr/var/run/dovecot # ll insgesamt 16 srw------- 1 root root 0 15. Dez 11:14 anvil srw------- 1 root root 0 15. Dez 11:14 anvil-auth-penalty srw------- 1 root root 0 15. Dez 11:14 auth-client srw------- 1 dovecot root 0 15. Dez 11:14 auth-login srw------- 1 root root 0 15. Dez 11:14 auth-master srw------- 1 vmail vmail 0 15. Dez 11:14 auth-userdb srw------- 1 dovecot root 0 15. Dez 11:14 auth-worker srw------- 1 root root 0 15. Dez 11:14 config srw------- 1 root root 0 15. Dez 11:14 dict srw------- 1 root root 0 15. Dez 11:14 director-admin srw-rw-rw- 1 root root 0 15. Dez 11:14 dns-client srw------- 1 root root 0 15. Dez 11:14 doveadm-server lrwxrwxrwx 1 root root 29 15. Dez 11:14 dovecot.conf -> /usr/etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 8. Jun 2012 empty srw-rw-rw- 1 root root 0 15. Dez 11:14 indexer srw------- 1 dovecot root 0 15. Dez 11:14 indexer-worker srw------- 1 root root 0 15. Dez 11:14 ipc srw-rw-rw- 1 root root 0 15. Dez 11:14 lmtp srw------- 1 root root 0 15. Dez 11:14 log-errors drwxr-x--- 2 root dovenull 4096 15. Dez 11:14 login -rw------- 1 root root 6 15. Dez 11:14 master.pid -rw-r--r-- 1 root root 37 15. Dez 11:14 mounts srw------- 1 root root 0 15. Dez 11:14 replication-notify prw------- 1 root root 0 15. Dez 11:14 replication-notify-fifo srw------- 1 dovecot root 0 15. Dez 11:14 replicator srw------- 1 root root 0 15. Dez 11:14 stats prw------- 1 root root 0 15. Dez 11:14 stats-mail the auth-userdb is there and vmail is the owner. What problem do I have that dovecot-lda does not find the users? Andreas From ben at morrow.me.uk Sat Dec 15 15:56:20 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 13:56:20 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215141229.31b35fca@itxnew.bitcorner.intern> <20121215141849.69585aff@itxnew.bitcorner.intern> Message-ID: <20121215135619.GB16098@anubis.morrow.me.uk> At 2PM +0100 on 15/12/12 Andreas Meyer wrote: > [Ben Morrow wrote:] > > > > Well, that looks OK to me; but the only way to test it is to manually > > run dovecot-lda as vmail. Is there an auth-userdb socket in your dovecot > > sockets directory? Does it have the right permissions? > > No, no such socket in /var/run/dovecot > > # ll > insgesamt 4 > srwxrwxrwx 1 root root 0 8. Jun 2012 dict-server > drwxr-x--- 2 root dovecot 4096 22. Jun 19:58 login If I were to ask 'is anything listening on those sockets?' is there any chance you could answer that? > > If the mail was handed over to dovecot-lda, it ought to be logging > > *something*. Find out where those logs should go; if they aren't > > appearing, you need to fix that. Syslog is IMHO a better bet than custom > > log files. > > I have a dovecot-lda-errors.log and a dovecot-lda.log > > # cat dovecot-lda-errors.log > Dec 14 23:28:20 lda: Error: userdb lookup: > connect(/var/run/dovecot/auth-userdb) failed: No such file or > directory > Dec 14 23:28:20 lda: Fatal: Internal error occurred. Refer to server > log for more information. At 2PM +0100 on 15/12/12 Andreas Meyer wrote: > > I just found out the sockets of dovecot reside in /usr/var/run/dovecot OK, that's... a little bizarre. That's not where dovecot-lda is looking, at least not according to the log above. Is the vmail user able to read dovecot.conf? Do you have more than one dovecot.conf, with different settings in? I would ask you to run doveconf -m lda base_dir auth_socket_path as the vmail user, but I'm not convinced you know how. Ben From anmeyer at anup.de Sat Dec 15 16:41:34 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 15:41:34 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215135619.GB16098@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> Message-ID: <20121215154134.156af02e@itxnew.bitcorner.intern> Ben Morrow wrote: > At 2PM +0100 on 15/12/12 Andreas Meyer wrote: > > [Ben Morrow wrote:] > > > > > > Well, that looks OK to me; but the only way to test it is to manually > > > run dovecot-lda as vmail. Is there an auth-userdb socket in your dovecot > > > sockets directory? Does it have the right permissions? > > > > No, no such socket in /var/run/dovecot > > > > # ll > > insgesamt 4 > > srwxrwxrwx 1 root root 0 8. Jun 2012 dict-server > > drwxr-x--- 2 root dovecot 4096 22. Jun 19:58 login > > If I were to ask 'is anything listening on those sockets?' is there any > chance you could answer that? Nothing is listening on /var/run/dovecot. It must be a relict from the old version 1.x # netstat -lnp |grep dovecot tcp 0 0 0.0.0.0:993 0.0.0.0:* LISTEN 25542/dovecot tcp 0 0 0.0.0.0:995 0.0.0.0:* LISTEN 25542/dovecot tcp 0 0 0.0.0.0:110 0.0.0.0:* LISTEN 25542/dovecot tcp 0 0 0.0.0.0:143 0.0.0.0:* LISTEN 25542/dovecot tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN 25542/dovecot tcp 0 0 :::993 :::* LISTEN 25542/dovecot tcp 0 0 :::995 :::* LISTEN 25542/dovecot tcp 0 0 :::110 :::* LISTEN 25542/dovecot tcp 0 0 :::143 :::* LISTEN 25542/dovecot tcp 0 0 :::4190 :::* LISTEN 25542/dovecot unix 2 [ ACC ] STREAM H?RT 3425398 24015/master private/dovecot unix 2 [ ACC ] STREAM H?RT 3441242 25542/dovecot /usr/var/run/dovecot/login/sieve unix 2 [ ACC ] STREAM H?RT 3441249 25542/dovecot /usr/var/run/dovecot/login/ssl-params unix 2 [ ACC ] STREAM H?RT 3441260 25542/dovecot /usr/var/run/dovecot/login/pop3 unix 2 [ ACC ] STREAM H?RT 3441278 25542/dovecot /usr/var/run/dovecot/login/ipc-proxy unix 2 [ ACC ] STREAM H?RT 3441288 25542/dovecot /usr/var/run/dovecot/login/imap unix 2 [ ACC ] STREAM H?RT 3441302 25542/dovecot /usr/var/run/dovecot/login/dns-client unix 2 [ ACC ] STREAM H?RT 3441316 25542/dovecot /usr/var/run/dovecot/login/login unix 2 [ ACC ] STREAM H?RT 3441246 25542/dovecot /usr/var/run/dovecot/stats unix 2 [ ACC ] STREAM H?RT 3441253 25542/dovecot /usr/var/run/dovecot/replicator unix 2 [ ACC ] STREAM H?RT 3441257 25542/dovecot /usr/var/run/dovecot/replication-notify unix 2 [ ACC ] STREAM H?RT 3441268 25542/dovecot /usr/var/run/dovecot/log-errors unix 2 [ ACC ] STREAM H?RT 3441272 25542/dovecot /usr/var/run/dovecot/lmtp unix 2 [ ACC ] STREAM H?RT 3441276 25542/dovecot /usr/var/run/dovecot/ipc unix 2 [ ACC ] STREAM H?RT 3441282 25542/dovecot /usr/var/run/dovecot/indexer-worker unix 2 [ ACC ] STREAM H?RT 3441286 25542/dovecot /usr/var/run/dovecot/indexer unix 2 [ ACC ] STREAM H?RT 3441296 25542/dovecot /usr/var/run/dovecot/doveadm-server unix 2 [ ACC ] STREAM H?RT 3441300 25542/dovecot /usr/var/run/dovecot/dns-client unix 2 [ ACC ] STREAM H?RT 3441306 25542/dovecot /usr/var/run/dovecot/director-admin unix 2 [ ACC ] STREAM H?RT 3441310 25542/dovecot /usr/var/run/dovecot/dict unix 2 [ ACC ] STREAM H?RT 3441314 25542/dovecot /usr/var/run/dovecot/config unix 2 [ ACC ] STREAM H?RT 3441320 25542/dovecot /usr/var/run/dovecot/auth-login unix 2 [ ACC ] STREAM H?RT 3441324 25542/dovecot /usr/var/run/dovecot/auth-client unix 2 [ ACC ] STREAM H?RT 3441328 25542/dovecot /usr/var/run/dovecot/auth-userdb unix 2 [ ACC ] STREAM H?RT 3441332 25542/dovecot /usr/var/run/dovecot/auth-master unix 2 [ ACC ] STREAM H?RT 3441336 25542/dovecot /usr/var/run/dovecot/auth-worker unix 2 [ ACC ] STREAM H?RT 3441340 25542/dovecot /usr/var/run/dovecot/anvil unix 2 [ ACC ] STREAM H?RT 3441344 25542/dovecot /usr/var/run/dovecot/anvil-auth-penalty > > > > If the mail was handed over to dovecot-lda, it ought to be logging > > > *something*. Find out where those logs should go; if they aren't > > > appearing, you need to fix that. Syslog is IMHO a better bet than custom > > > log files. > > > > I have a dovecot-lda-errors.log and a dovecot-lda.log > > > > # cat dovecot-lda-errors.log > > Dec 14 23:28:20 lda: Error: userdb lookup: > > connect(/var/run/dovecot/auth-userdb) failed: No such file or > > directory > > Dec 14 23:28:20 lda: Fatal: Internal error occurred. Refer to server > > log for more information. > > At 2PM +0100 on 15/12/12 Andreas Meyer wrote: > > > > I just found out the sockets of dovecot reside in /usr/var/run/dovecot > > OK, that's... a little bizarre. > > That's not where dovecot-lda is looking, at least not according to the > log above. Is the vmail user able to read dovecot.conf? Do you have more > than one dovecot.conf, with different settings in? I would ask you to > run > > doveconf -m lda base_dir auth_socket_path > > as the vmail user, but I'm not convinced you know how. I can run it as root but not as vmail # su vmail doveconf -m lda base_dir auth_socket_path /usr/bin/doveconf: /usr/bin/doveconf: cannot execute binary file # doveconf -m lda base_dir auth_socket_path base_dir = /usr/var/run/dovecot auth_socket_path = auth-userdb You are great! So the problem is dovecot-lda does not find the sockets. Can I tell it to look in /usr/var/run/dovecot? > > Ben > Andreas From anmeyer at anup.de Sat Dec 15 16:58:39 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 15:58:39 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215135619.GB16098@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> Message-ID: <20121215155839.0793842e@itxnew.bitcorner.intern> Ben Morrow wrote: > That's not where dovecot-lda is looking, at least not according to the > log above. Is the vmail user able to read dovecot.conf? Do you have more > than one dovecot.conf, with different settings in? I would ask you to > run > > doveconf -m lda base_dir auth_socket_path > > as the vmail user, but I'm not convinced you know how. I managed to su to vmail by giving it a shell. # su - vmail vmail at delta:~> doveconf -m lda base_dir auth_socket_path base_dir = /usr/var/run/dovecot auth_socket_path = auth-userdb But I don't know how to tell dovecot-lda to listen on sockets in /usr/var/run/dovecot > > Ben > Andreas From ben at morrow.me.uk Sat Dec 15 17:24:54 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 15:24:54 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215155839.0793842e@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> Message-ID: <20121215152454.GC16098@anubis.morrow.me.uk> At 3PM +0100 on 15/12/12 you (Andreas Meyer) wrote: > Ben Morrow wrote: > > > That's not where dovecot-lda is looking, at least not according to the > > log above. Is the vmail user able to read dovecot.conf? Do you have more > > than one dovecot.conf, with different settings in? I would ask you to > > run > > > > doveconf -m lda base_dir auth_socket_path > > > > as the vmail user, but I'm not convinced you know how. > > I managed to su to vmail by giving it a shell. > > # su - vmail > vmail at delta:~> doveconf -m lda base_dir auth_socket_path > base_dir = /usr/var/run/dovecot > auth_socket_path = auth-userdb > > But I don't know how to tell dovecot-lda to listen on sockets > in /usr/var/run/dovecot Do you mean 'connect to'? It's important to be clear. The first thing is to see what actually happens when you invoke dovecot-lda as vmail. Remember to check the logs as well as the mailboxes. Ben From anmeyer at anup.de Sat Dec 15 17:56:28 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 16:56:28 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215152454.GC16098@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> Message-ID: <20121215165628.67dde2c1@itxnew.bitcorner.intern> Ben Morrow wrote: > > # su - vmail > > vmail at delta:~> doveconf -m lda base_dir auth_socket_path > > base_dir = /usr/var/run/dovecot > > auth_socket_path = auth-userdb > > > > But I don't know how to tell dovecot-lda to listen on sockets > > in /usr/var/run/dovecot > > Do you mean 'connect to'? It's important to be clear. hm, what does dovecot-lda do? I think it tries to connect to /usr/var/run/dovecot/auth-userdb ? > The first thing is to see what actually happens when you invoke > dovecot-lda as vmail. Remember to check the logs as well as the > mailboxes. vmail at delta:~> echo "foo" | /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de The email with body foo in it is delivered to the mailbox. Dec 15 16:37:27 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Sending an email from the desktop results in the same error: # mailq -Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient------- CB9771B3025F 559 Sat Dec 15 16:39:48 anmeyer at anup.de (unknown user: "anmeyer at anup.de") anmeyer at anup.de I looked at the makefiles in the sources of the installed version of dovecot and found that dovecot-lda is like everything compiled with localstatedir = ${prefix}/var rundir = ${prefix}/var/run/dovecot statedir = ${prefix}/var/lib/dovecot where prefix = /usr I don't know why dovecot-lda is not connecting? to /usr/var/run/dovecot/auth-userdb and instead uses /var/run/dovecot. I delete /var/run/dovecot meanwhile. > > Ben > Andreas From daniel.parthey at informatik.tu-chemnitz.de Sat Dec 15 18:09:53 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 15 Dec 2012 17:09:53 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215155839.0793842e@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> Message-ID: <20121215160953.GA15874@daniel.localdomain> Andreas Meyer wrote: > I managed to su to vmail by giving it a shell. > # su - vmail For security reasons, you should rather not give a login shell to non-interactive users. You can temporarily pass a shell to su: su -s /bin/sh - vmail Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Dec 15 18:21:05 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 15 Dec 2012 17:21:05 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215165628.67dde2c1@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> Message-ID: <20121215162104.GA16160@daniel.localdomain> Andreas Meyer wrote: > Ben Morrow wrote: > > > > # su - vmail > > > vmail at delta:~> doveconf -m lda base_dir auth_socket_path > > > base_dir = /usr/var/run/dovecot > > > auth_socket_path = auth-userdb > > > > > > But I don't know how to tell dovecot-lda to listen on sockets > > > in /usr/var/run/dovecot > > > > Do you mean 'connect to'? It's important to be clear. > > hm, what does dovecot-lda do? I think it tries to connect to > /usr/var/run/dovecot/auth-userdb ? Try to trace the open syscalls of dovecot-lda and its children: strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de This should give you an idea about which files dovecot-lda really tries to open. Regards Daniel -- https://plus.google.com/103021802792276734820 From anmeyer at anup.de Sat Dec 15 18:52:06 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 17:52:06 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215162104.GA16160@daniel.localdomain> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215162104.GA16160@daniel.localdomain> Message-ID: <20121215175206.612df555@itxnew.bitcorner.intern> Hello! Daniel Parthey wrote: > Andreas Meyer wrote: > > Ben Morrow wrote: > > > > > > # su - vmail > > > > vmail at delta:~> doveconf -m lda base_dir auth_socket_path > > > > base_dir = /usr/var/run/dovecot > > > > auth_socket_path = auth-userdb > > > > > > > > But I don't know how to tell dovecot-lda to listen on sockets > > > > in /usr/var/run/dovecot > > > > > > Do you mean 'connect to'? It's important to be clear. > > > > hm, what does dovecot-lda do? I think it tries to connect to > > /usr/var/run/dovecot/auth-userdb ? > > Try to trace the open syscalls of dovecot-lda and its children: > > strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de > # strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de open("/usr/lib/dovecot/tls/i686/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/i686/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/i686/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/i686/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-lda.so.0", O_RDONLY) = 3 open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 open("/lib/libc.so.6", O_RDONLY) = 3 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) open("/lib/librt.so.1", O_RDONLY) = 3 open("/usr/lib/dovecot/libssl.so.0.9.8", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/libssl.so.0.9.8", O_RDONLY) = 3 open("/usr/lib/dovecot/libcrypto.so.0.9.8", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/libcrypto.so.0.9.8", O_RDONLY) = 3 open("/usr/lib/dovecot/libz.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) open("/lib/libz.so.1", O_RDONLY) = 3 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/lib/libdl.so.2", O_RDONLY) = 3 open("/lib/libpthread.so.0", O_RDONLY) = 3 open("/var/log/dovecot-lda-errors.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 6 open("/var/log/dovecot-lda.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 7 open("/usr/lib/dovecot", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 8 open("/usr/lib/dovecot/lib90_sieve_plugin.so", O_RDONLY) = 8 open("/usr/lib/dovecot/libdovecot-sieve.so.0", O_RDONLY) = 8 open("/var/log/dovecot-lda-errors.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 6 open("/var/log/dovecot-lda.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 7 > This should give you an idea about which files > dovecot-lda really tries to open. Can't really say there is something wrong. It seems to find everything it is looking for. > > Regards > Daniel Andreas From marcin at mejor.pl Sat Dec 15 19:14:40 2012 From: marcin at mejor.pl (=?ISO-8859-2?Q?Marcin_Miros=B3aw?=) Date: Sat, 15 Dec 2012 18:14:40 +0100 Subject: [Dovecot] When imapc can't connect to remote IMAP prevents user login (and blocks LDA) Message-ID: <50CCB000.2070808@mejor.pl> Hi! I'm using dovecot 2.1.12-r1. When remote imap server rejects connections then I can't login into account and MTA can't deliver emails to maildir also. I'm attaching snippets of logs: 2012-12-15T18:05:43.072594+01:00 meteor dovecot: imap-login: Login: user=, method=PLAIN, rip=2001:470:1f0b:1ab3:50af:bef4:6918:78ad, lip=2001:470:1f15:1b61::2, mpid=32533, TLS, session= 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) : Error: imapc(imap.wp.pl:143): Server disconnected: Connection reset by peer 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) : Error: imapc(imap.wp.pl:143): Authentication failed: Disconnected from server 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) : Error: imapc: Command failed: Disconnected from server 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) : Error: user marcin at mejor.pl: Initialization failed: Namespace 'xxx-wp-pl.': imapc: LIST failed: Internal error occurred. Refer to server log for more information. [2012-12-15 18:05:43] 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) : Error: Invalid user settings. Refer to server log for more information. And snippet when LDA tries to deliver email: 2012-12-15T18:00:54.689877+01:00 meteor dovecot: lda(marcin at mejor.pl) <>: Error: imapc(imap.wp.pl:143): Server disconnected: Connection reset by peer 2012-12-15T18:00:54.689877+01:00 meteor dovecot: lda(marcin at mejor.pl) <>: Error: imapc(imap.wp.pl:143): Authentication failed: Disconnected from server 2012-12-15T18:00:54.689877+01:00 meteor dovecot: lda(marcin at mejor.pl) <>: Error: imapc: Command failed: Disconnected from server 2012-12-15T18:00:54.689877+01:00 meteor dovecot: lda(marcin at mejor.pl) <>: Error: user marcin at mejor.pl: Initialization failed: Namespace 'xxx-wp-pl.': imapc: LIST failed: Internal error occurred. Refer to server log for more information. [2012-12-15 18:00:54] 2012-12-15T18:00:54.689877+01:00 meteor dovecot: lda(marcin at mejor.pl) <>: Fatal: Invalid user settings. Refer to server log for more information. I'd like to ask is this behavior correct? Thanks, Marcin doveconf -n: # 2.1.12: /etc/dovecot/dovecot.conf # OS: Linux 3.6.8-hardened x86_64 Gentoo Base System release 2.1 auth_cache_size = 1 k auth_mechanisms = login digest-md5 cram-md5 plain deliver_log_format = msgid=%m: from=%f: phys=%p: virt=%w %$ dict { quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_uid = 8 last_valid_uid = 8 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_attachment_dir = /dane/domeny/zalaczniki mail_attachment_min_size = 10000 k mail_cache_min_mail_count = 20 mail_gid = mail mail_log_prefix = "%s(%u) <%{session}>: " mail_plugins = autocreate quota notify mail_log stats zlib mail_privileged_group = mail mail_uid = mail maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy incl ude variables body enotify environment mailbox date ihave mdbox_preallocate_space = yes mdbox_rotate_interval = 60 days mdbox_rotate_size = 50 M namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts quota = dict:User quota::proxy::quota quota_exceeded_message = Quota exceeded / Skrzynka odbiorcy jest przepelniona, wiadomosc nie zostala dostarczona sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 1M stats_refresh = 30 s stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours zlib_save = gz } postmaster_address = postmaster at mejor.pl protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = mail mode = 0660 user = root } } service dict { unix_listener dict { user = mail } } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = References: <50CC2C47.9000400@heinlein-support.de> Message-ID: <50CCB1BF.4090208@brightok.net> On 12/15/2012 1:52 AM, Peer Heinlein wrote: > > Making consistent backups from Dovecot with mdbox requires a snapshoted > filesystem with (at least) a short Downtime for Dovecot. > > I'd like to avoid killing several thenthousand IMAP-sessions for 60 > seconds. Users don't like that... And the admin dislakes that too... > > Are you sure it is necessary? I'm not very familiar with mdbox, but given the rundown on the wiki, it looks as though it should be very resilient to snapshots even mid-write. With fs-freeze and the nature of bulk writes, I suspect it should be fine. At worst, it might need to regain sanity off the backup indexes. Since file rewrites are done during the purge script, I'd definitely not do snapshots during the purge. The last I checked, the fs-freeze api isn't complete. It would make more sense for dovecot to work with that structure once it is completed (allowing fs-freeze to inform dovecot that the fs will be freezing/unfreezing). Jack From ben at morrow.me.uk Sat Dec 15 20:07:17 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 18:07:17 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215165628.67dde2c1@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> Message-ID: <20121215180716.GD16098@anubis.morrow.me.uk> At 4PM +0100 on 15/12/12 you (Andreas Meyer) wrote: > Ben Morrow wrote: > > > > # su - vmail > > > vmail at delta:~> doveconf -m lda base_dir auth_socket_path > > > base_dir = /usr/var/run/dovecot > > > auth_socket_path = auth-userdb > > > > > > But I don't know how to tell dovecot-lda to listen on sockets > > > in /usr/var/run/dovecot > > > > Do you mean 'connect to'? It's important to be clear. > > hm, what does dovecot-lda do? I think it tries to connect to > /usr/var/run/dovecot/auth-userdb ? Yes. It doesn't listen on any sockets at all. > > The first thing is to see what actually happens when you invoke > > dovecot-lda as vmail. Remember to check the logs as well as the > > mailboxes. > > vmail at delta:~> echo "foo" | /usr/libexec/dovecot/dovecot-lda -f > anmeyer at anup.de -d anmeyer at anup.de > > The email with body foo in it is delivered to the mailbox. > Dec 15 16:37:27 lda(anmeyer at anup.de): Info: sieve: msgid=unspecified: > stored mail into mailbox 'INBOX' > > Sending an email from the desktop results in the same error: > > # mailq > -Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient------- > CB9771B3025F 559 Sat Dec 15 16:39:48 anmeyer at anup.de > (unknown user: "anmeyer at anup.de") > anmeyer at anup.de *Right*. Now we're getting somewhere: it looks like the problem is in your Postfix configuration. Create a script something like this #!/bin/sh echo "--- FROM [$1] TO [$2]" >>/tmp/lda-log /usr/bin/id >>/tmp/lda-log /usr/bin/env >>/tmp/lda-log exec /usr/libexec/dovecot/dovecot-lda -f "$1" -d "$2" (you may need to adjust the paths to id and env; the point is to avoid relying on $PATH) and change the master.cf entry to invoke /path/to/script ${sender} ${recipient} instead of dovecot-lda. Then deliver some mail and see what, if anything, gets written to /tmp/lda-log. Ben From ben at morrow.me.uk Sat Dec 15 20:19:10 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 18:19:10 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215160953.GA15874@daniel.localdomain> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215160953.GA15874@daniel.localdomain> Message-ID: <20121215181910.GE16098@anubis.morrow.me.uk> At 5PM +0100 on 15/12/12 Daniel Parthey wrote: > Andreas Meyer wrote: > > I managed to su to vmail by giving it a shell. > > # su - vmail > > For security reasons, you should rather not give a login shell > to non-interactive users. [This is good advice.] > You can temporarily pass a shell to su: > > su -s /bin/sh - vmail That depends on your su. Mine won't do that. I believe your assumption that Andreas is on Linux, and therefore has a su that does do that, is correct, but I don't know. (I might assume that since I said earlier 'read your system's su(1)' that it doesn't; but then again I might not...) Ben From daniel.parthey at informatik.tu-chemnitz.de Sat Dec 15 20:23:58 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 15 Dec 2012 19:23:58 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215175206.612df555@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215162104.GA16160@daniel.localdomain> <20121215175206.612df555@itxnew.bitcorner.intern> Message-ID: <20121215182358.GA18213@daniel.localdomain> Andreas Meyer wrote: > > > hm, what does dovecot-lda do? I think it tries to connect to > > > /usr/var/run/dovecot/auth-userdb ? > > > > Try to trace the open syscalls of dovecot-lda and its children: > > > > strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de > > > > # strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de > open("/usr/lib/dovecot/tls/i686/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/tls/i686/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/tls/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/tls/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/i686/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/i686/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/dovecot/libdovecot-lda.so.0", O_RDONLY) = 3 > open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 > open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 > open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/etc/ld.so.cache", O_RDONLY) = 3 > open("/lib/libc.so.6", O_RDONLY) = 3 > open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/lib/librt.so.1", O_RDONLY) = 3 > open("/usr/lib/dovecot/libssl.so.0.9.8", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/libssl.so.0.9.8", O_RDONLY) = 3 > open("/usr/lib/dovecot/libcrypto.so.0.9.8", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/usr/lib/libcrypto.so.0.9.8", O_RDONLY) = 3 > open("/usr/lib/dovecot/libz.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/lib/libz.so.1", O_RDONLY) = 3 > open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) > open("/lib/libdl.so.2", O_RDONLY) = 3 > open("/lib/libpthread.so.0", O_RDONLY) = 3 > open("/var/log/dovecot-lda-errors.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 6 > open("/var/log/dovecot-lda.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 7 > open("/usr/lib/dovecot", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 8 > open("/usr/lib/dovecot/lib90_sieve_plugin.so", O_RDONLY) = 8 > open("/usr/lib/dovecot/libdovecot-sieve.so.0", O_RDONLY) = 8 > open("/var/log/dovecot-lda-errors.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 6 > open("/var/log/dovecot-lda.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 7 Of course you will need to deliver a mail via stdin. Otherwise dovecot-lda will stall and wait for input, it doesn't even try to connect to auth-userdb. This might work: echo "foo" | strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Dec 15 20:25:01 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 15 Dec 2012 19:25:01 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215175206.612df555@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215162104.GA16160@daniel.localdomain> <20121215175206.612df555@itxnew.bitcorner.intern> Message-ID: <20121215182501.GB18213@daniel.localdomain> Andreas Meyer wrote: > > > hm, what does dovecot-lda do? I think it tries to connect to > > > /usr/var/run/dovecot/auth-userdb ? > > > > Try to trace the open syscalls of dovecot-lda and its children: > > > > strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de > > > This should give you an idea about which files > > dovecot-lda really tries to open. > > Can't really say there is something wrong. It seems to find everything > it is looking for. You can also replace the -eopen with -efile to trace all file syscalls. echo "foo" | strace -f -efile /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de -- https://plus.google.com/103021802792276734820 From anmeyer at anup.de Sat Dec 15 20:25:52 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 19:25:52 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215181910.GE16098@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215160953.GA15874@daniel.localdomain> <20121215181910.GE16098@anubis.morrow.me.uk> Message-ID: <20121215192552.0732d1ed@itxnew.bitcorner.intern> Ben Morrow wrote: > At 5PM +0100 on 15/12/12 Daniel Parthey wrote: > > Andreas Meyer wrote: > > > I managed to su to vmail by giving it a shell. > > > # su - vmail > > > > For security reasons, you should rather not give a login shell > > to non-interactive users. > > [This is good advice.] > > > You can temporarily pass a shell to su: > > > > su -s /bin/sh - vmail > > That depends on your su. Mine won't do that. I believe your assumption > that Andreas is on Linux, and therefore has a su that does do that, is > correct, but I don't know. (I might assume that since I said earlier > 'read your system's su(1)' that it doesn't; but then again I might > not...) Yes it does. man su says so too. > > Ben > From anmeyer at anup.de Sat Dec 15 20:56:35 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 19:56:35 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215182501.GB18213@daniel.localdomain> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215162104.GA16160@daniel.localdomain> <20121215175206.612df555@itxnew.bitcorner.intern> <20121215182501.GB18213@daniel.localdomain> Message-ID: <20121215195635.6e816bb4@itxnew.bitcorner.intern> Daniel Parthey wrote: > Andreas Meyer wrote: > > > > hm, what does dovecot-lda do? I think it tries to connect to > > > > /usr/var/run/dovecot/auth-userdb ? > > > > > > Try to trace the open syscalls of dovecot-lda and its children: > > > > > > strace -f -eopen /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de > > > > > This should give you an idea about which files > > > dovecot-lda really tries to open. > > > > Can't really say there is something wrong. It seems to find everything > > it is looking for. > > You can also replace the -eopen with -efile to trace all file syscalls. > > echo "foo" | strace -f -efile /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de # echo "foo" | strace -f -efile /usr/libexec/dovecot/dovecot-lda -f anmeyer at anup.de -d anmeyer at anup.de execve("/usr/libexec/dovecot/dovecot-lda", ["/usr/libexec/dovecot/dovecot-lda", "-f", "anmeyer at anup.de", "-d", "anmeyer at anup.de"], [/* 57 vars */]) = 0 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/i686/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/tls/i686/sse2", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/i686/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/tls/i686", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/tls/sse2", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/tls", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/i686/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/i686/sse2", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/i686/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/i686", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/sse2/libdovecot-lda.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat64("/usr/lib/dovecot/sse2", 0xbf901578) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-lda.so.0", O_RDONLY) = 3 open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 open("/lib/libc.so.6", O_RDONLY) = 3 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) open("/lib/librt.so.1", O_RDONLY) = 3 open("/usr/lib/dovecot/libssl.so.0.9.8", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/libssl.so.0.9.8", O_RDONLY) = 3 open("/usr/lib/dovecot/libcrypto.so.0.9.8", O_RDONLY) = -1 ENOENT (No such file or directory) open("/usr/lib/libcrypto.so.0.9.8", O_RDONLY) = 3 open("/usr/lib/dovecot/libz.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) open("/lib/libz.so.1", O_RDONLY) = 3 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/lib/libdl.so.2", O_RDONLY) = 3 open("/lib/libpthread.so.0", O_RDONLY) = 3 open("/var/log/dovecot-lda-errors.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 8 open("/var/log/dovecot-lda.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 9 open("/usr/lib/dovecot", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 10 open("/usr/lib/dovecot/lib90_sieve_plugin.so", O_RDONLY) = 10 open("/usr/lib/dovecot/libdovecot-sieve.so.0", O_RDONLY) = 10 open("/var/log/dovecot-lda-errors.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 8 open("/var/log/dovecot-lda.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0600) = 9 chdir("/var/spool/vhosts/anup.de/anmeyer") = 0 stat64("/var/spool/vhosts/anup.de/anmeyer", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 open("/etc/localtime", O_RDONLY) = 11 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2295, ...}) = 0 lstat64("/var/spool/vhosts/anup.de/anmeyer/.dovecot.sieve", {st_mode=S_IFLNK|0777, st_size=25, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/.dovecot.sieve", {st_mode=S_IFREG|0600, st_size=111, ...}) = 0 open("/var/spool/vhosts/anup.de/anmeyer/.dovecot.svbin", O_RDONLY|O_LARGEFILE) = 11 stat64("/var/spool/vhosts/anup.de/anmeyer/tmp", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 open("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.log", O_RDWR|O_LARGEFILE) = 12 open("/var/spool/vhosts/anup.de/anmeyer/dovecot.index", O_RDWR|O_LARGEFILE) = 13 open("/var/spool/vhosts/anup.de/anmeyer/tmp/1355597452.M328355P30049.delta", O_WRONLY|O_CREAT|O_EXCL|O_TRUNC|O_LARGEFILE, 0777) = 14 open("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.cache", O_RDWR|O_LARGEFILE) = 15 lstat64("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist.lock", 0xbf90145c) = -1 ENOENT (No such file or directory) open("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist.lock", O_RDWR|O_CREAT|O_EXCL|O_LARGEFILE, 0666) = 14 lstat64("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=11, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=11924, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist", {st_mode=S_IFREG|0600, st_size=544, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.log.2", {st_mode=S_IFREG|0600, st_size=32908, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=11924, ...}) = 0 access("/var/spool/vhosts/anup.de/anmeyer/cur", W_OK) = 0 rename("/var/spool/vhosts/anup.de/anmeyer/tmp/1355597452.M328355P30049.delta", "/var/spool/vhosts/anup.de/anmeyer/new/1355597452.M328355P30049.delta,S=4,W=5") = 0 open("/var/spool/vhosts/anup.de/anmeyer/new", O_RDONLY|O_LARGEFILE) = 14 open("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist", O_RDWR|O_LARGEFILE) = 14 stat64("/var/spool/vhosts/anup.de/anmeyer/cur", {st_mode=S_IFDIR|0700, st_size=16384, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=12016, ...}) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2295, ...}) = 0 stat64("/var/spool/vhosts/anup.de/anmeyer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=12076, ...}) = 0 lstat64("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=11, ...}) = 0 unlink("/var/spool/vhosts/anup.de/anmeyer/dovecot-uidlist.lock") = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2295, ...}) = 0 I can't see anyhing about auth-userdb. The mail was delivered to the maildir. Andreas From anmeyer at anup.de Sat Dec 15 21:12:58 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 20:12:58 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215180716.GD16098@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> Message-ID: <20121215201258.1f14a037@itxnew.bitcorner.intern> Ben Morrow wrote: > > Sending an email from the desktop results in the same error: > > > > # mailq > > -Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient------- > > CB9771B3025F 559 Sat Dec 15 16:39:48 anmeyer at anup.de > > (unknown user: "anmeyer at anup.de") > > anmeyer at anup.de > > *Right*. Now we're getting somewhere: it looks like the problem is in > your Postfix configuration. > > Create a script something like this > > #!/bin/sh > > echo "--- FROM [$1] TO [$2]" >>/tmp/lda-log > /usr/bin/id >>/tmp/lda-log > /usr/bin/env >>/tmp/lda-log > exec /usr/libexec/dovecot/dovecot-lda -f "$1" -d "$2" > > (you may need to adjust the paths to id and env; the point is to avoid > relying on $PATH) and change the master.cf entry to invoke > > /path/to/script ${sender} ${recipient} > > instead of dovecot-lda. Then deliver some mail and see what, if > anything, gets written to /tmp/lda-log. Done that, made the script executable, restarted postfix and sent two mails from the desktop. The stuck in the queue, no file lda-log in /tmp. dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/etc/postfix/script.sh ${sender} ${recipient} > Ben > Andreas From ben at morrow.me.uk Sat Dec 15 21:35:59 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 19:35:59 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215201258.1f14a037@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> <20121215201258.1f14a037@itxnew.bitcorner.intern> Message-ID: <20121215193559.GF16098@anubis.morrow.me.uk> At 8PM +0100 on 15/12/12 you (Andreas Meyer) wrote: > Ben Morrow wrote: > > > Create a script something like this > > > > #!/bin/sh > > > > echo "--- FROM [$1] TO [$2]" >>/tmp/lda-log > > /usr/bin/id >>/tmp/lda-log > > /usr/bin/env >>/tmp/lda-log > > exec /usr/libexec/dovecot/dovecot-lda -f "$1" -d "$2" > > > > (you may need to adjust the paths to id and env; the point is to avoid > > relying on $PATH) and change the master.cf entry to invoke > > > > /path/to/script ${sender} ${recipient} > > > > instead of dovecot-lda. Then deliver some mail and see what, if > > anything, gets written to /tmp/lda-log. > > Done that, made the script executable, restarted postfix and sent > two mails from the desktop. The stuck in the queue, no file lda-log > in /tmp. > > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail argv=/etc/postfix/script.sh ${sender} > ${recipient} OK, then I think the problem is entirely on the Postfix side: it's not even attempting to deliver the mail to Dovecot. You need to ask on a Postfix list. Ben From anmeyer at anup.de Sat Dec 15 21:54:20 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 20:54:20 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215193559.GF16098@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> <20121215201258.1f14a037@itxnew.bitcorner.intern> <20121215193559.GF16098@anubis.morrow.me.uk> Message-ID: <20121215205420.6f3966f3@itxnew.bitcorner.intern> Ben Morrow wrote: > > dovecot unix - n n - - pipe > > flags=DRhu user=vmail:vmail argv=/etc/postfix/script.sh ${sender} > > ${recipient} > > OK, then I think the problem is entirely on the Postfix side: it's not > even attempting to deliver the mail to Dovecot. You need to ask on a > Postfix list. And finally I think I found the problem. There is a transportmap in postfix integrated that says: anup.de virtual .anup.de virtual I chanched this to anup.de dovecot .anup.de dovecot and mail gets delivered. Even when I comment that map, mail is delivered because of virtual_transport = dovecot. Mail never reached the service dovecot because of that transportmap. You are so great! Thank you all for being so patient and for your help! Now I can go on. > > Ben > Andreas From ben at morrow.me.uk Sat Dec 15 22:13:19 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 20:13:19 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215205420.6f3966f3@itxnew.bitcorner.intern> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> <20121215201258.1f14a037@itxnew.bitcorner.intern> <20121215193559.GF16098@anubis.morrow.me.uk> <20121215205420.6f3966f3@itxnew.bitcorner.intern> Message-ID: <20121215201319.GA35727@anubis.morrow.me.uk> At 8PM +0100 on 15/12/12 you (Andreas Meyer) wrote: > Ben Morrow wrote: > > > > dovecot unix - n n - - pipe > > > flags=DRhu user=vmail:vmail argv=/etc/postfix/script.sh ${sender} > > > ${recipient} > > > > OK, then I think the problem is entirely on the Postfix side: it's not > > even attempting to deliver the mail to Dovecot. You need to ask on a > > Postfix list. > > And finally I think I found the problem. There is a transportmap in postfix > integrated that says: > > anup.de virtual > .anup.de virtual > > I chanched this to > > anup.de dovecot > .anup.de dovecot > > and mail gets delivered. Even when I comment that map, mail is > delivered because of virtual_transport = dovecot. Mail never reached > the service dovecot because of that transportmap. Before you go any further, please put the virtual_mailbox_maps parameter back with a map of the valid virtual addresses. Otherwise you'll become a backscatter source. Ben From anmeyer at anup.de Sat Dec 15 22:33:35 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 15 Dec 2012 21:33:35 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215201319.GA35727@anubis.morrow.me.uk> References: <20121215141849.69585aff@itxnew.bitcorner.intern> <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> <20121215201258.1f14a037@itxnew.bitcorner.intern> <20121215193559.GF16098@anubis.morrow.me.uk> <20121215205420.6f3966f3@itxnew.bitcorner.intern> <20121215201319.GA35727@anubis.morrow.me.uk> Message-ID: <20121215213335.7f597181@itxnew.bitcorner.intern> Ben Morrow wrote: > > And finally I think I found the problem. There is a transportmap in postfix > > integrated that says: > > > > anup.de virtual > > .anup.de virtual > > > > I chanched this to > > > > anup.de dovecot > > .anup.de dovecot > > > > and mail gets delivered. Even when I comment that map, mail is > > delivered because of virtual_transport = dovecot. Mail never reached > > the service dovecot because of that transportmap. > > Before you go any further, please put the virtual_mailbox_maps parameter > back with a map of the valid virtual addresses. Otherwise you'll become > a backscatter source. Do you mean the old virtual_mailbox_maps = hash:/etc/postfix/vmailbox ? But wouldn't that mean I have to care for two user files? vmailbox and the passwd-file of dovecot? > Ben > Andreas From ben at morrow.me.uk Sun Dec 16 00:55:36 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Sat, 15 Dec 2012 22:55:36 +0000 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215213335.7f597181@itxnew.bitcorner.intern> References: <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> <20121215201258.1f14a037@itxnew.bitcorner.intern> <20121215193559.GF16098@anubis.morrow.me.uk> <20121215205420.6f3966f3@itxnew.bitcorner.intern> <20121215201319.GA35727@anubis.morrow.me.uk> <20121215213335.7f597181@itxnew.bitcorner.intern> Message-ID: <20121215225536.GB35727@anubis.morrow.me.uk> At 9PM +0100 on 15/12/12 Andreas Meyer wrote: > Ben Morrow wrote: > > > Before you go any further, please put the virtual_mailbox_maps parameter > > back with a map of the valid virtual addresses. Otherwise you'll become > > a backscatter source. > > Do you mean the old virtual_mailbox_maps = hash:/etc/postfix/vmailbox ? > But wouldn't that mean I have to care for two user files? vmailbox and > the passwd-file of dovecot? It doesn't matter how you do it, but you need to reject invalid users during the SMTP transaction rather than allowing the mail to bounce later. (This is really basic stuff: have you read through the Postfix documentation? It make this pretty clear.) If you're using a passwd-file userdb in Dovecot, you need to write a script to convert it to a Postfix map, and make sure that script gets run whenever the source file is updated. (Makefiles are good for that sort of thing.) Alternatively, you could switch to keeping your userdb in an SQL or LDAP database, and have Postfix query it directly. If all else fails, you can arrange to pass the output of 'doveadm user "*"' to postmap, though depending on your Dovecot setup you may need to append a domain. Ben From anmeyer at anup.de Sun Dec 16 01:11:45 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 16 Dec 2012 00:11:45 +0100 Subject: [Dovecot] need help with dovecot-lda In-Reply-To: <20121215225536.GB35727@anubis.morrow.me.uk> References: <20121215135619.GB16098@anubis.morrow.me.uk> <20121215155839.0793842e@itxnew.bitcorner.intern> <20121215152454.GC16098@anubis.morrow.me.uk> <20121215165628.67dde2c1@itxnew.bitcorner.intern> <20121215180716.GD16098@anubis.morrow.me.uk> <20121215201258.1f14a037@itxnew.bitcorner.intern> <20121215193559.GF16098@anubis.morrow.me.uk> <20121215205420.6f3966f3@itxnew.bitcorner.intern> <20121215201319.GA35727@anubis.morrow.me.uk> <20121215213335.7f597181@itxnew.bitcorner.intern> <20121215225536.GB35727@anubis.morrow.me.uk> Message-ID: <20121216001145.7fc46f32@itxnew.bitcorner.intern> Ben Morrow wrote: > At 9PM +0100 on 15/12/12 Andreas Meyer wrote: > > Ben Morrow wrote: > > > > > Before you go any further, please put the virtual_mailbox_maps parameter > > > back with a map of the valid virtual addresses. Otherwise you'll become > > > a backscatter source. > > > > Do you mean the old virtual_mailbox_maps = hash:/etc/postfix/vmailbox ? > > But wouldn't that mean I have to care for two user files? vmailbox and > > the passwd-file of dovecot? > > It doesn't matter how you do it, but you need to reject invalid users > during the SMTP transaction rather than allowing the mail to bounce > later. (This is really basic stuff: have you read through the Postfix > documentation? It make this pretty clear.) Yes, this is clear to me and I also read through the dovecot-wiki a bit and especially LDA and LDA-Posfix. ;) > If you're using a passwd-file userdb in Dovecot, you need to write a > script to convert it to a Postfix map, and make sure that script gets > run whenever the source file is updated. (Makefiles are good for that > sort of thing.) Alternatively, you could switch to keeping your userdb > in an SQL or LDAP database, and have Postfix query it directly. If all > else fails, you can arrange to pass the output of 'doveadm user "*"' to > postmap, though depending on your Dovecot setup you may need to append a > domain. Thank you for your hints, Ben! I am glad I have that thing up and running at least. And I already converted the old vmailbox file that postfix used to a new one with the valid users so postfix knows them too. Thinking about SQL or LDAP database is one of the next steps I am considering. We don't have that much users and taking care of them is not that much work. Next thing is I want to implement Quota. We are running users with maildir and mboxes. And of course I want to realize sieve filtering soon or later. I am glad I got this right now with your help. And learned much again. > > Ben > Andreas From tlx at leuxner.net Sun Dec 16 11:17:59 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Sun, 16 Dec 2012 10:17:59 +0100 Subject: [Dovecot] mail_log_events seem to be broken in HG 2.2 Message-ID: <3C6BA996-4B27-40D5-9B8F-F363B8A97927@leuxner.net> It seems along the way of 2.2alpha1 'mail_log_events' quietly stopped working. They don't log expunges etc. anymore. [?] mail_log_events = expunge mailbox_delete Tested with latest HG. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4364 bytes Desc: not available URL: From cross+dovecot at distal.com Mon Dec 17 05:52:14 2012 From: cross+dovecot at distal.com (Chris Ross) Date: Sun, 16 Dec 2012 22:52:14 -0500 Subject: [Dovecot] Non-dovecot user looking for feedback Message-ID: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> I've been using UW-IMAPd for neigh on forever (at least since 2001). But, as it's basically stalled, and I'm about to update the hardware that is my mail server, I thought it was time to review existing open-source IMAP servers. Dovecot is the top three in my looking. The other of the top three candidates, because I know of people who've used it, is Cyrus IMAP. So, I should note that my thoughts are "uw-imapd, because I already know how to use it", "Cyrus, because someone I know/trust liked it years ago", and dovecot, because "it seems stable, professional, and to meet all of my needs". I guess the biggest question I have is how files/folders are stored in the filesystem. uw-imapd has a "mbx" format that all of my folders are in, and also has support for mbox and maildir (i think). mbx had some advantages for speed access, which would be unimportant I assume with dovecot's indexes, but IIRC there was also some reason the mbox format coped poorly with multiple clients accessing the same folder at the same time. So, am I right that dovecot supports only the "one big full file" mbox format, and the maildir format? And if so, is it known to allow multiple simultaneous IMAP clients to access and monitor and/or modify the same folder simultaneously? After those questions, it's just a "what do you think the pros and cons of each are?" I know asking in this forum, that I will get most if not all votes for Dovecot. And that's fine, as long as you have specific reasons why it would be better for someone with only a handful of users and minimal time available to administer the systems in question. Thanks! I appreciate any and all feedback. - Chris From protter at wp.pl Sat Dec 15 22:16:35 2012 From: protter at wp.pl (goffer) Date: Sat, 15 Dec 2012 12:16:35 -0800 (PST) Subject: [Dovecot] more than one password_query Message-ID: <1355602595043-39282.post@n4.nabble.com> Hello, I use dovecot + postfix with postfix sasl authentication by dovecot auth service. I have one question. Is it possible to have separate password_query only for auth service. I have two fields in database, one permits login to imap pop, second I want to use to permit login to smtp. Please explain how to set this (if it is possible) or give me some direction and sorry my English. -- View this message in context: http://dovecot.2317879.n4.nabble.com/more-than-one-password-query-tp39282.html Sent from the Dovecot mailing list archive at Nabble.com. From protter at wp.pl Sun Dec 16 01:17:23 2012 From: protter at wp.pl (goffer) Date: Sat, 15 Dec 2012 15:17:23 -0800 (PST) Subject: [Dovecot] more than one password_query In-Reply-To: <1355602595043-39282.post@n4.nabble.com> References: <1355602595043-39282.post@n4.nabble.com> Message-ID: <1355613443454-39286.post@n4.nabble.com> I found solution with one password_query password_query = SELECT password FROM mail_users WHERE email = '%u' AND (('%Ls' = 'smtp' AND postfix = 'Y') OR ('%Ls' = 'pop3' AND access = 'Y') OR ('%Ls' = 'imap' AND access = 'Y')) Others interesting dovecot variables: http://wiki2.dovecot.org/Variables -- View this message in context: http://dovecot.2317879.n4.nabble.com/more-than-one-password-query-tp39282p39286.html Sent from the Dovecot mailing list archive at Nabble.com. From rs at sys4.de Mon Dec 17 09:28:01 2012 From: rs at sys4.de (Robert Schetterer) Date: Mon, 17 Dec 2012 08:28:01 +0100 Subject: [Dovecot] Non-dovecot user looking for feedback In-Reply-To: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> References: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> Message-ID: <50CEC981.5020106@sys4.de> Am 17.12.2012 04:52, schrieb Chris Ross: > > I've been using UW-IMAPd for neigh on forever (at least since 2001). But, as it's basically stalled, and I'm about to update the hardware that is my mail server, I thought it was time to review existing open-source IMAP servers. Dovecot is the top three in my looking. > > The other of the top three candidates, because I know of people who've used it, is Cyrus IMAP. So, I should note that my thoughts are "uw-imapd, because I already know how to use it", "Cyrus, because someone I know/trust liked it years ago", and dovecot, because "it seems stable, professional, and to meet all of my needs". > > I guess the biggest question I have is how files/folders are stored in the filesystem. uw-imapd has a "mbx" format that all of my folders are in, and also has support for mbox and maildir (i think). mbx had some advantages for speed access, which would be unimportant I assume with dovecot's indexes, but IIRC there was also some reason the mbox format coped poorly with multiple clients accessing the same folder at the same time. > > So, am I right that dovecot supports only the "one big full file" mbox format, and the maildir format? And if so, is it known to allow multiple simultaneous IMAP clients to access and monitor and/or modify the same folder simultaneously? > > After those questions, it's just a "what do you think the pros and cons of each are?" I know asking in this forum, that I will get most if not all votes for Dovecot. And that's fine, as long as you have specific reasons why it would be better for someone with only a handful of users and minimal time available to administer the systems in question. > > Thanks! I appreciate any and all feedback. > > - Chris > Hi Chris, dove has some own high speed mailbox formats ( dbox, mdbox ) but it can handle maildir and mbox too, its up to you what you like to use, anyway as i had used cyrus and other imap servers in the past, my meaning ,dove is the best what you can choose today. Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From amateo at um.es Mon Dec 17 09:31:04 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 17 Dec 2012 08:31:04 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CC2A64.30309@heinlein-support.de> References: <50CC2A64.30309@heinlein-support.de> Message-ID: <50CECA38.3070403@um.es> El 15/12/12 08:44, Peer Heinlein escribi?: > > The mdbox-format with the altstorage-feature is quite nice and important. > > But we're having much more then >> 30 TB of maildata and doing an fsck > on huge partitions takes too much (down-) time for our mailsystem. > Wouldn't be easier just to split your users between different filesystems? I mean having different altstorages, but not as you propose but one for the half of your users and other for the other half. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337 From jtam.home at gmail.com Mon Dec 17 11:38:45 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 17 Dec 2012 01:38:45 -0800 (PST) Subject: [Dovecot] Non-dovecot user looking for feedback In-Reply-To: References: Message-ID: On Mon, 17 Dec 2012, Chris Ross wrote: > I've been using UW-IMAPd for neigh on forever (at least since 2001). > But, as it's basically stalled, and I'm about to update the hardware > that is my mail server, I thought it was time to review existing > open-source IMAP servers. Dovecot is the top three in my looking. I converted a few years ago and never looked back. > So, am I right that dovecot supports only the "one big full file" mbox > format, and the maildir format? And if so, is it known to allow > multiple simultaneous IMAP clients to access and monitor and/or modify > the same folder simultaneously? I still run using mbox, and have not had a problem with corruption, however, this is probably owing to our modest IMAP demand and careful coordination of file locks among all the different MUAs. You're better off with Maildir and other formats, that are better designed for simultaneous access. There are other good reasons to switch formats. Dovecot also supports its own mdbox/sdbox for high performance: its a hybrid that tries to incorporate the best of both words. More info http://wiki2.dovecot.org/MailboxFormat > After those questions, it's just a "what do you think the pros and cons > of each are?" I can't speak to the other software you are looking at, but two factors I found to be particularly good: - flexibility: you can get almost every oddball setup to work. Migration from uw-imapd is fairly easy, but then again, uw-imapd didn't have a lot of knobs to turn. Plugins are available that extends its functionality. - support: this mailing list is great, and Timo is an absolute wizard in getting bugs fixed. (Note: I am shamelessly buttering him up so that he fixes the outstanding bug I reported!) Joseph Tam From dave at morsberger.com Mon Dec 17 14:48:46 2012 From: dave at morsberger.com (David Morsberger) Date: Mon, 17 Dec 2012 07:48:46 -0500 Subject: [Dovecot] Non-dovecot user looking for feedback In-Reply-To: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> References: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> Message-ID: <3084200369644457166@unknownmsgid> Check out: http://imapwiki.org/ImapTest/ServerStatus -- David Morsberger 301-758-7387 Sent from my iPhone On Dec 17, 2012, at 2:00 AM, Chris Ross wrote: I've been using UW-IMAPd for neigh on forever (at least since 2001). But, as it's basically stalled, and I'm about to update the hardware that is my mail server, I thought it was time to review existing open-source IMAP servers. Dovecot is the top three in my looking. The other of the top three candidates, because I know of people who've used it, is Cyrus IMAP. So, I should note that my thoughts are "uw-imapd, because I already know how to use it", "Cyrus, because someone I know/trust liked it years ago", and dovecot, because "it seems stable, professional, and to meet all of my needs". I guess the biggest question I have is how files/folders are stored in the filesystem. uw-imapd has a "mbx" format that all of my folders are in, and also has support for mbox and maildir (i think). mbx had some advantages for speed access, which would be unimportant I assume with dovecot's indexes, but IIRC there was also some reason the mbox format coped poorly with multiple clients accessing the same folder at the same time. So, am I right that dovecot supports only the "one big full file" mbox format, and the maildir format? And if so, is it known to allow multiple simultaneous IMAP clients to access and monitor and/or modify the same folder simultaneously? After those questions, it's just a "what do you think the pros and cons of each are?" I know asking in this forum, that I will get most if not all votes for Dovecot. And that's fine, as long as you have specific reasons why it would be better for someone with only a handful of users and minimal time available to administer the systems in question. Thanks! I appreciate any and all feedback. - Chris From joshua.trier at hostrocket.com Mon Dec 17 19:11:41 2012 From: joshua.trier at hostrocket.com (joshua.trier at hostrocket.com) Date: Mon, 17 Dec 2012 12:11:41 -0500 Subject: [Dovecot] Possible bug not sure on which end Message-ID: <50CF524D.6090004@hostrocket.com> Hello Serveral of our clients are running into a problem relating to Gmails change in their "Check mail from other accounts (using POP3):". It seems related to the response dovecot sends back on a connection. Gmail is checking for a +OK in the header, however dovecot is sending OK without a prefix of +. Here is the response from Gmail webmail "Missing +OK response upon connecting to the server: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready." Here is dovecot header on a pop3-ssl connection * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. Who's end is this problem on? Google's, dovecots? Anyway to enable the response to include a +? Thanks Josh From cyril.russo at nexvision.fr Mon Dec 17 19:20:48 2012 From: cyril.russo at nexvision.fr (Cyril RUSSO) Date: Mon, 17 Dec 2012 18:20:48 +0100 Subject: [Dovecot] Adding a parameter to dovecot's deliver to get a meaningful return value Message-ID: Hi, First, please forgive me as I'm not subscribed to the list. I'm using Dovecot 2 (2.1.7) for serving my local maildir. This maildir is filled by an external process, fetching & merging mails from different sources that's outside this scope (but it's working). Dovecot is thus acting as a MTA, but more as a MDA. I've a web client running on the server, and it connects to Dovecot to get the mails. I've configured this web client & dovecot to use sieve to filter the mails. I know that since Dovecot does not actually deliver the messages, it's not the expected behavior. Anyway, I can use the "deliver" software in your suite for passing sieve's rules on each message in my maildir, and it's almost working. I've a cron job that run deliver on each message of my maildir, but I'm a bit puzzled now. Basically, I'm not able to figure out if a message was matched by a sieve filter or not. I'm a bit disappointed by two things: 1) Sieve's reject doesn't make "deliver" to return an error, so a sieve rule chain ending in "reject" can't be detected from my cron's script. I wonder it's due to the step deliver is supposed to be run (after a mail is already accepted). 2) "deliver" doesn't have a method to find out if it processed the given mail as input. Basically, would it be possible to either add a parameter to "deliver" (for example: "--fail-on-discarding") so it would fail if the sieve rules discard or reject (/ereject) the mail ? That way, I could detect the failure in my script, and know that I don't need to delete the initial mail since it was not filtered. Or, thought differently, I wonder if "deliver" could open a socket/pipe/file whatever, and write the number of processed mails in there (or using a "--return-processed-mail"), so a sieve rule ending with "delete", would be detectable by my script. Best regards, -- Cyril -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4367 bytes Desc: not available URL: From kjonca at o2.pl Mon Dec 17 19:30:41 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Mon, 17 Dec 2012 18:30:41 +0100 Subject: [Dovecot] Possible bug not sure on which end References: <50CF524D.6090004@hostrocket.com> Message-ID: <87licwd1ry.fsf@alfa.kjonca> "joshua.trier at hostrocket.com" writes: > Hello > > Serveral of our clients are running into a problem relating to > Gmails change in their "Check mail from other accounts (using > POP3):". It seems related to the response dovecot sends back on a > connection. Here you said, that you check mail with pop3 > > Gmail is checking for a +OK in the header, however dovecot is sending > OK without a prefix of +. > > Here is the response from Gmail webmail > "Missing +OK response upon connecting to the server: * OK > [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > AUTH=PLAIN] Dovecot ready." > > Here is dovecot header on a pop3-ssl connection > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID > ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. And here is imap response. Are you sure you connect to pop3? KJ -- http://blogdebart.pl/2012/06/24/hiena/ This universe shipped by weight, not by volume. Some expansion of the contents may have occurred during shipment. From delrio at mie.utoronto.ca Mon Dec 17 19:40:50 2012 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Mon, 17 Dec 2012 12:40:50 -0500 Subject: [Dovecot] Possible bug not sure on which end In-Reply-To: <50CF524D.6090004@hostrocket.com> References: <50CF524D.6090004@hostrocket.com> Message-ID: <50CF5922.4080909@mie.utoronto.ca> On 12/17/12 12:11 PM, joshua.trier at hostrocket.com wrote: > Here is the response from Gmail webmail > "Missing +OK response upon connecting to the server: * OK > [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > AUTH=PLAIN] Dovecot ready." > > Here is dovecot header on a pop3-ssl connection > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID > ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. That is an IMAP connection, not a POP3 connection. POP3 responds with: +OK Server ready. From philip at coackley.com Sun Dec 16 22:47:36 2012 From: philip at coackley.com (Philip Coackley) Date: Sun, 16 Dec 2012 20:47:36 +0000 Subject: [Dovecot] Dovecot version 1.2.17 Message-ID: <50CE3368.1000909@coackley.com> Hello, I am currently performing retrospective upgrades to an old ubuntu 9.10 Karmic Kola server. I need to upgrade dovecot 1.1.11 to 1.2.17 then to 2.0 etc. I have downloaded the binaries and run ./configure make make install. Dovecot compiles OK however I can not get the ./configure options to install at the following locations: executable: /usr/sbin/ config: /etc/dovecot/ Question: What are the ./configure options to do this? What are the ./configure options used to create the executable for unbuntu? (especially 9.10 if different). Reason for upgrade is auth-login errors every 2-3 weeks with 1.1.11 - looking at the release descriptions, this should fix this and the memory leaks! Phil Coackley From ben at morrow.me.uk Tue Dec 18 01:17:40 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Mon, 17 Dec 2012 23:17:40 +0000 Subject: [Dovecot] Dovecot version 1.2.17 In-Reply-To: <50CE3368.1000909@coackley.com> References: <50CE3368.1000909@coackley.com> Message-ID: <20121217231739.GA3006@anubis.morrow.me.uk> At 8PM +0000 on 16/12/12 you (Philip Coackley) wrote: > > I am currently performing retrospective upgrades to an old ubuntu 9.10 > Karmic Kola server. > > I need to upgrade dovecot 1.1.11 to 1.2.17 then to 2.0 etc. > > I have downloaded the binaries and run ./configure make make install. > > Dovecot compiles OK however I can not get the ./configure options to > install at the following locations: > > executable: /usr/sbin/ > config: /etc/dovecot/ > > Question: > What are the ./configure options to do this? > > What are the ./configure options used to create the executable for > unbuntu? (especially 9.10 if different). See (this is a long URL, so take out the linebreak) http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/karmic/dovecot/ karmic/view/head:/debian/rules Ben From cross+dovecot at distal.com Tue Dec 18 08:19:05 2012 From: cross+dovecot at distal.com (Chris Ross) Date: Tue, 18 Dec 2012 01:19:05 -0500 Subject: [Dovecot] Non-dovecot user looking for feedback In-Reply-To: <3084200369644457166@unknownmsgid> References: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> <3084200369644457166@unknownmsgid> Message-ID: Thank you for that. That mostly rules out Cyrus, as it seems much the lesser of Dovecot and UW-IMAP. But, it mostly just declares it's statements about accordance with the standards. While I appreciate that, I'm more interested in how it behaves with common mail clients. And, the note about dovecot Expunge Fetch says "depends on storage", but gives no more information. What sorts of storage options are available, and what the pros and cons of them are, was one of my original questions. Is there some "give me all the details to read through" document somewhere? What it does, it's capabilities, and how it does things? Thanks again to all for any help. - Chris On Dec 17, 2012, at 07:48 , David Morsberger wrote: > Check out: > > http://imapwiki.org/ImapTest/ServerStatus > > -- > David Morsberger > 301-758-7387 > Sent from my iPhone > > On Dec 17, 2012, at 2:00 AM, Chris Ross wrote: > >> >> I've been using UW-IMAPd for neigh on forever (at least since 2001). But, as it's basically stalled, and I'm about to update the hardware that is my mail server, I thought it was time to review existing open-source IMAP servers. Dovecot is the top three in my looking. >> >> The other of the top three candidates, because I know of people who've used it, is Cyrus IMAP. So, I should note that my thoughts are "uw-imapd, because I already know how to use it", "Cyrus, because someone I know/trust liked it years ago", and dovecot, because "it seems stable, professional, and to meet all of my needs". >> >> I guess the biggest question I have is how files/folders are stored in the filesystem. uw-imapd has a "mbx" format that all of my folders are in, and also has support for mbox and maildir (i think). mbx had some advantages for speed access, which would be unimportant I assume with dovecot's indexes, but IIRC there was also some reason the mbox format coped poorly with multiple clients accessing the same folder at the same time. >> >> So, am I right that dovecot supports only the "one big full file" mbox format, and the maildir format? And if so, is it known to allow multiple simultaneous IMAP clients to access and monitor and/or modify the same folder simultaneously? >> >> After those questions, it's just a "what do you think the pros and cons of each are?" I know asking in this forum, that I will get most if not all votes for Dovecot. And that's fine, as long as you have specific reasons why it would be better for someone with only a handful of users and minimal time available to administer the systems in question. >> >> Thanks! I appreciate any and all feedback. >> >> - Chris >> From skdovecot at smail.inf.fh-brs.de Tue Dec 18 11:28:06 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 18 Dec 2012 10:28:06 +0100 (CET) Subject: [Dovecot] Non-dovecot user looking for feedback In-Reply-To: References: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> <3084200369644457166@unknownmsgid> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 18 Dec 2012, Chris Ross wrote: I did used UW-imap until it gave lots of problems, because of mbox-Format located in user's home folders. It also seemed to become problematic in point of performance, because some users keep any message. Then I migrated to Courier. Maildir solved one and another problem. Then I migrated to Dovecot, which I had no larger trouble with, once setup and running. Sieve works well and other plugins very useful, too! > Is there some "give me all the details to read through" document > somewhere? What it does, it's capabilities, and how it does things? http://wiki2.dovecot.org/ http://wiki2.dovecot.org/DovecotFeatures http://wiki2.dovecot.org/MailboxFormat http://wiki2.dovecot.org/Pigeonhole/Sieve - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUNA3JmoxLS8a3A9mAQLOkwgAoLctclnBCwAohYxbgsEdf/DGGsM9t5Kl Qo4U3Y9+vjnblvFyvYtOc7bxzhx8MKzTZfBOXWs7m8eJgwPkg1WK9HJhtv32uZ8G +t6/2hZARR8hzqzIYu2+S2/Df7oVpR5cwoxzrIZ1ctoF0GrWKZDkeez5Z+z6bFSt kXm2rHYcGwJSi0VDO3ZInSmty97/bvi7dg1AXcyZ5MEIBCwmXFV/6XNV0XlS2DMa 3SAGbCZQiIBvmvvbn9q7HNMQmMtZeonaHJ7e12XBkOU3FrTAdLBbHkB3CfAg8TiN hTdrX97+6EELLoiEMUMAbysbeEr1xemXmHXk9EJD/DedbMLoWeYHsw== =a0jl -----END PGP SIGNATURE----- From marcio.merlone at a1.ind.br Tue Dec 18 14:14:36 2012 From: marcio.merlone at a1.ind.br (Marcio Merlone) Date: Tue, 18 Dec 2012 10:14:36 -0200 Subject: [Dovecot] Advice on sieve vacation for aliases Message-ID: <50D05E2C.2050405@a1.ind.br> Greetings, I have a working mail server with sieve 1:1.2.9-1ubuntu6.5 working just fine. My commercial dept. has asked me to set a vacation message for comercial at domain.tld, but this is an alias to jhon at domain.tld and meggie at domain.tld. I have created a sieve_global_path = /etc/dovecot/global.sieve and it works, but not the intended way: it sends two vacation messages, each From: each employee, and not From: comercial at domain.tld alias. Is there how to make dovecot send only one vacation message From: comercial at domain.tld or will I have to survive with one message from jhon and another from meggie? Also, is there how to have a dovecot.lda-dupes for the alias instead the users? /etc/dovecot/global.sieve: require ["vacation"]; # rule:[Ferias coletivas] if anyof (header :contains "To" "comercial at domain.tld") { vacation :days 7 :subject "F?rias coletivas de 20/12/2012 a 07/01/2013" text: bla bla bla. ; stop; } Thanks in advance and nice holidays. -- Marcio Merlone From listas at adminlinux.com.br Tue Dec 18 18:48:42 2012 From: listas at adminlinux.com.br (3.listas@adminlinux.com.br) Date: Tue, 18 Dec 2012 14:48:42 -0200 Subject: [Dovecot] Too many imap connections in state "idling" In-Reply-To: References: <50C88C2C.5040703@adminlinux.com.br> <50CA11D3.5040406@adminlinux.com.br> Message-ID: <50D09E6A.4050501@adminlinux.com.br> Thanks Steffen Kaiser ! I think not. The server is currently always 60% of imap processes in state "idling". IDLE processes are like this: root at server:/root# ps aux |grep imap dovemail 617 0.0 0.0 23136 2260 ? S Dec15 0:01 dovecot/imap [Username1 IP1 IDLE] dovemail 677 0.0 0.0 23104 2172 ? S Dec15 0:01 dovecot/imap [Username2 IP2 IDLE] ... My "idling" processes are seen as follows: root at server:~# ps aux |grep imap |grep idling dovemail 1141 0.0 0.0 16836 2148 ? D Dec15 0:01 dovecot/imap [idling] dovemail 3375 0.0 0.0 16828 2120 ? D 15:48 0:00 dovecot/imap [idling] dovemail 4833 0.0 0.0 16828 2212 ? D 15:49 0:00 dovecot/imap [idling] ... Thanks! -- Thiago Henrique www.adminlinux.com.br On 14-12-2012 06:40, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 13 Dec 2012, 3.listas at adminlinux.com.br wrote: > >> Is it normal this large amount of connections in state 'idling' ? > > If they actually using the "IDLE" command to wait for PUSH mails on > much more folders than on the other server? > > Regards, > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUMrmFmoxLS8a3A9mAQKmjgf/RbVzZet2+PUDQpMkrquB8zURR+WaBpxa > OCnNahjCV3kkuyLSciU8cq54vQhfPEXoyeqoQric/QmMOIZwhaVclLGpnSGa6lGR > fjk6x1PgcUDpqncktTJ+aUuJYTiigQbZ1wLWUfCHNZMXx5smReUMV+IdYV/0UH2a > NCnQMX7+FfUWOfZdU6QbomgTXAEgjUD+YRo0JqQ6ja/ELWfbUrYAXwhGXAXyskJT > 0eygy3FSEBJQMaIO+o5Dco7AbaCGs19xRagZWGZV5/1j17dHqOHwLdp8MnO4wCI8 > 4IPzuTUbAY0gnCEJLcSYmQG1FzNi5SjPfMV/dypB7wcPdIx4rIzsww== > =OQSw > -----END PGP SIGNATURE----- From tss at iki.fi Tue Dec 18 20:28:46 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 20:28:46 +0200 Subject: [Dovecot] Too many imap connections in state "idling" In-Reply-To: <50D09E6A.4050501@adminlinux.com.br> References: <50C88C2C.5040703@adminlinux.com.br> <50CA11D3.5040406@adminlinux.com.br> <50D09E6A.4050501@adminlinux.com.br> Message-ID: <6702E849-C049-4A48-8C1F-50F4EB9D511A@iki.fi> On 18.12.2012, at 18.48, 3.listas at adminlinux.com.br wrote: > root at server:~# ps aux |grep imap |grep idling > dovemail 1141 0.0 0.0 16836 2148 ? D Dec15 0:01 dovecot/imap [idling] > dovemail 3375 0.0 0.0 16828 2120 ? D 15:48 0:00 dovecot/imap [idling] > dovemail 4833 0.0 0.0 16828 2212 ? D 15:49 0:00 dovecot/imap [idling] > ? "D" state means they're hanging in kernel. Can you look with gdb and strace what they're doing? gdb -p 1141 bt full strace -tt -p 1141 From tss at iki.fi Tue Dec 18 20:39:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 20:39:18 +0200 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions In-Reply-To: <50BA297E.4070104@yahoo.com> References: <50BA297E.4070104@yahoo.com> Message-ID: <1355855958.13277.11.camel@hurina> On Sat, 2012-12-01 at 10:59 -0500, tlhackque wrote: > I have a (mbox/IMAP) directory under my mail directory with these > permissions: > > drwxrws--- 4 tlhackque mail 4096 Dec 1 10:34 Vendors/ > > It contains a subdirectory: > > -rw-rw---- 1 thlackque mail 84805345 Dec 1 10:34 Vendors/AVendor > > If I try to rename the AVendor folder (client is Thunderbird 17.0), I > get this error: > > Unable to rename across conflicting directory permisssions > > If I chmod g-s Vendors, the RENAME command succeeds. Where are you renaming it to and what permissions that directory has? I can't seem to easily reproduce this. From tss at iki.fi Tue Dec 18 20:49:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 20:49:01 +0200 Subject: [Dovecot] indexer-worker Panic In-Reply-To: References: Message-ID: <1355856541.13277.12.camel@hurina> On Tue, 2012-12-04 at 13:26 -0500, Dave Abrahams wrote: > I just found this in my logs. Any idea? > > --8<---------------cut here---------------start------------->8--- > 12/4/12 12:33:43.831 PM dovecot[2660]: indexer-worker(dave): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) > 12/4/12 12:33:43.831 PM dovecot[2660]: indexer-worker(dave): Error: Raw backtrace: 2 libdovecot.0.dylib 0x000000010840e6c4 default_fatal_finish + 36 -> 3 libdovecot.0.dylib 0x000000010840f3e1 i_internal_fatal_handler + 49 -> 4 libdovecot.0.dylib 0x000000010840e98e i_panic + 158 -> 5 libdovecot-storage.0.dylib 0x0000000108340693 fs_list_get_path + 467 -> 6 indexer-worker 0x00000001082e7341 master_connection_input + 513 -> 7 libdovecot.0.dylib 0x000000010841b5 > 12/4/12 12:33:43.831 PM dovecot[2660]: indexer-worker(dave): Error: ce io_loop_call_io + 46 -> 8 libdovecot.0.dylib 0x000000010841c737 io_loop_handler_run + 215 -> 9 libdovecot.0.dylib 0x000000010841b7e8 io_loop_run + 88 -> 10 libdovecot.0.dylib 0x00000001084079c8 master_service_run + 24 -> 11 indexer-worker 0x00000001082e7001 main + 321 -> 12 libdyld.dylib 0x00007fff93d117e1 start + 0 -> 13 ??? 0x0000000000000001 0x0 + 1 Fixed: http://hg.dovecot.org/dovecot-2.1/rev/04704d1eb6c3 From tss at iki.fi Tue Dec 18 20:52:05 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 20:52:05 +0200 Subject: [Dovecot] Error: unlink_directory(.../lucene-indexes) with doveadm index In-Reply-To: <031f01cdd2d8$de4f72d0$9aee5870$@fredk.com> References: <031f01cdd2d8$de4f72d0$9aee5870$@fredk.com> Message-ID: <1355856725.13277.14.camel@hurina> On Wed, 2012-12-05 at 05:08 -0600, Fred Kilbourn wrote: > I am updating search indexes on all my mailboxes via a nightly cronjob that > runs: doveadm index -A '*' > > The problem we're running into is that random mailboxes will throw the > following error during the update (sanitized to conceal actual domain name): > > doveadm(user at domain.com): Error: > unlink_directory(/var/spool/mail/domain.com/user/sdbox/lucene-indexes) > failed: Permission denied > > We have around 250 domains on the server, with a handful of mailboxes on > average in each domain. We get this for a varying number of total mailboxes > (1 to 6 every night). It is common for the same mailbox to show up a few > days in a row and then stop throwing the error. The script is running as > root, so there shouldn't be any file level permissions. Try if this works: doveadm index -A -q '*' This way the indexing is done by indexer processes with proper permissions. Although I wonder if it floods the indexer processes too quickly with the commands if there are a lot of users.. From fred at fredk.com Tue Dec 18 21:05:29 2012 From: fred at fredk.com (Fred Kilbourn) Date: Tue, 18 Dec 2012 13:05:29 -0600 Subject: [Dovecot] Error: unlink_directory(.../lucene-indexes) with doveadm index In-Reply-To: <1355856725.13277.14.camel@hurina> References: <031f01cdd2d8$de4f72d0$9aee5870$@fredk.com> <1355856725.13277.14.camel@hurina> Message-ID: <005801cddd52$a5cb6700$f1623500$@fredk.com> > -----Original Message----- > From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] > On Behalf Of Timo Sirainen > Sent: Tuesday, December 18, 2012 12:52 PM > To: Fred Kilbourn > Cc: dovecot at dovecot.org > Subject: Re: [Dovecot] Error: unlink_directory(.../lucene-indexes) with > doveadm index > > On Wed, 2012-12-05 at 05:08 -0600, Fred Kilbourn wrote: > > I am updating search indexes on all my mailboxes via a nightly cronjob > that > > runs: doveadm index -A '*' > > > > The problem we're running into is that random mailboxes will throw the > > following error during the update (sanitized to conceal actual domain > name): > > > > doveadm(user at domain.com): Error: > > unlink_directory(/var/spool/mail/domain.com/user/sdbox/lucene-indexes) > > failed: Permission denied > > > > We have around 250 domains on the server, with a handful of mailboxes > on > > average in each domain. We get this for a varying number of total > mailboxes > > (1 to 6 every night). It is common for the same mailbox to show up a > few > > days in a row and then stop throwing the error. The script is running > as > > root, so there shouldn't be any file level permissions. > > Try if this works: doveadm index -A -q '*' > > This way the indexing is done by indexer processes with proper > permissions. Although I wonder if it floods the indexer processes too > quickly with the commands if there are a lot of users.. Okay I'll give that a try. I don't see that option anywhere in the documentation, but I do see it in the source so I'll see what happens. Thanks. From tlhackque at yahoo.com Tue Dec 18 21:13:39 2012 From: tlhackque at yahoo.com (tlhackque) Date: Tue, 18 Dec 2012 14:13:39 -0500 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions In-Reply-To: <1355855958.13277.11.camel@hurina> References: <50BA297E.4070104@yahoo.com> <1355855958.13277.11.camel@hurina> Message-ID: <50D0C063.1000501@yahoo.com> On 18-Dec-12 13:39, Timo Sirainen wrote: > On Sat, 2012-12-01 at 10:59 -0500, tlhackque wrote: >> I have a (mbox/IMAP) directory under my mail directory with these >> permissions: >> >> drwxrws--- 4 tlhackque mail 4096 Dec 1 10:34 Vendors/ >> >> It contains a subdirectory: >> >> -rw-rw---- 1 thlackque mail 84805345 Dec 1 10:34 Vendors/AVendor >> >> If I try to rename the AVendor folder (client is Thunderbird 17.0), I >> get this error: >> >> Unable to rename across conflicting directory permisssions >> >> If I chmod g-s Vendors, the RENAME command succeeds. > Where are you renaming it to and what permissions that directory has? I > can't seem to easily reproduce this. > > Thanks for looking at this! Here it is from the top with every step from creating the subfolder thru the fail to success without -s, reproduced today: On the server, in my ~mail directory: | ||ls -ld Vendors drwxrws--- 4 tlhackque mail 4096 Dec 18 13:56 Vendors/ ls -ld Vendors/Test ls: Vendors/Test: No such file or directory Right-click on Vendors in TB New Folder Test Subfolder of Vendors [Server restricts] x Messages only Create ls -ld Vendors/Test -rw-rw---- 1 tlhackque mail 0 Dec 18 13:58 Vendors/Test Right click on Test Rename Test Rename RENAME Brief pop-up with this text; retrieved from the TB Activity manager window: The current command did not succeed. The mail server for account (tlhackque) responded: [CANNOT} Renaming not supported across conflicting directory permissions. chmod g-s Vendors; ls -ld Vendors drwxrwx--- 4 tlhackque mail 4096 Dec 18 13:58 Vendors Right click on Test Rename Test Rename RENAME Succeeds | dovecot --version 2.1.10 Thunderbird 17.0 OS: cat /proc/sys/kernel/osrelease 2.6.22.14-72.fc6 SELinux is enabled, there are no errors in the log. -- This communication may not represent my employer's views, if any, on the matters discussed. From tss at iki.fi Tue Dec 18 21:16:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:16:14 +0200 Subject: [Dovecot] NFS, deleting folder issue In-Reply-To: References: Message-ID: <1355858174.13277.16.camel@hurina> On Wed, 2012-12-05 at 11:47 -0500, Catalin Petrescu wrote: > I use dovecot on a server with some Nightmare File Systerm (aka NFS) > storage. > When I delete a folder, its content gets deleted, but the folder itself > does not. .. > So, the dovecot.index.log was deleted, but it's still open, and the folder > can't be deleted because of the pesky .nfs* file. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/b53ab1c11843 From tss at iki.fi Tue Dec 18 21:23:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:23:38 +0200 Subject: [Dovecot] Documentation of Redis and Memcache Backends In-Reply-To: <50C0A1BB.4090102@enas.net> References: <50C0A1BB.4090102@enas.net> Message-ID: <1355858618.13277.19.camel@hurina> On Thu, 2012-12-06 at 14:46 +0100, Urban Loesch wrote: > Hi, > > in the release notes of 2.1.9 I read that dovecot supports memcache and redis backends for > userdb/passdb authentication. This is very interesting for me and should reduce queries and database load of > our mysql servers. > > My idea is to use memcache or redis in our IMAP/POP3 proxies in front of our backend servers. > So I would like to try out if it's possible to store proxy information of our backends. For > example the backend ip adress. > > But in the wiki I found only a few configuration settings for redis backend. > http://master.wiki2.dovecot.org/AuthDatabase/Dict That's all the Redis/memcached-specific configuration. Just make them return all the extra fields you want in the JSON values. You could for example put a passdb/userdb dict first and sql next. So requests are first tried from the dict and if that fails then from sql. > Also the mentioned example config file "dovecot-dict-auth.conf.ext" with full list of configuration options > does not exits in the source of 2.1.11. Looks like it was missing from the Makefile. Will be in next version and you can also see it from: http://hg.dovecot.org/dovecot-2.1/file/tip/doc/example-config/dovecot-dict-auth.conf.ext From tss at iki.fi Tue Dec 18 21:26:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:26:14 +0200 Subject: [Dovecot] During FTS reindexing, search commands unceremoniously exit In-Reply-To: References: Message-ID: <1355858774.13277.21.camel@hurina> On Thu, 2012-12-06 at 12:31 -0500, Dave Abrahams wrote: > Is this intentional? Closing the connection without warning doesn't > seem like the best response... > > --8<---------------cut here---------------start------------->8--- > % printf "1 select \"INBOX\"\n2 search body quack\n3 logout\n" | /opt/local/libexec/dovecot/imap > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY] Logged in as dave > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft gnus-forward gnus-expire) > * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft gnus-forward gnus-expire \*)] Flags permitted. > * 31 EXISTS > * 0 RECENT > * OK [UIDVALIDITY 1349969399] UIDs valid > * OK [UIDNEXT 1376] Predicted next UID > * OK [HIGHESTMODSEQ 2908] Highest > 1 OK [READ-WRITE] Select completed. > imap(dave): Info: Connection closed in=45 out=2027404 > % I think the problem is that SEARCH command returns to the main loop while it waits for the indexing to finish. The main loop then notices that the client has already disconnected. So that kind of piping of commands isn't very reliable. This probably works: (printf "1 select \"INBOX\"\n2 search body quack\n3 logout\n"; read) | /opt/local/libexec/dovecot/imap From tss at iki.fi Tue Dec 18 21:27:50 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:27:50 +0200 Subject: [Dovecot] namespace subscription problem In-Reply-To: <50C15FCA.9000407@h3c.de> References: <50C15FCA.9000407@h3c.de> Message-ID: <1355858870.13277.22.camel@hurina> On Fri, 2012-12-07 at 04:17 +0100, Holger Hegmanns wrote: > Hi all, > > my problem seems to be a cosmetic one (again). > > According to the docs: > > subscriptions: "yes" (default) if this namespace should handle its own > subscriptions. If "no", then the first parent namespace with > subscriptions=yes will handle it. > > Therefore is no way to create the following scenario: > > three namespaces (private, shared, public) > the private namespace has to handle its own subscriptions > the private namespace setup with "prefix = INBOX." > the both shared and public namespace setup with "subscriptions = no" > > cause there is no so called "parent" namespace. Private namespace setup > with "prefix = " works fine, but that's not what I want. First create all the namespaces you want and set subscriptions=no for all of them. Then create a new prefix="" namespace, and set it subscriptions=yes list=no hidden=yes. From h.reindl at thelounge.net Tue Dec 18 21:28:24 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 18 Dec 2012 20:28:24 +0100 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions In-Reply-To: <1355855958.13277.11.camel@hurina> References: <50BA297E.4070104@yahoo.com> <1355855958.13277.11.camel@hurina> Message-ID: <50D0C3D8.6070302@thelounge.net> Am 18.12.2012 19:39, schrieb Timo Sirainen: > On Sat, 2012-12-01 at 10:59 -0500, tlhackque wrote: >> It contains a subdirectory: >> >> -rw-rw---- 1 thlackque mail 84805345 Dec 1 10:34 Vendors/AVendor >> >> If I try to rename the AVendor folder (client is Thunderbird 17.0), I >> get this error: >> >> Unable to rename across conflicting directory permisssions this is 660 which is simply wrong for a directrory in case of diretcories you need the excue flag means 770 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Tue Dec 18 21:38:25 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:38:25 +0200 Subject: [Dovecot] Removing configured SSL certificate file from disk while Dovecot is running spams syslog In-Reply-To: <50C061CE.7090904@n-art.de> References: <50C061CE.7090904@n-art.de> Message-ID: <1355859505.13277.23.camel@hurina> On Thu, 2012-12-06 at 18:13 +0900, Nils wrote: > [root at mikan ~]# dovecot --version > 2.1.12 > > When I remove the SSL certificate from disk while Dovecot is running, it > spams syslog with the following log message over and over: > > Dec 6 17:41:41 mikan dovecot: config: Fatal: Error in configuration > file /etc/dovecot/conf.d/10-ssl.conf line 12: ssl_cert: Can't open file > /etc/ssl/private/dovecot.pem: No such file or directory .. > Reporting that the certificate went away is fine and useful, but > spamming the syslog over and over with hundreds of entries per second(!) > is annoying. :( Fixed: http://hg.dovecot.org/dovecot-2.1/rev/bc11033ef035 From tss at iki.fi Tue Dec 18 21:39:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:39:57 +0200 Subject: [Dovecot] imap dumps core when connecting with mutt In-Reply-To: <1693777.jcPe9tMOC4@lhart> References: <1693777.jcPe9tMOC4@lhart> Message-ID: <1355859597.13277.24.camel@hurina> On Sun, 2012-12-09 at 19:03 +0200, Arthur Titeica wrote: > Hello, > > I'm trying to investigate a problem with dovecot/imap dumping core when > connecting connecting mith mutt (everything else works). > > imap(user at domain): Fatal: master: service(imap): child 31752 killed with > signal 11 (core dumped) > > I managed to create a core file and passed that to gdb. The log is here [1]. > > I hope this helps - please tell me what else would be needed if not. First of all doveconf -n output would be helpful. The gdb backtrace would have been also a bit more useful with debug symbols. From tss at iki.fi Tue Dec 18 21:47:52 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:47:52 +0200 Subject: [Dovecot] doveadm-lda - segfault In-Reply-To: <876248i6aq.fsf@alfa.kjonca> References: <87obi0j3j5.fsf@alfa.kjonca> <50C7879B.7030207@localhost.localdomain.org> <87ip88i9k2.fsf@alfa.kjonca> <20121211213034.GD39964@anubis.morrow.me.uk> <87a9tki6vw.fsf@alfa.kjonca> <876248i6aq.fsf@alfa.kjonca> Message-ID: <1355860072.13277.27.camel@hurina> On Tue, 2012-12-11 at 23:15 +0100, Kamil Jo?ca wrote: > #0 0x00007f99d591fe6f in mail_storage_try_copy (mail=0x198dbb0, _ctx=0x7fff8914fc28) at mail-copy.c:56 > 56 mail-copy.c: No such file or directory. raw-storage's envelope_sender is NULL. Fixed Dovecot to make sure NULL isn't returned: http://hg.dovecot.org/dovecot-2.1/rev/579984fdb6e5 But I think Pigeonhole also shouldn't set it to NULL. sieve-message.c:sieve_message_get_sender() apparently returns NULL if it can't find anything. Elsewhere this is used when nothing else is there: #define DEFAULT_ENVELOPE_SENDER "MAILER-DAEMON" From tss at iki.fi Tue Dec 18 21:50:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:50:15 +0200 Subject: [Dovecot] Automatically Cleaning Kerberos Credential Cache Files In-Reply-To: References: Message-ID: <1355860215.13277.29.camel@hurina> On Tue, 2012-12-11 at 19:13 -0800, Joseph Tam wrote: > Ben Morrow writes: > > > In any case, it's likely that the delivery process looks in the user's > > home directory even if delivery is to a separate mail spool, unless > > you've taken steps to prevent this. > > I can confirm this. I think the reason is that dovecot changes to the > user's home directory so that it has a place to dump core. This causes > problem for my setup since I user per-user NFS mounts, so a delivery to an > internal mailing list caused hundreds of NFS automounts. > > I patched this behaviour out, but there is probably a more elegant solution > (unset MAIL_STORAGE_SERVICE_FLAG_ENABLE_CORE_DUMPS? How?). If there is a home directory, Dovecot chdirs there. Maybe you can avoid returning a home directory? Of course that causes some other trouble then. A new mail_home_chdir=no setting would of course work, but kind of annoying to have such setting.. From tss at iki.fi Tue Dec 18 21:52:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:52:34 +0200 Subject: [Dovecot] Manually creating dovecot- files after isync/mbsync mirror In-Reply-To: References: Message-ID: <1355860354.13277.30.camel@hurina> On Wed, 2012-12-12 at 11:00 +0200, Dale Gallagher wrote: > Hi everyone > > I'm using isync 1.0.5 patched to do recursive folder listing and mirroring > mail from an external party's IMAP server to a local Maildir, which will be > accessed by Dovecot 2.0.9. > > In order to prevent IMAP clients from re-downloading their mail, when > connecting to Dovecot, I'm busy writing a script to generate appropriate > dovecot-uidlist and dovecot-uidvalidity files, per Maildir. > > isync stores the uid in the filename, so that's extractable, per message, > and the uidvalidity and current max uid are stored in a file .uidvalidity, > in each Maildir. > > I've read the docs here: http://wiki2.dovecot.org/MailboxFormat/Maildir > > Regarding the dovecot-uidlist header (first line) - I've tried to search > for and figure out what exactly is meant by the "mailbox global uid" and > once I do, how to manually generate the 128 bit hex variation of it? Could > someone elaborate on this, please. > > How would omitting the global uid field, beginning with G, affect remote > clients' syncing of mail? Is this field mandatory? Not necessary. Dovecot will add it later if needed. > I also see that Dovecot's uidvalidity is of the form 4df8a4e2, whereas > isync uses an integer. I'd appreciate it if someone could elaborate on what > Dovecot uses and whether I can convert one to the other? dovecot-uidlist file isn't directly visible to IMAP client. The UIDVALIDITY is converted between hex and decimals as necessary. From tss at iki.fi Tue Dec 18 21:53:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 21:53:43 +0200 Subject: [Dovecot] SPECIAL-USE and mailbox names in various IMAP clients In-Reply-To: References: <33DF7C74-6AF2-4FB1-B25F-7298AD01CDDB@iki.fi> Message-ID: <1355860423.13277.32.camel@hurina> On Wed, 2012-12-12 at 08:28 -0800, Bradley Giesbrecht wrote: > On Dec 12, 2012, at 3:11 AM, Timo Sirainen wrote: > > > http://imapwiki.org/SpecialUse > > > > Please fill out for all clients with all languages you know of. Knowing the mailbox names can be helpful with Dovecot's mailbox_alias plugin. > > > Is there online documentation for testing an email clients support of SPECIAL-USE? Create Dovecot configuration with: mailbox testbox { special_use = \Sent auto = subscribe } Then see if the client saves a mail to "testbox" or to its old/original/default "Sent". From catalin.petrescu at gmail.com Tue Dec 18 22:06:27 2012 From: catalin.petrescu at gmail.com (Catalin Petrescu) Date: Tue, 18 Dec 2012 15:06:27 -0500 Subject: [Dovecot] NFS, deleting folder issue In-Reply-To: <1355858174.13277.16.camel@hurina> References: <1355858174.13277.16.camel@hurina> Message-ID: Awesome, Thanks! Catalin Petrescu On Tue, Dec 18, 2012 at 2:16 PM, Timo Sirainen wrote: > On Wed, 2012-12-05 at 11:47 -0500, Catalin Petrescu wrote: > > > I use dovecot on a server with some Nightmare File Systerm (aka NFS) > > storage. > > When I delete a folder, its content gets deleted, but the folder itself > > does not. > .. > > So, the dovecot.index.log was deleted, but it's still open, and the > folder > > can't be deleted because of the pesky .nfs* file. > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/b53ab1c11843 > > > From tss at iki.fi Tue Dec 18 22:10:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:10:49 +0200 Subject: [Dovecot] dovecot-lda (2.1.12) segfaults In-Reply-To: References: Message-ID: <1355861449.13277.35.camel@hurina> On Thu, 2012-12-13 at 03:56 -0800, Joseph Tam wrote: > We uograded our dovecot from version 2.1.10 -> 2.10.12, but within > the first hour of use, dovecot-lda would segfault during delivery. > This left a lock file lying around causing the user's mail readers to > hang; much hilarity ensues. All further deliveries to the same user > will result in a crash. > > The only thing that fixes this condition is to blow away the user's > INBOX cache index. Reindexing with "doveadm index" does not fix > anything. > > I've installed a test version with one user's problematic INBOX > cache indices and ran > > gdb dovecot-lda > (gdb) run -t testuser > and it crashes with the following backtrace > > Program received signal SIGSEGV, Segmentation fault. > 0xff2a0440 in mail_cache_header_fields_read (cache=0x5c120) at mail-cache-fields.c:323 > 323 if (field_hdr->size < sizeof(*field_hdr) + .. > (gdb) p field_hdr > $1 = (const struct mail_cache_header_fields *) 0x20 So mail_cache_map() returned a broken pointer.. > Is this enough debug info to work your magic, Timo? I can supply the cache data > if you neded it. It's compiled on a Solaris10. Can you still reproduce this in any way? I found two bugs, would be nice to know if they solve it: http://hg.dovecot.org/dovecot-2.1/rev/2f848393f78e http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 From tss at iki.fi Tue Dec 18 22:14:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:14:08 +0200 Subject: [Dovecot] Clear-text ldap passwords: {CLEAR} scheme? In-Reply-To: <50CB3995.20303@niif.hu> References: <50CB3995.20303@niif.hu> Message-ID: <1355861648.13277.36.camel@hurina> On Fri, 2012-12-14 at 15:37 +0100, Kristof Bajnok wrote: > Hi, > > if I read the documentation correctly, the clear-text password storage > scheme in Dovecot is called PLAIN. Unfortunately, in Sun LDAP Directory > Server I have to specify them as "{CLEAR}" [1]. > > Is it somehow possible to make Dovecot recognise "{clear}foobar" > passwords as plaintext? Now I get: > auth: Error: ldap(username): Unknown scheme clear Hmh. Okay: http://hg.dovecot.org/dovecot-2.1/rev/bde8963a3774 From tlhackque at yahoo.com Tue Dec 18 22:25:27 2012 From: tlhackque at yahoo.com (tlhackque) Date: Tue, 18 Dec 2012 15:25:27 -0500 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions In-Reply-To: <50D0D0F1.2080800@litts.net> References: <50BA297E.4070104@yahoo.com> <1355855958.13277.11.camel@hurina> <50D0C3D8.6070302@thelounge.net> <50D0D0F1.2080800@litts.net> Message-ID: <50D0D137.9070301@yahoo.com> > It's an MBox file that I'm trying to rename, not a directory. > | file Vendors/|| > ||Vendors/: setgid directory|| > || file Vendors/Test|| > ||Vendors/Test: empty|| > | > (Perhaps you missed that I said I created it "messages only", and the > config I originally posted showed the file storage is mbox...) > > So perhaps dovecot is confused - expecting an mbox file to have > directory permissions, when the directory it's in is setgid? At least > that's how it has seemed to me all along... > > Thanks. > > This communication may not represent my employer's views, > if any, on the matters discussed. > On 18-Dec-12 14:28, Reindl Harald wrote: >> Am 18.12.2012 19:39, schrieb Timo Sirainen: >>> On Sat, 2012-12-01 at 10:59 -0500, tlhackque wrote: >>>> It contains a subdirectory: >>>> >>>> -rw-rw---- 1 thlackque mail 84805345 Dec 1 10:34 Vendors/AVendor >>>> >>>> If I try to rename the AVendor folder (client is Thunderbird 17.0), I >>>> get this error: >>>> >>>> Unable to rename across conflicting directory permisssions >> this is 660 which is simply wrong for a directrory >> in case of diretcories you need the excue flag means 770 >> > -- This communication may not represent my employer's views, if any, on the matters discussed. From tss at iki.fi Tue Dec 18 22:27:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:27:35 +0200 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CC2A64.30309@heinlein-support.de> References: <50CC2A64.30309@heinlein-support.de> Message-ID: <1355862455.13277.48.camel@hurina> On Sat, 2012-12-15 at 08:44 +0100, Peer Heinlein wrote: > The mdbox-format with the altstorage-feature is quite nice and important. > > But we're having much more then >> 30 TB of maildata and doing an fsck > on huge partitions takes too much (down-) time for our mailsystem. > > It would be much easier, if Dovecot would be able to use at least THREE > storage-paths for his m-Files (and not just TWO like now). People have asked for this a few times, but it's not that easy to implement (because of how altstorage code is now implemented), and I'm not really convinced that it's worth the trouble to add. > Having an altstorage1 and altstorage2, we would be able to move away all > mails from on altstorage-mountpoint, we could put this > storage-moungpoint into "maintenance" and do an fsck without Downtime > for Dovecot. > > > It would be nice having a doveadm-feature to put a altstorage-path in > "maintenance-mode", so to move easily away all m-files to other > alt-storage-paths and to let Dovecot know not to use this locked partition. The new "doveadm mount" stuff can handle this. If you unmount a filesystem (and maybe mounting it to another mountpoint), Dovecot will just fail all commands that attempt to access the altstorage (instead of assuming all the mails are gone and recreating the index). I think moving from one altstorage to another would be possible with rsync: 1. Mount the new storage 2. cp/rsync files to new storage [3. If it takes long enough that doveadm purge/altmove is already run, rsync again.] 5. Move the new storage's mountpoint over the old one (not sure if there's a way to do this atomically?) > Having even more then 3 storage-paths would be nice for huge setups: In > this case we could easily use different SMALLER partitions without > having just two or three huge partitions > 15 TB. Like others mentioned, you could do this also by dividing users to multiple different partitions. From tss at iki.fi Tue Dec 18 22:33:29 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:33:29 +0200 Subject: [Dovecot] When imapc can't connect to remote IMAP prevents user login (and blocks LDA) In-Reply-To: <50CCB000.2070808@mejor.pl> References: <50CCB000.2070808@mejor.pl> Message-ID: <1355862809.13277.51.camel@hurina> On Sat, 2012-12-15 at 18:14 +0100, Marcin Miros?aw wrote: > I'm using dovecot 2.1.12-r1. > When remote imap server rejects connections then I can't login into > account and MTA can't deliver emails to maildir also. > > I'm attaching snippets of logs: > 2012-12-15T18:05:43.072594+01:00 meteor dovecot: imap-login: Login: > user=, method=PLAIN, > rip=2001:470:1f0b:1ab3:50af:bef4:6918:78ad, lip=2001:470:1f15:1b61::2, > mpid=32533, TLS, session= > 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) > : Error: imapc(imap.wp.pl:143): Server > disconnected: Connection reset by peer > 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) > : Error: imapc(imap.wp.pl:143): > Authentication failed: Disconnected from server > 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) > : Error: imapc: Command failed: > Disconnected from server > 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) > : Error: user marcin at mejor.pl: > Initialization failed: Namespace 'xxx-wp-pl.': imapc: LIST failed: > Internal error occurred. Refer to server log for more information. > [2012-12-15 18:05:43] > 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) > : Error: Invalid user settings. Refer > to server log for more information. Would be nice to have fewer and nicer error message lines of course. > I'd like to ask is this behavior correct? You're using Dovecot as simple imapc proxy without local mails? Then yeah, what else could it really do? From tss at iki.fi Tue Dec 18 22:35:52 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:35:52 +0200 Subject: [Dovecot] mail_log_events seem to be broken in HG 2.2 In-Reply-To: <3C6BA996-4B27-40D5-9B8F-F363B8A97927@leuxner.net> References: <3C6BA996-4B27-40D5-9B8F-F363B8A97927@leuxner.net> Message-ID: <1355862952.13277.53.camel@hurina> On Sun, 2012-12-16 at 10:17 +0100, Thomas Leuxner wrote: > It seems along the way of 2.2alpha1 'mail_log_events' quietly stopped working. They don't log expunges etc. anymore. > > [?] > mail_log_events = expunge mailbox_delete Dunno. Latest hg works with my test: mail_plugins = " notify mail_log" plugin { mail_log_events = expunge mailbox_delete mail_log_fields = uid box msgid size } x expunge imap(tss 5414 ): Info: expunge: box=INBOX, uid=2369, msgid=<1051291295.32159.381.camel at hurina>, size=4598 x delete foo imap(tss 5414 ): Info: Mailbox deleted: foo From tss at iki.fi Tue Dec 18 22:40:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:40:56 +0200 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions In-Reply-To: <50D0C063.1000501@yahoo.com> References: <50BA297E.4070104@yahoo.com> <1355855958.13277.11.camel@hurina> <50D0C063.1000501@yahoo.com> Message-ID: <1355863256.13277.54.camel@hurina> On Tue, 2012-12-18 at 14:13 -0500, tlhackque wrote: > >> Unable to rename across conflicting directory permisssions > >> > >> If I chmod g-s Vendors, the RENAME command succeeds. > > Where are you renaming it to and what permissions that directory has? I > > can't seem to easily reproduce this. > > > > > Thanks for looking at this! .. > dovecot --version > 2.1.10 Looks like this was fixed in v2.1.11. From tss at iki.fi Tue Dec 18 22:52:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 22:52:18 +0200 Subject: [Dovecot] Adding a parameter to dovecot's deliver to get a meaningful return value In-Reply-To: References: Message-ID: <1355863938.13277.59.camel@hurina> On Mon, 2012-12-17 at 18:20 +0100, Cyril RUSSO wrote: > Hi, > > First, please forgive me as I'm not subscribed to the list. > I'm using Dovecot 2 (2.1.7) for serving my local maildir. > This maildir is filled by an external process, fetching & merging mails from different sources that's outside this scope (but it's working). > > Dovecot is thus acting as a MTA, but more as a MDA. > I've a web client running on the server, and it connects to Dovecot to get the mails. > I've configured this web client & dovecot to use sieve to filter the mails. I know that since Dovecot does not actually deliver the messages, it's not the expected behavior. > Anyway, I can use the "deliver" software in your suite for passing sieve's rules on each message in my maildir, and it's almost working. > I've a cron job that run deliver on each message of my maildir, but I'm a bit puzzled now. > Basically, I'm not able to figure out if a message was matched by a sieve filter or not. > > I'm a bit disappointed by two things: > 1) Sieve's reject doesn't make "deliver" to return an error, so a sieve rule chain ending in "reject" can't be detected from my cron's script. > I wonder it's due to the step deliver is supposed to be run (after a mail is already accepted). With dovecot-lda -e parameter you could at least in theory use ereject extension (not sure if Pigeonhole implements that now). Also alternatively the reject command will execute sendmail_path to send the rejection mail. You could catch that and e.g. create some flag file. > 2) "deliver" doesn't have a method to find out if it processed the given mail as input. > > Basically, would it be possible to either add a parameter to "deliver" (for example: "--fail-on-discarding") so it would fail if the sieve rules discard or reject (/ereject) the mail ? > That way, I could detect the failure in my script, and know that I don't need to delete the initial mail since it was not filtered. > > Or, thought differently, I wonder if "deliver" could open a socket/pipe/file whatever, and write the number of processed mails in there (or using a "--return-processed-mail"), so a sieve rule ending with "delete", would be detectable by my script. All of this sounds like a rather complex and probably somewhat fragile solution. I don't think I'd want to add such features where there is only one user (you). From tss at iki.fi Tue Dec 18 23:12:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 23:12:47 +0200 Subject: [Dovecot] passdb to add extra fields? Message-ID: <1355865167.13277.73.camel@hurina> Some passdbs like PAM can't really return any extra fields. Also some people have wanted to combine users' data from different passdb/userdbs so that for example you'd have userdb passwd give the uid/gid/home, but then you'd also have some other userdb give quota limits. So I was thinking something like this: passdb { driver = pam } passdb { driver = sql include = yes } or: userdb { driver = passwd } userdb { driver = passwd-file include = yes } I'm not sure about two things: 1) Should there be a way to replace all of the existing fields instead of just adding new ones? 2) Any thoughts of a better name than "include"? With passdb it would mean that it's included only when the authentication failed for some other passdb. With userdb it means it's included only if a previous userdb lookup succeeded. Also there are already "deny" and "pass" settings. Interaction with them can be somewhat confusing.. Maybe all of these should be replaced with: type=deny: Same as old deny=yes (deny auth if user is in list) type=precondition(?): Same as pass=yes (require another passdb to match) type=postcondition(?): Require user to exist in this passdb/userdb as well, adding any extra fields in it. type=add: Add any extra fields, if the user exists at all. (Better ideas for the names here? Is even "type" a good name?) Then maybe a new setting to delete existing extra fields .. or perhaps just extend passdb { override_fields } so that having "-field" would delete the field if it already existed.. From mstevens at imt-systems.com Tue Dec 18 23:37:40 2012 From: mstevens at imt-systems.com (Morten Stevens) Date: Tue, 18 Dec 2012 22:37:40 +0100 Subject: [Dovecot] dovecot index errors since 2.1.12 Message-ID: <50D0E224.2050508@imt-systems.com> Hi, After upgrading to dovecot 2.1.12, I see a lot of these errors: # 2.1.12: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.14.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) # Filesystem: ext4 with mdbox storage Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Cached message size smaller than expected (5010 < 8192) Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Corrupted index cache file /var/vmail/example.org/user//mdbox/mailboxes/INBOX/Ubuntu/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 27517 Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: read(/var/vmail/example.org/user//mdbox/storage/m.7123) failed: Input/output error (FETCH for mailbox INBOX/Ubuntu UID 27517) Dec 10 15:21:04 mail dovecot: imap(user at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-10 15:21:04] in=3391 out=1383967 Dec 17 21:38:34 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (12222 > 12085) Dec 17 21:38:34 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/LKML/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 216231 Dec 17 21:38:34 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15569) failed: Input/output error (FETCH for mailbox LKML UID 216231) Dec 17 21:38:34 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-17 21:38:34] in=4079 out=61996358 Dec 17 21:40:34 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (6726 > 5302) Dec 17 21:40:34 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Google/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 930834 Dec 17 21:40:34 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15544) failed: Input/output error (FETCH for mailbox Google UID 930834) Dec 17 21:40:34 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-17 21:40:34] in=27666 out=29738162 Since the release of dovecot 2.1.x, I have never seen this error message. After downgrading to 2.1.10 the error is gone. Andy ideas? Best regards, Morten From tss at iki.fi Tue Dec 18 23:42:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 18 Dec 2012 23:42:00 +0200 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <50D0E224.2050508@imt-systems.com> References: <50D0E224.2050508@imt-systems.com> Message-ID: <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> On 18.12.2012, at 23.37, Morten Stevens wrote: > After upgrading to dovecot 2.1.12, I see a lot of these errors: > > # 2.1.12: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-279.14.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) > # Filesystem: ext4 with mdbox storage > > Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Cached message size smaller than expected (5010 < 8192) > Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Corrupted index cache file /var/vmail/example.org/user//mdbox/mailboxes/INBOX/Ubuntu/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 27517 Could you try if this fix helps? http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 From aajaxx at gmail.com Tue Dec 18 23:45:03 2012 From: aajaxx at gmail.com (Ajax) Date: Tue, 18 Dec 2012 16:45:03 -0500 Subject: [Dovecot] passdb to add extra fields? In-Reply-To: <1355865167.13277.73.camel@hurina> References: <1355865167.13277.73.camel@hurina> Message-ID: On Tue, Dec 18, 2012 at 4:12 PM, Timo Sirainen wrote: > [[...]]] > 2) Any thoughts of a better name than "include"? With passdb it would > mean that it's included only when the authentication failed for some > other passdb. With userdb it means it's included only if a previous > userdb lookup succeeded. > Amend ?? From marcin at mejor.pl Wed Dec 19 00:06:01 2012 From: marcin at mejor.pl (=?ISO-8859-2?Q?Marcin_Miros=B3aw?=) Date: Tue, 18 Dec 2012 23:06:01 +0100 Subject: [Dovecot] When imapc can't connect to remote IMAP prevents user login (and blocks LDA) In-Reply-To: <1355862809.13277.51.camel@hurina> References: <50CCB000.2070808@mejor.pl> <1355862809.13277.51.camel@hurina> Message-ID: <50D0E8C9.1070301@mejor.pl> W dniu 2012-12-18 21:33, Timo Sirainen pisze: Hi Timo, hi all! > On Sat, 2012-12-15 at 18:14 +0100, Marcin Miros?aw wrote: >> I'm using dovecot 2.1.12-r1. >> When remote imap server rejects connections then I can't login into >> account and MTA can't deliver emails to maildir also. >> >> I'm attaching snippets of logs: >> 2012-12-15T18:05:43.072594+01:00 meteor dovecot: imap-login: Login: >> user=, method=PLAIN, >> rip=2001:470:1f0b:1ab3:50af:bef4:6918:78ad, lip=2001:470:1f15:1b61::2, >> mpid=32533, TLS, session= >> 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) >> : Error: imapc(imap.wp.pl:143): Server >> disconnected: Connection reset by peer >> 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) >> : Error: imapc(imap.wp.pl:143): >> Authentication failed: Disconnected from server >> 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) >> : Error: imapc: Command failed: >> Disconnected from server >> 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) >> : Error: user marcin at mejor.pl: >> Initialization failed: Namespace 'xxx-wp-pl.': imapc: LIST failed: >> Internal error occurred. Refer to server log for more information. >> [2012-12-15 18:05:43] >> 2012-12-15T18:05:43.442598+01:00 meteor dovecot: imap(marcin at mejor.pl) >> : Error: Invalid user settings. Refer >> to server log for more information. > > Would be nice to have fewer and nicer error message lines of course. This isn't problem for me. >> I'd like to ask is this behavior correct? > > You're using Dovecot as simple imapc proxy without local mails? Then > yeah, what else could it really do? Here is problem, I'm using local mails also!:) So when remote imap server doesn't want to talk with me I can't even check mail emails. I can understand this behavior (e.g. lda can't deliver email because sieve script could put such email in folder available via imapc) but it looks like a kind of DoS for my mailbox;) Maybe some kind of switch could be implemented: treat imapc errors as critical or not? Just an idea. Thanks, Marcin From tss at iki.fi Wed Dec 19 00:10:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 00:10:16 +0200 Subject: [Dovecot] When imapc can't connect to remote IMAP prevents user login (and blocks LDA) In-Reply-To: <50D0E8C9.1070301@mejor.pl> References: <50CCB000.2070808@mejor.pl> <1355862809.13277.51.camel@hurina> <50D0E8C9.1070301@mejor.pl> Message-ID: On 19.12.2012, at 0.06, Marcin Miros?aw wrote: >>> I'd like to ask is this behavior correct? >> >> You're using Dovecot as simple imapc proxy without local mails? Then >> yeah, what else could it really do? > > Here is problem, I'm using local mails also!:) So when remote imap > server doesn't want to talk with me I can't even check mail emails. > I can understand this behavior (e.g. lda can't deliver email because > sieve script could put such email in folder available via imapc) but it > looks like a kind of DoS for my mailbox;) Maybe some kind of switch > could be implemented: treat imapc errors as critical or not? Just an idea. I saw only one namespace in your configuration. Are you adding the imapc namespace somewhere else, or how exactly does your system work? Anyway, if you have a separate imapc namespace, I think you can simply set: namespace .. { ignore_on_failure = yes } From ben at morrow.me.uk Wed Dec 19 00:24:09 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Tue, 18 Dec 2012 22:24:09 +0000 Subject: [Dovecot] passdb to add extra fields? In-Reply-To: <1355865167.13277.73.camel@hurina> References: <1355865167.13277.73.camel@hurina> Message-ID: <20121218222408.GC3006@anubis.morrow.me.uk> At 11PM +0200 on 18/12/12 you (Timo Sirainen) wrote: > Some passdbs like PAM can't really return any extra fields. Also some > people have wanted to combine users' data from different passdb/userdbs > so that for example you'd have userdb passwd give the uid/gid/home, but > then you'd also have some other userdb give quota limits. > > So I was thinking something like this: > > passdb { > driver = pam > } > passdb { > driver = sql > include = yes > } > > or: > > userdb { > driver = passwd > } > userdb { > driver = passwd-file > include = yes > } > > I'm not sure about two things: > > 1) Should there be a way to replace all of the existing fields instead > of just adding new ones? > > 2) Any thoughts of a better name than "include"? With passdb it would > mean that it's included only when the authentication failed for some > other passdb. With userdb it means it's included only if a previous > userdb lookup succeeded. > > Also there are already "deny" and "pass" settings. Interaction with them > can be somewhat confusing.. Maybe all of these should be replaced with: > > type=deny: Same as old deny=yes (deny auth if user is in list) > type=precondition(?): Same as pass=yes (require another passdb to match) > type=postcondition(?): Require user to exist in this passdb/userdb as > well, adding any extra fields in it. > type=add: Add any extra fields, if the user exists at all. > > (Better ideas for the names here? Is even "type" a good name?) This sounds like the nsswitch.conf [notfound=continue] stuff, perhaps you could use those names? Status success entry found notfound entry definitely not found tryagain database temporarily unavailable unavail database not responding (an error of some kind) Action return return the current result continue try the next db and accumulate fields with defaults of success = return notfound = continue tryagain = continue unavail = continue You could potentially add other actions, like 'retry' which waits a bit and retries. Some sort of 'tempfail' action, which returns temporary failure to the client, would be good, but I don't think IMAP supports that, unless you just drop the connection and assume the client will reconnect and retry. That would mean your first example would need to be passdb { driver = pam success = continue } passdb { driver = sql } You could also add an 'override' key so that with this userdb { driver = passwd success = continue } userdb { driver = sql } the SQL can't set 'home' (because passwd has already set it) but with this userdb { driver = passwd success = continue } userdb { driver = sql override = home } it can. Ben From marcin at mejor.pl Wed Dec 19 00:25:14 2012 From: marcin at mejor.pl (=?ISO-8859-2?Q?Marcin_Miros=B3aw?=) Date: Tue, 18 Dec 2012 23:25:14 +0100 Subject: [Dovecot] When imapc can't connect to remote IMAP prevents user login (and blocks LDA) In-Reply-To: References: <50CCB000.2070808@mejor.pl> <1355862809.13277.51.camel@hurina> <50D0E8C9.1070301@mejor.pl> Message-ID: <50D0ED4A.9000204@mejor.pl> W dniu 2012-12-18 23:10, Timo Sirainen pisze: > On 19.12.2012, at 0.06, Marcin Miros?aw wrote: > >>>> I'd like to ask is this behavior correct? >>> >>> You're using Dovecot as simple imapc proxy without local mails? Then >>> yeah, what else could it really do? >> >> Here is problem, I'm using local mails also!:) So when remote imap >> server doesn't want to talk with me I can't even check mail emails. >> I can understand this behavior (e.g. lda can't deliver email because >> sieve script could put such email in folder available via imapc) but it >> looks like a kind of DoS for my mailbox;) Maybe some kind of switch >> could be implemented: treat imapc errors as critical or not? Just an idea. > > I saw only one namespace in your configuration. Are you adding the imapc namespace somewhere else, or how exactly does your system work? Anyway, if you have a separate imapc namespace, I think you can simply set: > > namespace .. { > ignore_on_failure = yes > } So I reinvented the wheel:] Thanks for tip! I'm storing namespaces in database. Thanks again, Marcin From mstevens at imt-systems.com Wed Dec 19 00:40:05 2012 From: mstevens at imt-systems.com (Morten Stevens) Date: Tue, 18 Dec 2012 23:40:05 +0100 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> References: <50D0E224.2050508@imt-systems.com> <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> Message-ID: <50D0F0C5.5090104@imt-systems.com> On 18.12.2012 22:42, Timo Sirainen wrote: > On 18.12.2012, at 23.37, Morten Stevens wrote: > >> After upgrading to dovecot 2.1.12, I see a lot of these errors: >> >> # 2.1.12: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-279.14.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) >> # Filesystem: ext4 with mdbox storage >> >> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Cached message size smaller than expected (5010 < 8192) >> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Corrupted index cache file /var/vmail/example.org/user//mdbox/mailboxes/INBOX/Ubuntu/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 27517 > > Could you try if this fix helps? http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 Hi Timo, Thanks for the quick reply, but it doesn't help. Dec 18 23:25:28 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (5437 > 3778) Dec 18 23:25:28 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Commit/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 684475 Dec 18 23:25:28 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15613) failed: Input/output error (FETCH for mailbox Commit UID 684475) Dec 18 23:25:28 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-18 23:25:28] in=6602 out=5191621 Dec 18 23:25:52 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (8371 > 7123) Dec 18 23:25:52 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/LKML/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 216722 Dec 18 23:25:52 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15604) failed: Input/output error (FETCH for mailbox LKML UID 216722) Dec 18 23:25:52 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-18 23:25:52] in=24312 out=41801670 Dec 18 23:26:00 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (6008 > 5194) Dec 18 23:26:00 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Google/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 935885 Dec 18 23:26:00 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15620) failed: Input/output error (FETCH for mailbox Google UID 935885) Dec 18 23:26:00 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-18 23:26:00] in=6334 out=7859459 Dec 18 23:26:38 mail dovecot: imap(user2 at example.org): Error: Cached message size smaller than expected (4433 < 5226) Dec 18 23:26:38 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Bugs/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 497733 Dec 18 23:26:38 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15620) failed: Input/output error (FETCH for mailbox Bugs UID 497733) Dec 18 23:26:38 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-18 23:26:38] in=1589 out=1320584 Do you have an idea? Best regards, Morten From tss at iki.fi Wed Dec 19 00:44:46 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 00:44:46 +0200 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <50D0F0C5.5090104@imt-systems.com> References: <50D0E224.2050508@imt-systems.com> <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> <50D0F0C5.5090104@imt-systems.com> Message-ID: <2677217B-55E4-409F-A8CC-E5CCC559F2FC@iki.fi> On 19.12.2012, at 0.40, Morten Stevens wrote: >>> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Cached message size smaller than expected (5010 < 8192) >>> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Corrupted index cache file /var/vmail/example.org/user//mdbox/mailboxes/INBOX/Ubuntu/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 27517 >> >> Could you try if this fix helps? http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 > > Thanks for the quick reply, but it doesn't help. Can you easily reproduce this with a new empty user, using some simple IMAP commands? Or alternatively running imaptest tool? http://imapwiki.org/ImapTest Also send your full doveconf -n output. And especially: are you using zlib plugin compression? Storing attachments separately? From mstevens at imt-systems.com Wed Dec 19 01:22:28 2012 From: mstevens at imt-systems.com (Morten Stevens) Date: Wed, 19 Dec 2012 00:22:28 +0100 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <2677217B-55E4-409F-A8CC-E5CCC559F2FC@iki.fi> References: <50D0E224.2050508@imt-systems.com> <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> <50D0F0C5.5090104@imt-systems.com> <2677217B-55E4-409F-A8CC-E5CCC559F2FC@iki.fi> Message-ID: <50D0FAB4.9010500@imt-systems.com> On 18.12.2012 23:44, Timo Sirainen wrote: > On 19.12.2012, at 0.40, Morten Stevens wrote: > >>>> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Cached message size smaller than expected (5010 < 8192) >>>> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Corrupted index cache file /var/vmail/example.org/user//mdbox/mailboxes/INBOX/Ubuntu/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 27517 >>> >>> Could you try if this fix helps? http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 >> >> Thanks for the quick reply, but it doesn't help. > > Can you easily reproduce this with a new empty user, using some simple IMAP commands? Or alternatively running imaptest tool? http://imapwiki.org/ImapTest I'm not able to reproduce this with a new empty user and I am also not able to reproduce this error after I deleted the affected folders and recreated them. > Also send your full doveconf -n output. And especially: are you using zlib plugin compression? Storing attachments separately? No zlib compression and we do not save the attachments separately. Do you still need the full doveconf -n output? I think it's fixed with commit bded819417d9. Best regards, Morten From daniel.parthey at informatik.tu-chemnitz.de Wed Dec 19 06:01:42 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 19 Dec 2012 05:01:42 +0100 Subject: [Dovecot] Advice on sieve vacation for aliases In-Reply-To: <50D05E2C.2050405@a1.ind.br> References: <50D05E2C.2050405@a1.ind.br> Message-ID: <20121219040142.GA16347@daniel.localdomain> Marcio Merlone wrote: > jhon at domain.tld and meggie at domain.tld. I have created a > sieve_global_path = /etc/dovecot/global.sieve and it works, but not > the intended way: it sends two vacation messages, each From: each > employee, and not From: comercial at domain.tld alias. Arguments to vacation are documented in RFC 5230: http://tools.ietf.org/html/rfc5230#page-10 Try to add :from comercial at domain.tld parameter to the vacation command. This should at least change the "From:" header of the vacation messages. Regards, Daniel -- https://plus.google.com/103021802792276734820 From linuxmail at 4lin.net Wed Dec 19 10:49:52 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Wed, 19 Dec 2012 09:49:52 +0100 Subject: [Dovecot] Upload / migrate old mails: iPhone shows oldest mails first Message-ID: hi, I've got a very strange behavior: I uploaded old mails from a local folder (thunderbird / osx) to my Dovecot (Debian Squeeze) and now, the iphone (ios6) show the oldest mails first. The only thing I can imagine is, that Dovecot got from Thunderbird the newest mails first and last the old mails, so that in the last mdbox are the old one. So, if it is correct, how can I fix it? cu denny From s.potapov at rambler-co.ru Wed Dec 19 11:02:28 2012 From: s.potapov at rambler-co.ru (Potapov Sergey) Date: Wed, 19 Dec 2012 09:02:28 +0000 Subject: [Dovecot] Path for fixing sequence lookup of newly created mails in transaction view Message-ID: <409CEB1649811749B2E36961BEE2DDBC08187FA8@MBX2.rambler.ramblermedia.com> Hi! It seem that tview_lookup_seq_range works incorret, if I request uids from 3 to 3, and I have new uids 1,2,4,5 it will return seq for uid=4. Fixing patch is included as attach. ------ Sergey Potapov -------------- next part -------------- A non-text attachment was scrubbed... Name: fix_tview_lookup_seq_range.patch Type: text/x-diff Size: 894 bytes Desc: fix_tview_lookup_seq_range.patch URL: From torbjorn at dbb.su.se Wed Dec 19 11:42:45 2012 From: torbjorn at dbb.su.se (Torbjorn Astlind) Date: Wed, 19 Dec 2012 10:42:45 +0100 Subject: [Dovecot] Dsync help, new attempt Message-ID: <50D18C15.5040400@dbb.su.se> I observe that dsync fills Maildir correctly incl. cur, if I delete Maildir just before dsync runs. Can the failed mbox to Maildir conversion be caused by dovecot creating Maildir automatically if a client connects to dovecot? Should dovecot be shutdown when running dsync? All the best, Torbj?rn 9. dsync help? (Torbjorn Astlind) ------------------------------ Message: 9 Date: Mon, 10 Dec 2012 16:33:08 +0100 From: Torbjorn Astlind To: dovecot at dovecot.org Subject: [Dovecot] dsync help? Message-ID: <50C600B4.4040603 at dbb.su.se> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi all, I have dovecot serving aprox 200 users through mbox, but the time has come to migrate to a new server, and to use Maildir. Using rsync from the old server I get all user data, i.e /home/*, and inboxes i.e /var/mail/* to a new server. This has worked well for some time as backup. The dsync should convert everything to Maildir, and it does... to an extent. (linebrakes for easy viewing) What I see, is that often, the /home/mail/xxx is NOT resulting in /home/xxx/Maildir/cur All mailboxes from /home/xxx, are properly converted to /home/xxx/Maildir/.name_of_ box Am I misunderstanding something? I get it to work sometimes if I delete the ~/Maildir completely before doing the dsync. All, and any help most welcome, Torbj?rn for i in `cat /home2/torbjorn/SCRIPTS/userlist.txt`; do dsync -D -v -f -u $i -c /etc/dovecot/alt_config/10-mail.MBOX.conf backup maildir:~/Maildir; done > /home2/torbjorn/SCRIPTS/mb2mdRES.txt 2>&1 the -c 10.mail.MBOX.conf contains, the parts I think are relevant for the dsync operation: mail_location = mbox:~/home:INBOX=/home/mail/%u namespace { type = private separator = '/' inbox = yes } dsync(root): Debug: Effective uid=501, gid=501, home=/home/torbjorn dsync(root): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/home:INBOX=/home/mail/torbjorn dsync(root): Debug: fs: root=/home/torbjorn/home, index=, control=, inbox=/home/mail/torbjorn, alt= dsync(root): Debug: Effective uid=501, gid=501, home=/home/torbjorn dsync(root): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir dsync(root): Debug: maildir++: root=/home/torbjorn/Maildir, index=, control=, inbox=/home/torbjorn/Maildir, alt= dsync(root): Debug: Namespace : /home/torbjorn/Maildir doesn't exist yet, using default permissions dsync(root): Debug: Namespace : Using permissions from /home/torbjorn/Maildir: mode=0700 gid=-1 dsync(torbjorn): Debug: Namespace : Using permissions from /home/torbjorn/home: mode=0700 gid=-1 ------------------------------ _______________________________________________ dovecot mailing list dovecot at dovecot.org http://dovecot.org/cgi-bin/mailman/listinfo/dovecot End of dovecot Digest, Vol 116, Issue 16 **************************************** From bind at enas.net Wed Dec 19 12:01:21 2012 From: bind at enas.net (Urban Loesch) Date: Wed, 19 Dec 2012 11:01:21 +0100 Subject: [Dovecot] Too many imap connections in state "idling" In-Reply-To: <50D09E6A.4050501@adminlinux.com.br> References: <50C88C2C.5040703@adminlinux.com.br> <50CA11D3.5040406@adminlinux.com.br> <50D09E6A.4050501@adminlinux.com.br> Message-ID: <50D19071.7070602@enas.net> Can you see other strange symptoms on that machine? For example very high system load but not high I/O? We had similar issues with imap processes that are hanging in "D" state some months ago. The problem was, or is a bug in the inotify mechanism in the linux kernel. Not shure if the bug has just been fixed. For details see here: http://www.dovecot.org/list/dovecot/2012-May/065884.html and solution here: http://www.dovecot.org/list/dovecot/2012-June/066314.html Regards Urban On 18.12.2012 17:48, 3.listas at adminlinux.com.br wrote: > Thanks Steffen Kaiser ! I think not. The server is currently always 60% of imap processes in state "idling". > > IDLE processes are like this: > root at server:/root# ps aux |grep imap > dovemail 617 0.0 0.0 23136 2260 ? S Dec15 0:01 dovecot/imap [Username1 IP1 IDLE] > dovemail 677 0.0 0.0 23104 2172 ? S Dec15 0:01 dovecot/imap [Username2 IP2 IDLE] > ... > > My "idling" processes are seen as follows: > root at server:~# ps aux |grep imap |grep idling > dovemail 1141 0.0 0.0 16836 2148 ? D Dec15 0:01 dovecot/imap [idling] > dovemail 3375 0.0 0.0 16828 2120 ? D 15:48 0:00 dovecot/imap [idling] > dovemail 4833 0.0 0.0 16828 2212 ? D 15:49 0:00 dovecot/imap [idling] > ... > > Thanks! > -- > Thiago Henrique > www.adminlinux.com.br > > On 14-12-2012 06:40, Steffen Kaiser wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Thu, 13 Dec 2012, 3.listas at adminlinux.com.br wrote: >> >>> Is it normal this large amount of connections in state 'idling' ? >> >> If they actually using the "IDLE" command to wait for PUSH mails on much more folders than on the other server? >> >> Regards, >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBUMrmFmoxLS8a3A9mAQKmjgf/RbVzZet2+PUDQpMkrquB8zURR+WaBpxa >> OCnNahjCV3kkuyLSciU8cq54vQhfPEXoyeqoQric/QmMOIZwhaVclLGpnSGa6lGR >> fjk6x1PgcUDpqncktTJ+aUuJYTiigQbZ1wLWUfCHNZMXx5smReUMV+IdYV/0UH2a >> NCnQMX7+FfUWOfZdU6QbomgTXAEgjUD+YRo0JqQ6ja/ELWfbUrYAXwhGXAXyskJT >> 0eygy3FSEBJQMaIO+o5Dco7AbaCGs19xRagZWGZV5/1j17dHqOHwLdp8MnO4wCI8 >> 4IPzuTUbAY0gnCEJLcSYmQG1FzNi5SjPfMV/dypB7wcPdIx4rIzsww== >> =OQSw >> -----END PGP SIGNATURE----- > > From jtam.home at gmail.com Wed Dec 19 12:47:09 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 19 Dec 2012 02:47:09 -0800 (PST) Subject: [Dovecot] dovecot-lda (2.1.12) segfaults In-Reply-To: References: Message-ID: Timo Sirainen writes: > Can you still reproduce this in any way? Yes, I have 6 sets of user INBOX index caches that will crash dovecot-lda. The actual content of the INBOX is irrelevant (crash probably happens before INBOX is opened). > I found two bugs, would be nice to know if they solve it: > > http://hg.dovecot.org/dovecot-2.1/rev/2f848393f78e > http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 No, these patch don't help. It crashes in the same place with the same value of field_hdr. Here's the full backtrace: #0 0xff2a0474 in mail_cache_header_fields_read (cache=0x5c250) at mail-cache-fields.c:325 field_hdr = (const struct mail_cache_header_fields *) 0x20 field = {name = 0x402
, idx = 4282351288, type = MAIL_CACHE_FIELD_VARIABLE_SIZE, field_size = 4282335628, decision = MAIL_CACHE_DECISION_TEMP, last_used = -14558816} last_used = (const uint32_t *) 0x64584 sizes = (const uint32_t *) 0xc types = (const uint8_t *) 0x64888 "" decisions = (const uint8_t *) 0x64900 "" p = 0x24a38 "?\035\212@????" names = 0x0 end = 0x64a50 "" orig_key = (void *) 0xffbfee38 orig_value = (void *) 0x64550 fidx = 411784 new_fields_count = 4280126016 dec = MAIL_CACHE_DECISION_NO max_drop_time = 376804 offset = 32 i = 4282348464 #1 0xff29e8cc in mail_cache_compress_locked (cache=0x5c250, trans=0x645e0, unlock=0xffbfeeef) at mail-cache-compress.c:361 dotlock = (struct dotlock *) 0x2ea00 st = {st_dev = 235718347, st_pad1 = {874, 0, 0}, st_ino = 0, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0, st_rdev = 3720, st_pad2 = {0, 0}, st_size = 3720, st_atim = { tv_sec = 410816, tv_nsec = -12631336}, st_mtim = {tv_sec = 514, tv_nsec = -12631336}, st_ctim = {tv_sec = 65536, tv_nsec = 0}, st_blksize = 0, st_blocks = 1621028016851520, st_fstype = "\000\000\000\004\000\000\000\003\212\000\000\000\000\005?P", st_pad4 = {-4198784, -14028952, 39394339, 377424, 0, 16777216, 3, 4}} old_mask = 4282348464 file_seq = 4 old_offset = 4290768372 ext_offsets = {arr = {buffer = 0xffbfee10, element_size = 4280930288}, v = 0xffbfee10, v_modifiable = 0xffbfee10} offsets = (const uint32_t *) 0x0 data = (const void *) 0xff3f4380 i = 0 count = 1 fd = 0 ret = 377424 #2 0xff29efe0 in mail_cache_compress (cache=0x5c250, trans=0x645e0) at mail-cache-compress.c:489 unlock = false ret = 411764 __FUNCTION__ = "mail_cache_compress" #3 0xff2a3e28 in mail_cache_transaction_compress (ctx=0x5e3b8) at mail-cache-transaction.c:180 cache = (struct mail_cache *) 0x5c250 view = (struct mail_index_view *) 0x644c0 trans = (struct mail_index_transaction *) 0x645e0 ret = 2424 #4 0xff2a40b8 in mail_cache_transaction_open_if_needed (ctx=0x5e3b8) at mail-cache-transaction.c:241 cache = (struct mail_cache *) 0x5c250 ext = (const struct mail_index_ext *) 0x1e idx = 154968 i = 1 __FUNCTION__ = "mail_cache_transaction_open_if_needed" #5 0xff2a6e94 in mail_cache_field_want_add (ctx=0x5e3b8, seq=1, field_idx=12) at mail-cache-transaction.c:1048 decision = 153968 #6 0xff27e8e8 in index_mail_parse_header_register_all_wanted (mail=0x5efa8) at index-mail-headers.c:175 _mail = (struct mail *) 0x5efa8 all_cache_fields = (const struct mail_cache_field *) 0x25970 i = 12 count = 26 #7 0xff27ec90 in index_mail_parse_header_init (mail=0x5efa8, headers=0x0) at index-mail-headers.c:230 _data_stack_cur_id = 2 data = (struct index_mail_data *) 0x5f058 match = (const uint8_t *) 0x641a0 "" i = 0 field_idx = 4290769328 match_count = 2155905152 __FUNCTION__ = "index_mail_parse_header_init" #8 0xff27f5c8 in index_mail_cache_parse_init (_mail=0x5efa8, input=0x64058) at index-mail-headers.c:376 mail = (struct index_mail *) 0x5efa8 input2 = (struct istream *) 0x641a0 __FUNCTION__ = "index_mail_cache_parse_init" #9 0xff2299cc in mbox_save_get_input_stream (ctx=0x5e6e0, input=0x637c8) at mbox-save.c:411 filter = (struct istream *) 0x0 ret = (struct istream *) 0x5edd0 cache_input = (struct istream *) 0x25990 streams = {0x20202020, 0x2e938, 0xa202020} #10 0xff22a084 in mbox_save_begin (_ctx=0x5e6e0, input=0x637c8) at mbox-save.c:520 ctx = (struct mbox_save_context *) 0x5e6e0 t = (struct mbox_transaction_context *) 0x5de88 save_flags = MAIL_RECENT offset = 0 __FUNCTION__ = "mbox_save_begin" #11 0xff24e9c0 in mailbox_save_begin (ctx=0xffbff514, input=0x637c8) at mail-storage.c:1652 box = (struct mailbox *) 0x594e8 ret = 0 #12 0xff23f138 in mail_storage_try_copy (_ctx=0xffbff514, mail=0x54cd8) at mail-copy.c:68 ctx = (struct mail_save_context *) 0x5e6e0 pmail = (struct mail_private *) 0x54cd8 input = (struct istream *) 0x637c8 from_envelope = 0x13d90 "MAILER-DAEMON" guid = 0xff2f0ec0 "" received_date = -1 #13 0xff23f23c in mail_storage_copy (ctx=0x5e6e0, mail=0x54cd8) at mail-copy.c:93 No locals. #14 0xff24ec28 in mailbox_copy (_ctx=0xffbff670, mail=0x54cd8) at mail-storage.c:1721 ctx = (struct mail_save_context *) 0x5e6e0 box = (struct mailbox *) 0x594e8 keywords = (struct mail_keywords *) 0x0 ret = 389032 #15 0xff24ec98 in mailbox_save_using_mail (ctx=0xffbff670, mail=0x54cd8) at mail-storage.c:1730 No locals. #16 0xff388070 in mail_deliver_save (ctx=0xffbff8a8, mailbox=0x13fe8 "INBOX", flags=0, keywords=0x0, storage_r=0xffbff83c) at mail-deliver.c:317 open_ctx = {user = 0x3d3a8, lda_mailbox_autocreate = true, lda_mailbox_autosubscribe = false} box = (struct mailbox *) 0x594e8 trans_flags = MAILBOX_TRANSACTION_FLAG_EXTERNAL t = (struct mailbox_transaction_context *) 0x5de88 save_ctx = (struct mail_save_context *) 0x0 headers_ctx = (struct mailbox_header_lookup_ctx *) 0x0 kw = (struct mail_keywords *) 0x0 error = MAIL_ERROR_NONE mailbox_name = 0x13fe8 "INBOX" errstr = 0x0 guid = 0xff3f73b0 "" changes = {pool = 0x13e38, uid_validity = 0, saved_uids = {arr = {buffer = 0x13e28, element_size = 1}, v = 0x13e28, v_modifiable = 0x13e28}, ignored_modseq_changes = 4282350008, changed = false} range = (const struct seq_range *) 0xff1d3580 default_save = true ret = 0 __FUNCTION__ = "mail_deliver_save" #17 0xff38869c in mail_deliver (ctx=0xffbff8a8, storage_r=0xffbff83c) at mail-deliver.c:403 ret = -1 #18 0x00012d08 in main (argc=3, argv=0xffbff964) at main.c:434 set_roots = {0x24b48, 0x0} ctx = {pool = 0x2eaf0, set = 0x30440, session = 0x2eb00, dup_ctx = 0x0, session_id = 0x0, src_mail = 0x54cd8, src_envelope_sender = 0x0, dest_user = 0x3d3a8, dest_addr = 0x25828 "testuser at domain", final_dest_addr = 0x25828 "testuser at domain", dest_mailbox_name = 0x13fe8 "INBOX", dest_mail = 0x5efa8, var_expand_table = 0x0, tried_default_save = true, saved_mail = false, save_dest_mail = false, mailbox_full = false, dsn = false} service_flags = 1027 user = 0xffbffad0 "testuser" errstr = 0xff3f48e8 "" path = 0x0 storage_service = (struct mail_storage_service_ctx *) 0x2f650 service_user = (struct mail_storage_service_user *) 0x2fe88 service_input = {module = 0x13fd0 "lda", service = 0x13fd0 "lda", username = 0xffbffad0 "testuser", session_id = 0x0, local_ip = {family = 0, u = {ip6 = { _S6_un = {_S6_u8 = '\0' , _S6_u32 = {0, 0, 0, 0}, __S6_align = 0}}, ip4 = {S_un = {S_un_b = {s_b1 = 0 '\0', s_b2 = 0 '\0', s_b3 = 0 '\0', s_b4 = 0 '\0'}, S_un_w = {s_w1 = 0, s_w2 = 0}, S_addr = 0}}}}, remote_ip = {family = 0, u = {ip6 = { _S6_un = {_S6_u8 = '\0' , _S6_u32 = {0, 0, 0, 0}, __S6_align = 0}}, ip4 = {S_un = {S_un_b = {s_b1 = 0 '\0', s_b2 = 0 '\0', s_b3 = 0 '\0', s_b4 = 0 '\0'}, S_un_w = {s_w1 = 0, s_w2 = 0}, S_addr = 0}}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} storage = (struct mail_storage *) 0x39330 user_source = 0x13f30 "" destaddr_source = 0x13f30 "" process_euid = 0 stderr_rejection = false ret = 1 c = -1 error = MAIL_ERROR_NONE Joseph Tam From tss at iki.fi Wed Dec 19 12:59:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 12:59:54 +0200 Subject: [Dovecot] dovecot-lda (2.1.12) segfaults In-Reply-To: References: Message-ID: <49FCD0FA-1D17-4B5D-A0B4-B5A93EE3B178@iki.fi> On 19.12.2012, at 12.47, Joseph Tam wrote: >> Can you still reproduce this in any way? > > Yes, I have 6 sets of user INBOX index caches that will crash dovecot-lda. > The actual content of the INBOX is irrelevant (crash probably happens > before INBOX is opened). Could you send me those files? Would be the easiest and quickest way to get it fixed :) From tss at iki.fi Wed Dec 19 15:02:25 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 15:02:25 +0200 Subject: [Dovecot] dovecot-lda (2.1.12) segfaults In-Reply-To: <49FCD0FA-1D17-4B5D-A0B4-B5A93EE3B178@iki.fi> References: <49FCD0FA-1D17-4B5D-A0B4-B5A93EE3B178@iki.fi> Message-ID: <7488E6A7-4E75-4FD2-AA94-906E3CBCAEEB@iki.fi> On 19.12.2012, at 12.59, Timo Sirainen wrote: > On 19.12.2012, at 12.47, Joseph Tam wrote: > >>> Can you still reproduce this in any way? >> >> Yes, I have 6 sets of user INBOX index caches that will crash dovecot-lda. >> The actual content of the INBOX is irrelevant (crash probably happens >> before INBOX is opened). > > Could you send me those files? Would be the easiest and quickest way to get it fixed :) Okay, fixed: http://hg.dovecot.org/dovecot-2.1/rev/32ce915e046a From mstevens at imt-systems.com Wed Dec 19 15:35:02 2012 From: mstevens at imt-systems.com (Morten Stevens) Date: Wed, 19 Dec 2012 14:35:02 +0100 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <50D0FAB4.9010500@imt-systems.com> References: <50D0E224.2050508@imt-systems.com> <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> <50D0F0C5.5090104@imt-systems.com> <2677217B-55E4-409F-A8CC-E5CCC559F2FC@iki.fi> <50D0FAB4.9010500@imt-systems.com> Message-ID: <50D1C286.70407@imt-systems.com> On 19.12.2012 00:22, Morten Stevens wrote: > > On 18.12.2012 23:44, Timo Sirainen wrote: >> On 19.12.2012, at 0.40, Morten Stevens wrote: >> >>>>> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: Cached >>>>> message size smaller than expected (5010 < 8192) >>>>> Dec 10 15:21:04 mail dovecot: imap(user at example.org): Error: >>>>> Corrupted index cache file >>>>> /var/vmail/example.org/user//mdbox/mailboxes/INBOX/Ubuntu/dbox-Mails/dovecot.index.cache: >>>>> Broken physical size for mail UID 27517 >>>> >>>> Could you try if this fix helps? >>>> http://hg.dovecot.org/dovecot-2.1/rev/bded819417d9 >>> >>> Thanks for the quick reply, but it doesn't help. >> >> Can you easily reproduce this with a new empty user, using some simple >> IMAP commands? Or alternatively running imaptest tool? >> http://imapwiki.org/ImapTest > > I'm not able to reproduce this with a new empty user and I am also not > able to reproduce this error after I deleted the affected folders and > recreated them. Hi Timo, I see the error again. (this is a newly created folder) Dec 19 14:20:45 mail dovecot: imap-login: Login: user=, method=PLAIN, rip=109.90.118.156, lip=81.30.145.131, mpid=16599, TLS, session=<0jJoezTRewBtWnac> Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (4318 > 4244) Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Wiki/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 15 Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15626) failed: Input/output error (FETCH for mailbox Wiki UID 15) Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-19 14:20:57] in=2153 out=1200970 Do you need the index cache files? Best regards, Morten From tss at iki.fi Wed Dec 19 16:42:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 16:42:44 +0200 Subject: [Dovecot] Path for fixing sequence lookup of newly created mails in transaction view In-Reply-To: <409CEB1649811749B2E36961BEE2DDBC08187FA8@MBX2.rambler.ramblermedia.com> References: <409CEB1649811749B2E36961BEE2DDBC08187FA8@MBX2.rambler.ramblermedia.com> Message-ID: <1355928164.13277.77.camel@hurina> On Wed, 2012-12-19 at 09:02 +0000, Potapov Sergey wrote: > It seem that tview_lookup_seq_range works incorret, if I request uids > from 3 to 3, and I have new uids 1,2,4,5 it will return seq for uid=4. > Fixing patch is included as attach. Thanks. I committed it in two parts: http://hg.dovecot.org/dovecot-2.1/rev/7f4835cff04a http://hg.dovecot.org/dovecot-2.1/rev/c9e6ad8a42db BTW. Did you notice this cause some Dovecot bug or were you using it in your own code? From tss at iki.fi Wed Dec 19 16:44:05 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 16:44:05 +0200 Subject: [Dovecot] Upload / migrate old mails: iPhone shows oldest mails first In-Reply-To: References: Message-ID: <1355928245.13277.79.camel@hurina> On Wed, 2012-12-19 at 09:49 +0100, Denny Schierz wrote: > hi, > > I've got a very strange behavior: I uploaded old mails from a local > folder (thunderbird / osx) to my Dovecot (Debian Squeeze) and now, the > iphone (ios6) show the oldest mails first. The only thing I can > imagine is, that Dovecot got from Thunderbird the newest mails first > and last the old mails, so that in the last mdbox are the old one. Probably. > So, if it is correct, how can I fix it? If iPhone can't sort mails by received date, then I don't know if there's any really easy way to fix it. Basically figure out some way to import the mails again in the correct order.. From tss at iki.fi Wed Dec 19 17:15:46 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 17:15:46 +0200 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <50D1C286.70407@imt-systems.com> References: <50D0E224.2050508@imt-systems.com> <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> <50D0F0C5.5090104@imt-systems.com> <2677217B-55E4-409F-A8CC-E5CCC559F2FC@iki.fi> <50D0FAB4.9010500@imt-systems.com> <50D1C286.70407@imt-systems.com> Message-ID: <877466DB-7020-496F-BE20-612767796143@iki.fi> On 19.12.2012, at 15.35, Morten Stevens wrote: > I see the error again. (this is a newly created folder) > > Dec 19 14:20:45 mail dovecot: imap-login: Login: user=, method=PLAIN, rip=109.90.118.156, lip=81.30.145.131, mpid=16599, TLS, session=<0jJoezTRewBtWnac> > Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (4318 > 4244) > Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Wiki/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 15 > Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15626) failed: Input/output error (FETCH for mailbox Wiki UID 15) > Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-19 14:20:57] in=2153 out=1200970 > > Do you need the index cache files? Hmh. I can't figure out how that could happen. Also the index files alone probably aren't enough.. Can you send the index files, storage/dovecot.map.index* files and storage/m.* files put through http://dovecot.org/tools/mdbox-obfuscate.pl to remove the actual message contents. Then only the dovecot.index.cache file has anything sensitive (some message headers). From mstevens at imt-systems.com Wed Dec 19 17:34:28 2012 From: mstevens at imt-systems.com (Morten Stevens) Date: Wed, 19 Dec 2012 16:34:28 +0100 Subject: [Dovecot] dovecot index errors since 2.1.12 In-Reply-To: <877466DB-7020-496F-BE20-612767796143@iki.fi> References: <50D0E224.2050508@imt-systems.com> <57FFADA1-78C3-4552-9A0A-F79FDDDFD77A@iki.fi> <50D0F0C5.5090104@imt-systems.com> <2677217B-55E4-409F-A8CC-E5CCC559F2FC@iki.fi> <50D0FAB4.9010500@imt-systems.com> <50D1C286.70407@imt-systems.com> <877466DB-7020-496F-BE20-612767796143@iki.fi> Message-ID: <50D1DE84.8020204@imt-systems.com> On 19.12.2012 16:15, Timo Sirainen wrote: > On 19.12.2012, at 15.35, Morten Stevens wrote: > >> I see the error again. (this is a newly created folder) >> >> Dec 19 14:20:45 mail dovecot: imap-login: Login: user=, method=PLAIN, rip=109.90.118.156, lip=81.30.145.131, mpid=16599, TLS, session=<0jJoezTRewBtWnac> >> Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: Cached message size larger than expected (4318 > 4244) >> Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: Corrupted index cache file /var/vmail/example.org/user2//mdbox/mailboxes/Wiki/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 15 >> Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Error: read(/var/vmail/example.org/user2//mdbox/storage/m.15626) failed: Input/output error (FETCH for mailbox Wiki UID 15) >> Dec 19 14:20:57 mail dovecot: imap(user2 at example.org): Disconnected: Internal error occurred. Refer to server log for more information. [2012-12-19 14:20:57] in=2153 out=1200970 >> >> Do you need the index cache files? > > Hmh. I can't figure out how that could happen. Also the index files alone probably aren't enough.. Can you send the index files, storage/dovecot.map.index* files and storage/m.* files put through http://dovecot.org/tools/mdbox-obfuscate.pl to remove the actual message contents. Then only the dovecot.index.cache file has anything sensitive (some message headers). Hi Timo, I'll send you the requested files in a separate mail. Best regards, Morten From koko at cybcom.net Wed Dec 19 17:37:06 2012 From: koko at cybcom.net (Nikolai Tsvetkov) Date: Wed, 19 Dec 2012 17:37:06 +0200 Subject: [Dovecot] environment variables not set Message-ID: <50D1DF22.4080401@cybcom.net> hi, all! I try to use relay-ctrl with dovecot's imap, but with no luck. I think that the problem is with environment variables. Here are some information: dovecot --version 2.1.12 dovecot -n # 2.1.12: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.29-smp i686 Slackware 14.0 auth_mechanisms = plain login debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no first_valid_uid = 89 info_log_path = /var/log/dovecot-info.log listen = * log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir passdb { driver = shadow } protocols = imap service imap { executable = /usr/local/bin/envdir /etc/relay-ctrl /usr/local/bin/relay-ctrl-chdir /usr/local/bin/dovecot-settcpremoteip /usr/local/bin/relay-ctrl-allow /usr/local/libexec/dovecot/imap } ssl = no userdb { driver = passwd } /usr/local/bin/dovecot-settcpremoteip: #!/bin/sh # # Wrapper for relay-ctrl-allow that sets TCPREMOTEIP. TCPREMOTEIP="${IP}"; export TCPREMOTEIP exec "$@" From koko at cybcom.net Wed Dec 19 17:41:55 2012 From: koko at cybcom.net (Nikolai Tsvetkov) Date: Wed, 19 Dec 2012 17:41:55 +0200 Subject: [Dovecot] environment variables not set In-Reply-To: <50D1DF22.4080401@cybcom.net> References: <50D1DF22.4080401@cybcom.net> Message-ID: <50D1E043.1000009@cybcom.net> Sorry for double posting. :( So, when I export environment variables, received in dovecot-settcpremoteip, there are no USER, IP etc., but only standard SLACKWARE variables. I don't know whether it is related, but dovecot.log is full of such errors (in fact on every login): Dec 19 17:36:51 imap: Error: relay-ctrl-allow[29611]: Warning: Could not rename '.1355931411.409875:29611' to '': No such file or directory. Dec 19 17:37:51 imap: Error: relay-ctrl-allow[29615]: Warning: Could not rename '.1355931471.411497:29615' to '': No such file or directory. Dec 19 17:38:51 imap: Error: relay-ctrl-allow[29619]: Warning: Could not rename '.1355931531.415611:29619' to '': No such file or directory. What is wrong? Best regards, Nikolai Tsvetkov From tss at iki.fi Wed Dec 19 17:46:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 17:46:40 +0200 Subject: [Dovecot] environment variables not set In-Reply-To: <50D1DF22.4080401@cybcom.net> References: <50D1DF22.4080401@cybcom.net> Message-ID: <2BB2AF28-1051-4035-B1D8-187D909B14C6@iki.fi> On 19.12.2012, at 17.37, Nikolai Tsvetkov wrote: > I try to use relay-ctrl with dovecot's imap, but with no luck. I think > that the problem is with environment variables. Here are some information: > > dovecot --version > 2.1.12 > > service imap { > executable = /usr/local/bin/envdir /etc/relay-ctrl > /usr/local/bin/relay-ctrl-chdir /usr/local/bin/dovecot-settcpremoteip > /usr/local/bin/relay-ctrl-allow /usr/local/libexec/dovecot/imap > } Use the v2.x way of running post-login scripts: http://wiki2.dovecot.org/PostLoginScripting From koko at cybcom.net Wed Dec 19 18:03:59 2012 From: koko at cybcom.net (Nikolai Tsvetkov) Date: Wed, 19 Dec 2012 18:03:59 +0200 Subject: [Dovecot] environment variables not set In-Reply-To: <2BB2AF28-1051-4035-B1D8-187D909B14C6@iki.fi> References: <50D1DF22.4080401@cybcom.net> <2BB2AF28-1051-4035-B1D8-187D909B14C6@iki.fi> Message-ID: <50D1E56F.6050403@cybcom.net> Thank you! I tried, but only with first line and it didn't work. Now everything is fine. Here is a snippet if anyone gets in trouble like me: ............................. service imap { executable = imap relayctl } service relayctl { executable = script-login /usr/local/bin/envdir /etc/relay-ctrl /usr/local/bin/relay-ctrl-chdir /usr/local/bin/dovecot-settcpremoteip /usr/local/bin/relay-ctrl-allow user = $default_internal_user unix_listener relayctl { } } ........................... Thanks again! On 19.12.2012 ?. 17:46 ?., Timo Sirainen wrote: > On 19.12.2012, at 17.37, Nikolai Tsvetkov wrote: > >> I try to use relay-ctrl with dovecot's imap, but with no luck. I think >> that the problem is with environment variables. Here are some information: >> >> dovecot --version >> 2.1.12 >> >> service imap { >> executable = /usr/local/bin/envdir /etc/relay-ctrl >> /usr/local/bin/relay-ctrl-chdir /usr/local/bin/dovecot-settcpremoteip >> /usr/local/bin/relay-ctrl-allow /usr/local/libexec/dovecot/imap >> } > Use the v2.x way of running post-login scripts: http://wiki2.dovecot.org/PostLoginScripting > > > > From 24x7server at 24x7server.net Wed Dec 19 18:20:22 2012 From: 24x7server at 24x7server.net (Rajesh M) Date: Wed, 19 Dec 2012 21:50:22 +0530 (Asi) Subject: [Dovecot] migration to dovecot pop3 Message-ID: <.120.61.24.134.1355934022.squirrel@24x7server.net> hi i am planning to migrate from qmail pop3 to dovecot pop3 the number of users on the server is large over 5000 also data volume is large - over 3.5 tb -- ie many users several 1000s of emails in their inbox email clients used are outlook / outlook express / windows mail, etc my questions 1) will the migration cause all the emails on the server to re-download 2) can dovecot be configured to allow only one download at a time - pop3 locking with time out setting that can be customized 3) can dovecot pop3 be configured so that it will allow download of emails only of the last say 15 days ie even if the same pop3 user is configure on another machine it will download only messages of the last 15 days 4) has anybody migrated from qmail pop3 to dovecot pop3 successfully without emails being downloaded again thankyou very much in advance rajesh From hlx at h3c.de Wed Dec 19 19:51:37 2012 From: hlx at h3c.de (Holger Hegmanns) Date: Wed, 19 Dec 2012 18:51:37 +0100 Subject: [Dovecot] namespace subscription problem In-Reply-To: <1355858870.13277.22.camel@hurina> References: <50C15FCA.9000407@h3c.de> <1355858870.13277.22.camel@hurina> Message-ID: <50D1FEA9.3090801@h3c.de> > On Fri, 2012-12-07 at 04:17 +0100, Holger Hegmanns wrote: >> Hi all, >> >> my problem seems to be a cosmetic one (again). >> >> According to the docs: >> >> subscriptions: "yes" (default) if this namespace should handle its own >> subscriptions. If "no", then the first parent namespace with >> subscriptions=yes will handle it. >> >> Therefore is no way to create the following scenario: >> >> three namespaces (private, shared, public) >> the private namespace has to handle its own subscriptions >> the private namespace setup with "prefix = INBOX." >> the both shared and public namespace setup with "subscriptions = no" >> >> cause there is no so called "parent" namespace. Private namespace setup >> with "prefix = " works fine, but that's not what I want. > > First create all the namespaces you want and set subscriptions=no for > all of them. Then create a new prefix="" namespace, and set it > subscriptions=yes list=no hidden=yes. Great! It works like a charm! H.e From anmeyer at anup.de Wed Dec 19 21:55:38 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Wed, 19 Dec 2012 20:55:38 +0100 Subject: [Dovecot] setting mail_home and vacation Message-ID: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> Hello! dovecot version 2.1.7 I set up vacation with sieve. We have mboxes and maildirs and in dovecot.conf mail_location = mbox:/var/spool/vhosts/%d/dovecotprivate/%n:INBOX=/var/spool/vhosts/%d/%n Error: User archiv at xyz.de doesn't have home dir set, disabling duplicate database Dec 19 20:37:03 lda(archiv at xyz.de): Error: sieve: sieve script file path ~/.dovecot.sieve is relative to home directory, but home directory is not available. Dec 19 20:37:03 lda(archiv at xyz.de): Error: sieve: failed to access user's sieve script ~/.dovecot.sieve (using default script location instead) When I set mail_home = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/vhosts/%d/%n I get this for mboxes in the log: Error: user archiv at xyz.de: Relative home directory paths not supported: mbox:/var/spool/vhosts/xyz.de/archiv:INBOX=/var/spool/vhosts/xyz.de/archiv The .dovecot.sieve script of the user seems to be found, a vacation response is sent and the email is stored mail into mailbox 'INBOX' What is wrong? Andreas From stephan at rename-it.nl Wed Dec 19 22:31:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 19 Dec 2012 21:31:03 +0100 Subject: [Dovecot] Maildir hardlinks with sieve In-Reply-To: <50C7B6B8.4080107@rename-it.nl> References: <20121129130156.86002utrv14t9eic@webmail.unipa.it> <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> <50C7B6B8.4080107@rename-it.nl> Message-ID: <50D22407.7020604@rename-it.nl> On 12/11/2012 11:42 PM, Stephan Bosch wrote: > On 12/9/2012 10:12 PM, Benedetto Vassallo wrote: >> >> Def. Quota Benedetto Vassallo : >> >> Hi all, >> As I had no response, I suppose there is no way to have maildir >> hardlinks work if I set up sieve. >> Is that correct? > > Apparently, not at this time. I think it should be fixable, but that > will require some investigation. I won't have time for this until this > weekend. I gave it a look. Solving this now for v2.1 would require to many changes. This will have to wait until a later release and I hope this can be solved from within Dovecot rather than Pigeonhole. Regards, Stephan. From ben at morrow.me.uk Wed Dec 19 23:08:22 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Wed, 19 Dec 2012 21:08:22 +0000 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> Message-ID: <20121219210821.GA42801@anubis.morrow.me.uk> At 8PM +0100 on 19/12/12 you (Andreas Meyer) wrote: > > I set up vacation with sieve. We have mboxes and maildirs and in dovecot.conf > mail_location = > mbox:/var/spool/vhosts/%d/dovecotprivate/%n:INBOX=/var/spool/vhosts/%d/%n > > Error: User archiv at xyz.de doesn't have home dir set, disabling > duplicate database > Dec 19 20:37:03 lda(archiv at xyz.de): Error: sieve: sieve script file > path ~/.dovecot.sieve is relative to home directory, but home > directory is not available. > Dec 19 20:37:03 lda(archiv at xyz.de): Error: sieve: failed to access > user's sieve script ~/.dovecot.sieve (using default script location > instead) > > When I set > mail_home = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/vhosts/%d/%n > > I get this for mboxes in the log: > Error: user archiv at xyz.de: Relative home directory paths not > supported: > mbox:/var/spool/vhosts/xyz.de/archiv:INBOX=/var/spool/vhosts/xyz.de/archiv mail_home should be set to the path to a directory, not a mailbox location. You want just mail_home = /var/spool/vhosts/%d/%n Dovecot is interpreting the initial 'mbox:' part as the start of a relative path. Ben From benedetto.vassallo at unipa.it Wed Dec 19 23:16:13 2012 From: benedetto.vassallo at unipa.it (Benedetto Vassallo) Date: Wed, 19 Dec 2012 21:16:13 +0000 Subject: [Dovecot] Maildir hardlinks with sieve In-Reply-To: <50D22407.7020604@rename-it.nl> References: <20121129130156.86002utrv14t9eic@webmail.unipa.it> <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> <50C7B6B8.4080107@rename-it.nl> <50D22407.7020604@rename-it.nl> Message-ID: <20121219211613.Horde.xZV1DtXp4p-If8OS9wVo1w7@webmail-h5.unipa.it> Stephan Bosch ha scritto: > On 12/11/2012 11:42 PM, Stephan Bosch wrote: >> On 12/9/2012 10:12 PM, Benedetto Vassallo wrote: >>> >>> Def. Quota Benedetto Vassallo : >>> >>> Hi all, >>> As I had no response, I suppose there is no way to have maildir >>> hardlinks work if I set up sieve. >>> Is that correct? >> >> Apparently, not at this time. I think it should be fixable, but >> that will require some investigation. I won't have time for this >> until this weekend. > > I gave it a look. Solving this now for v2.1 would require to many > changes. This will have to wait until a later release and I hope > this can be solved from within Dovecot rather than Pigeonhole. > > Regards, > > Stephan. OK, then I'll wait for it. Can I have a feedback when it's done so I can install the correct version of dovecot/pigeonhole? Thank you all -- Benedetto Vassallo Sistema Informativo di Ateneo Settore Gestione Reti Hardware e Software U.O.B. Sviluppo e manutenzione dei sistemi Universit? degli studi di Palermo Phone: +3909123860056 Fax: +390916529124 From tss at iki.fi Wed Dec 19 23:39:32 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 19 Dec 2012 23:39:32 +0200 Subject: [Dovecot] Maildir hardlinks with sieve In-Reply-To: <20121219211613.Horde.xZV1DtXp4p-If8OS9wVo1w7@webmail-h5.unipa.it> References: <20121129130156.86002utrv14t9eic@webmail.unipa.it> <20121209211215.Horde.oygHDneTnqhGmdCzD6RYLg1@webmail-h5.unipa.it> <50C7B6B8.4080107@rename-it.nl> <50D22407.7020604@rename-it.nl> <20121219211613.Horde.xZV1DtXp4p-If8OS9wVo1w7@webmail-h5.unipa.it> Message-ID: On 19.12.2012, at 23.16, Benedetto Vassallo wrote: >>>> As I had no response, I suppose there is no way to have maildir hardlinks work if I set up sieve. >>>> Is that correct? >>> >>> Apparently, not at this time. I think it should be fixable, but that will require some investigation. I won't have time for this until this weekend. >> >> I gave it a look. Solving this now for v2.1 would require to many changes. This will have to wait until a later release and I hope this can be solved from within Dovecot rather than Pigeonhole. >> >> Regards, >> >> Stephan. > > OK, then I'll wait for it. > Can I have a feedback when it's done so I can install the correct version of dovecot/pigeonhole? > Thank you all It's a pretty invasive change. Either it's coming to v2.2.0 or the next possibility is v2.3.0. From tlx at leuxner.net Wed Dec 19 23:59:51 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 19 Dec 2012 22:59:51 +0100 Subject: [Dovecot] mail_log_events seem to be broken in HG 2.2 In-Reply-To: <1355862952.13277.53.camel@hurina> References: <3C6BA996-4B27-40D5-9B8F-F363B8A97927@leuxner.net> <1355862952.13277.53.camel@hurina> Message-ID: <00010013-64A8-41D5-8CE1-D3B66543FD2E@leuxner.net> Am 18.12.2012 um 21:35 schrieb Timo Sirainen : > On Sun, 2012-12-16 at 10:17 +0100, Thomas Leuxner wrote: >> It seems along the way of 2.2alpha1 'mail_log_events' quietly stopped working. They don't log expunges etc. anymore. >> >> [?] >> mail_log_events = expunge mailbox_delete > > Dunno. Latest hg works with my test: > > mail_plugins = " notify mail_log" > plugin { > mail_log_events = expunge mailbox_delete > mail_log_fields = uid box msgid size > } Right. Have 'notify' and 'mail_log' been added recently? I wasn't aware they are required - nor did I see them in the notes/config skeletons. Adding both of them seems to have fixed: Dec 19 22:55:04 spectre dovecot: imap(tlx at leuxner.net): expunge: box=Trash, uid=47601, msgid=<27339106.8748641355654225635.JavaMail.em-build at massmail-sender-eu-1b-i-705e3..., size=9111 Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4364 bytes Desc: not available URL: From anmeyer at anup.de Thu Dec 20 00:02:02 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Wed, 19 Dec 2012 23:02:02 +0100 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121219210821.GA42801@anubis.morrow.me.uk> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> Message-ID: <20121219230202.0be6a5e6@itxnew.bitcorner.intern> Ben Morrow wrote: > > When I set > > mail_home = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/vhosts/%d/%n > > > > I get this for mboxes in the log: > > Error: user archiv at xyz.de: Relative home directory paths not > > supported: > > mbox:/var/spool/vhosts/xyz.de/archiv:INBOX=/var/spool/vhosts/xyz.de/archiv > > mail_home should be set to the path to a directory, not a mailbox > location. You want just > > mail_home = /var/spool/vhosts/%d/%n ok, done that. I get this in Error: chdir(/var/spool/vhosts/xyz.de/archiv) failed: Not a directory Error: sieve: failed to stat sieve script: stat(/var/spool/vhosts/xyz.de/archiv/.dovecot.sieve) failed: Not a directory Error: sieve: failed to access user's sieve script ~/.dovecot.sieve (using default script location instead) I guess, this is just normal for mboxes? archiv at xyz.de is a mbox, per bcc serviced by postfix. > Dovecot is interpreting the initial 'mbox:' part as the start of a > relative path. Interessting, thank you! > > Ben Andreas From ben at morrow.me.uk Thu Dec 20 01:18:51 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Wed, 19 Dec 2012 23:18:51 +0000 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121219230202.0be6a5e6@itxnew.bitcorner.intern> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> <20121219230202.0be6a5e6@itxnew.bitcorner.intern> Message-ID: <20121219231850.GB42801@anubis.morrow.me.uk> At 11PM +0100 on 19/12/12 you (Andreas Meyer) wrote: > Ben Morrow wrote: > > > > When I set > > > mail_home = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/vhosts/%d/%n > > > > > > I get this for mboxes in the log: > > > Error: user archiv at xyz.de: Relative home directory paths not > > > supported: > > > mbox:/var/spool/vhosts/xyz.de/archiv:INBOX=/var/spool/vhosts/xyz.de/archiv > > > > mail_home should be set to the path to a directory, not a mailbox > > location. You want just > > > > mail_home = /var/spool/vhosts/%d/%n > > ok, done that. I get this in > Error: chdir(/var/spool/vhosts/xyz.de/archiv) failed: Not a directory > Error: sieve: failed to stat sieve script: > stat(/var/spool/vhosts/xyz.de/archiv/.dovecot.sieve) failed: Not a > directory > Error: sieve: failed to access user's sieve script ~/.dovecot.sieve > (using default script location instead) > > I guess, this is just normal for mboxes? archiv at xyz.de is a mbox, per bcc > serviced by postfix. Where is that user's home directory, then? (Where is its .dovecot.sieve?) That is the path that mail_home should be set to. Ben From anmeyer at anup.de Thu Dec 20 01:42:52 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Thu, 20 Dec 2012 00:42:52 +0100 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121219231850.GB42801@anubis.morrow.me.uk> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> <20121219230202.0be6a5e6@itxnew.bitcorner.intern> <20121219231850.GB42801@anubis.morrow.me.uk> Message-ID: <20121220004252.41af685c@itxnew.bitcorner.intern> Ben Morrow wrote: > > > mail_home = /var/spool/vhosts/%d/%n > > > > ok, done that. I get this in > > Error: chdir(/var/spool/vhosts/xyz.de/archiv) failed: Not a directory > > Error: sieve: failed to stat sieve script: > > stat(/var/spool/vhosts/xyz.de/archiv/.dovecot.sieve) failed: Not a > > directory > > Error: sieve: failed to access user's sieve script ~/.dovecot.sieve > > (using default script location instead) > > > > I guess, this is just normal for mboxes? archiv at xyz.de is a mbox, per bcc > > serviced by postfix. > > Where is that user's home directory, then? (Where is its > .dovecot.sieve?) That is the path that mail_home should be set to. It's /var/spool/vhosts/xyz.de/archiv . It's one file, a mbox. There is no .dovecot.sieve. This mbox is flushed various times a day by a MUA. This user archiv is a virtual user and has no home directory, just a mbox. > Ben Andreas From ben at morrow.me.uk Thu Dec 20 02:51:44 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Thu, 20 Dec 2012 00:51:44 +0000 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121220004252.41af685c@itxnew.bitcorner.intern> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> <20121219230202.0be6a5e6@itxnew.bitcorner.intern> <20121219231850.GB42801@anubis.morrow.me.uk> <20121220004252.41af685c@itxnew.bitcorner.intern> Message-ID: <20121220005143.GC42801@anubis.morrow.me.uk> At 12AM +0100 on 20/12/12 you (Andreas Meyer) wrote: > Ben Morrow wrote: > > > Where is that user's home directory, then? (Where is its > > .dovecot.sieve?) That is the path that mail_home should be set to. > > It's /var/spool/vhosts/xyz.de/archiv . It's one file, a mbox. There is no > .dovecot.sieve. This mbox is flushed various times a day by a MUA. > This user archiv is a virtual user and has no home directory, just a mbox. All Dovecot users should have a unique home directory (which needs to be *a directory*, obviously, and shouldn't be the same as any of the mailbox locations). See http://wiki2.dovecot.org/VirtualUsers/Home . Ben From daniel.parthey at informatik.tu-chemnitz.de Thu Dec 20 02:54:16 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Thu, 20 Dec 2012 01:54:16 +0100 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121220004252.41af685c@itxnew.bitcorner.intern> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> <20121219230202.0be6a5e6@itxnew.bitcorner.intern> <20121219231850.GB42801@anubis.morrow.me.uk> <20121220004252.41af685c@itxnew.bitcorner.intern> Message-ID: <20121220005416.GA23356@daniel.localdomain> Andreas Meyer wrote: > Ben Morrow wrote: > > > > > mail_home = /var/spool/vhosts/%d/%n > > > > > > ok, done that. I get this in > > > Error: chdir(/var/spool/vhosts/xyz.de/archiv) failed: Not a directory > > > Error: sieve: failed to stat sieve script: > > > stat(/var/spool/vhosts/xyz.de/archiv/.dovecot.sieve) failed: Not a > > > directory > > > Error: sieve: failed to access user's sieve script ~/.dovecot.sieve > > > (using default script location instead) > > > > > > I guess, this is just normal for mboxes? archiv at xyz.de is a mbox, per bcc > > > serviced by postfix. > > > > Where is that user's home directory, then? (Where is its > > .dovecot.sieve?) That is the path that mail_home should be set to. > > It's /var/spool/vhosts/xyz.de/archiv . It's one file, a mbox. There is no > .dovecot.sieve. This mbox is flushed various times a day by a MUA. > This user archiv is a virtual user and has no home directory, just a mbox. Your mail_home needs to be a directory, not a file. mbox files should be located inside a subdirectory of your mail_home. Regards Daniel -- https://plus.google.com/103021802792276734820 From jtam.home at gmail.com Thu Dec 20 02:59:12 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 19 Dec 2012 16:59:12 -0800 (PST) Subject: [Dovecot] migration to dovecot pop3 In-Reply-To: References: Message-ID: Rajesh M writes: > i am planning to migrate from qmail pop3 to dovecot pop3 > > the number of users on the server is large over 5000 > ... > also data volume is large - over 3.5 tb -- ie many users several 1000s of > emails in their inbox If you stay on the list, you might find some people here whose mail metrics are several orders of magnitude larger than this. > 1) will the migration cause all the emails on the server to re-download > ... > 4) has anybody migrated from qmail pop3 to dovecot pop3 successfully > without emails being downloaded again A proper migration will avoid this. Google is your friend http://lmgtfy.com/q=POP+qmail+to+dovecot+migration The top hits provide exactly what you're looking for. > 2) can dovecot be configured to allow only one download at a time - pop3 > locking with time out setting that can be customized > > 3) can dovecot pop3 be configured so that it will allow download of emails > only of the last say 15 days ie even if the same pop3 user is configure on > another machine it will download only messages of the last 15 days I can't answer this, but if this is an attempt to prevent mass download, the answer to 1+4 makes these questions irrelevant. Joseph Tam From jtam.home at gmail.com Thu Dec 20 04:08:39 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 19 Dec 2012 18:08:39 -0800 (PST) Subject: [Dovecot] dovecot-lda (2.1.12) segfaults In-Reply-To: References: Message-ID: Timo Sirainen writes: Date: Wed, 19 Dec 2012 12:59:54 +0200 > Could you send me those files? Would be the easiest and quickest way to > get it fixed :) Date: Wed, 19 Dec 2012 15:02:25 +0200 > Okay, fixed: http://hg.dovecot.org/dovecot-2.1/rev/32ce915e046a Yes it is does, and it stops crashing for the other 5 sets of indices. A 2-hour turnaround, of which an hour was spent packing up the index files. Amazing. Thanks. Joseph Tam From alexandr.sabitov at netregistry.com.au Thu Dec 20 04:11:31 2012 From: alexandr.sabitov at netregistry.com.au (Alexandr Sabitov) Date: Thu, 20 Dec 2012 02:11:31 +0000 Subject: [Dovecot] Director and forwarding LDAP user as Master user Message-ID: <55D76B5A78B24C42B3AEC8148D487AA7422F11E4@EX-5.nro.netregistry.net> Hello guys, Would you be able to help me with this little issue. I bet someone has the same config so if you can copy-paste it I will very appreciate it. So main idea is to enable Dovecot director to authenticate a LDAP user with plain or encrypted password and send the user to back-end Dovecot server after the authentication. According to Wiki it is only possible if we use the master user to communicate to the back-end server. On the back-end Dovecot server it is working fine, I can log in as normal user/user_password or as user*masteruser/master_password. The back-end config is: auth_master_user_separator = * passdb { driver = passwd-file args = /usr/local/dovecot/etc/dovecot/passwd.masterusers master = yes pass = yes } passdb { driver = ldap args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = ldap args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext } Now front-end: how to get director forward the user to the back-end after authentication on the director? With my director config the user stays on the director all the time: passdb { driver = static args = proxy=y master=masteruser pass=master_password destuser=%u*masteruser } passdb { driver = ldap args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = ldap args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext } The only way to forward the user is to setup nopassword=y in args of static passdb but in that case the user will be authenticated on the backend but not on the director... What do I missing ? Please help me Best Regards, Alexandr Sabitov From digimotif at gmail.com Thu Dec 20 06:17:55 2012 From: digimotif at gmail.com (Brian Jarrett) Date: Wed, 19 Dec 2012 21:17:55 -0700 Subject: [Dovecot] Problems trying to add dspam delivery to dovecot LDA to working Postfix/Dovecot server. No passdb. Message-ID: Hello list, I'm really hoping someone can point me in the right direction on this. I set up a server using Postfix with LDAP lookups to Active Directory. Postfix delivers to maildir. Dovecot IMAP and POP are working correctly using PAM Kerberos to authenticate via Active Directory. I want to add spam filtering, so I'm trying to set up Postfix to use dspam which is then supposed to use Dovecot LDA to deliver messages to the mailbox instead of having Postfix deliver to the Maildir. I can't get any deliveries to Dovecot LDA to get past passdb lookup. When I run /usr/lib/dovecot/deliver -f bjarrett at garfield16.org -d bjarrett at metcalfexcavation.com I get: Dec 19 20:57:55 mxserver2 dovecot: auth: Debug: master in: USER#0111# 011bjarrett at metcalfexcavation.com#011service=lda Dec 19 20:57:55 mxserver2 dovecot: auth: Debug: password( bjarrett at metcalfexcavation.com): passdb doesn't support credential lookups Dec 19 20:57:55 mxserver2 dovecot: auth: Error: static( bjarrett at metcalfexcavation.com): passdb doesn't support lookups, can't verify user's existence Dec 19 20:57:55 mxserver2 dovecot: auth: Debug: master out: FAIL#0111 Dec 19 20:57:55 mxserver2 dovecot: lda: Error: user bjarrett at metcalfexcavation.com: Auth USER lookup failed Dec 19 20:57:55 mxserver2 dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. so it doesn't even look like it's attempting to find the user. Here's my doveconf -n: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-29-generic x86_64 Ubuntu 12.04.1 LTS ext4 auth_debug = yes mail_gid = 1001 mail_location = maildir:/home/mailbox/%Lu/Maildir mail_uid = 1001 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mailbox mode = 0600 user = mailbox } } ssl_cert = was automatically rejected:%n%r } I have tried several configurations, but nothing seems to get me past the "passdb doesn't support.." errors. From arthur at psw.ro Thu Dec 20 08:19:31 2012 From: arthur at psw.ro (Arthur Titeica) Date: Thu, 20 Dec 2012 08:19:31 +0200 Subject: [Dovecot] imap dumps core when connecting with mutt In-Reply-To: <1355859597.13277.24.camel@hurina> References: <1693777.jcPe9tMOC4@lhart> <1355859597.13277.24.camel@hurina> Message-ID: <54240577.y3v9fmOOSG@lhart> Hello, Thanks for the reply. On Tuesday 18 December 2012 21:39:57 Timo Sirainen wrote: > On Sun, 2012-12-09 at 19:03 +0200, Arthur Titeica wrote: > > Hello, > > > > I'm trying to investigate a problem with dovecot/imap dumping core when > > connecting connecting mith mutt (everything else works). > > > > imap(user at domain): Fatal: master: service(imap): child 31752 killed with > > signal 11 (core dumped) > > > > I managed to create a core file and passed that to gdb. The log is here > > [1]. > > > > I hope this helps - please tell me what else would be needed if not. > > First of all doveconf -n output would be helpful. Here is the config: http://paste.kde.org/628478/83892135/raw/ > The gdb backtrace would have been also a bit more useful with debug symbols. I see no debug option in ./configure --help. Would it be enough not to strip the binaries after the build? -- Arthur Titeica From anmeyer at anup.de Thu Dec 20 11:39:04 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Thu, 20 Dec 2012 10:39:04 +0100 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121220005143.GC42801@anubis.morrow.me.uk> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> <20121219230202.0be6a5e6@itxnew.bitcorner.intern> <20121219231850.GB42801@anubis.morrow.me.uk> <20121220004252.41af685c@itxnew.bitcorner.intern> <20121220005143.GC42801@anubis.morrow.me.uk> Message-ID: <20121220103904.61dc029c@itxnew.bitcorner.intern> Ben Morrow wrote: > At 12AM +0100 on 20/12/12 you (Andreas Meyer) wrote: > > Ben Morrow wrote: > > > > > Where is that user's home directory, then? (Where is its > > > .dovecot.sieve?) That is the path that mail_home should be set to. > > > > It's /var/spool/vhosts/xyz.de/archiv . It's one file, a mbox. There is no > > .dovecot.sieve. This mbox is flushed various times a day by a MUA. > > This user archiv is a virtual user and has no home directory, just a mbox. > > All Dovecot users should have a unique home directory (which needs to be > *a directory*, obviously, and shouldn't be the same as any of the > mailbox locations). See http://wiki2.dovecot.org/VirtualUsers/Home . ok, thank you, that was an important step for the mboxes we drive! > Ben Andreas From anmeyer at anup.de Thu Dec 20 11:41:07 2012 From: anmeyer at anup.de (Andreas Meyer) Date: Thu, 20 Dec 2012 10:41:07 +0100 Subject: [Dovecot] setting mail_home and vacation In-Reply-To: <20121220005416.GA23356@daniel.localdomain> References: <20121219205538.27ea0e3c@itxnew.bitcorner.intern> <20121219210821.GA42801@anubis.morrow.me.uk> <20121219230202.0be6a5e6@itxnew.bitcorner.intern> <20121219231850.GB42801@anubis.morrow.me.uk> <20121220004252.41af685c@itxnew.bitcorner.intern> <20121220005416.GA23356@daniel.localdomain> Message-ID: <20121220104107.412d1650@itxnew.bitcorner.intern> Daniel Parthey wrote: > > > Where is that user's home directory, then? (Where is its > > > .dovecot.sieve?) That is the path that mail_home should be set to. > > > > It's /var/spool/vhosts/xyz.de/archiv . It's one file, a mbox. There is no > > .dovecot.sieve. This mbox is flushed various times a day by a MUA. > > This user archiv is a virtual user and has no home directory, just a mbox. > > Your mail_home needs to be a directory, not a file. > mbox files should be located inside a subdirectory of your mail_home. Thank you, got it! And migrated the users to the new location of the mboxes. Great! That makes everything much easier. > Regards > Daniel Andreas From skdovecot at smail.inf.fh-brs.de Thu Dec 20 12:58:23 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 20 Dec 2012 11:58:23 +0100 (CET) Subject: [Dovecot] Antispam r49 breaks Dovecot v2.1 Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Dear Eugene, patch 49 breaks compilation with Dovecot v2.1. Attached patch encloses the change in a #if. To feed the #if the actual Dovecot version, I've introduced an extra variable in extra.mk, but I cannot help with making the GNU configure stuff doing it right away. There will be numerous other ways to get the Dovecot version into the source ... . Maybe, Timo would add a binary version of the Dovecot version in its config.h ? In order to be able to built version-aware plugins. Regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUNLvT2oxLS8a3A9mAQIzfwgAvf7zcN9RwKD/kTmFkfx5djKd5H0dRXt8 423csD3bCU6qcOtR2MHR0ApNp07aXK84MPgIazbne41Iekqk0daoOhnPoc0mHy8u kj9EYFGVlQTKa2vcSUEu8Phddc/YHvzQba9m2Dg9P4STuJ6EcRqkhvufspERGphF Y+IY20BQc9/Flu8TIxtt6pSiIioq0WWntCGnyPP9BX90JYYO+5zAm5FnG4GH4Q0Z 44dZSKM7iP0/nMhmsraX/5alxy0mvx3ZfhO/Ktx/wd92WmLROAlicBClIZC9XCH2 6HD/ryr73DrEeEZdmwHcnmZrtWc++EJcAetfv45Fov8XagUtFJ0D4A== =G+d/ -----END PGP SIGNATURE----- -------------- next part -------------- A non-text attachment was scrubbed... Name: antispam_2.1-2.2.patch.gz Type: application/octet-stream Size: 559 bytes Desc: URL: From skdovecot at smail.inf.fh-brs.de Thu Dec 20 18:30:36 2012 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 20 Dec 2012 17:30:36 +0100 (CET) Subject: [Dovecot] no more backtraces in v2.1.12 (was Re: backtrace from postgres dict) In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 28 Nov 2012, Steffen Kaiser wrote: with Dovecot v2.1.12 I do no get those panics anymore. > 2012-11-28 10:04:41 dict: Panic: file driver-pgsql.c: line 84 > (driver_pgsql_set_state): assertion failed: (state == SQL_DB_STATE_BUSY || > db->cur_result == NULL) > > 2012-11-28 10:04:41 dict: Error: Raw backtrace: > /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(+0x4857a) > [0x7f91f511157a] -> > /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(+0x485c6) > [0x7f91f51115c6] -> > /usr/local/dovecot-2.1.10/lib/dovecot/libdovecot.so.0(i_error+0) > [0x7f91f50e4eaf] -> dovecot2.1/dict() [0x40aa36] -> dovecot2.1/dict() > [0x40aa91] -> dovecot2.1/dict() [0x40bed3] -> dovecot2.1/dict() [0x409504] - > -> dovecot2.1/dict(sql_db_cache_deinit+0x20) [0x408a60] -> > dovecot2.1/dict(main+0x169) [0x405a59] -> > /lib/libc.so.6(__libc_start_main+0xfd) [0x7f91f4b5cc8d] -> dovecot2.1/dict() > [0x404bb9] > > 2012-11-28 10:04:41 dict: Fatal: master: service(dict): child 22923 killed > with signal 6 (core not dumped) - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUNM9LGoxLS8a3A9mAQJaoQgAu5LfaqmVcdFWMF0Z+DrQvLz1xlSIP35+ cJxI7gYKh21LzpSB2iJ2DjccRUJDZRupqpIwSDLuiFYp7ORktrrO6ohieXrDM7z1 VcFO1kU2vbTYIbOloN724pSy1oFxTsec5TTi5zlL9WFjSTW2pP9oFbcSan+43ADo gUSwm69F57GIZvOGyMSb1o83JCXRI83IajtgFtcIBuTqn6TC+zMolC2rC35ElZdM EqkXMnGBKLNjxdp+hsro2i59bahzlIO4eigrRNFDTbiM8fInFen9BK40OnXkF2Ni n7kh9Zx+8EDE2ayWFKaPz0hXZbbQSXcWdkfHjc/TBV9DPk2YY7BTSw== =V/8J -----END PGP SIGNATURE----- From kjonca at o2.pl Thu Dec 20 19:29:26 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Thu, 20 Dec 2012 18:29:26 +0100 Subject: [Dovecot] doveadm-lda - segfault References: <87obi0j3j5.fsf@alfa.kjonca> <50C7879B.7030207@localhost.localdomain.org> <87ip88i9k2.fsf@alfa.kjonca> <20121211213034.GD39964@anubis.morrow.me.uk> <87a9tki6vw.fsf@alfa.kjonca> <876248i6aq.fsf@alfa.kjonca> <1355860072.13277.27.camel@hurina> Message-ID: <87623waayx.fsf@alfa.kjonca> Timo Sirainen writes: > On Tue, 2012-12-11 at 23:15 +0100, Kamil Jo?ca wrote: >> #0 0x00007f99d591fe6f in mail_storage_try_copy (mail=0x198dbb0, _ctx=0x7fff8914fc28) at mail-copy.c:56 >> 56 mail-copy.c: No such file or directory. > > raw-storage's envelope_sender is NULL. Fixed Dovecot to make sure NULL > isn't returned: http://hg.dovecot.org/dovecot-2.1/rev/579984fdb6e5 > > But I think Pigeonhole also shouldn't set it to NULL. > sieve-message.c:sieve_message_get_sender() apparently returns NULL if it > can't find anything. Elsewhere this is used when nothing else is there: > > #define DEFAULT_ENVELOPE_SENDER "MAILER-DAEMON" > > > LDA from dovecot 2:2.1.12-0~auto+10 does not segfaults. Thanks. KJ -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewskiej-wprowadzenie/ "Remember, extremism in the nondefense of moderation is not a virtue." -- Peter Neumann, about usenet From ka at pacific.net Thu Dec 20 20:27:14 2012 From: ka at pacific.net (Ken A) Date: Thu, 20 Dec 2012 12:27:14 -0600 Subject: [Dovecot] migration to dovecot pop3 In-Reply-To: References: Message-ID: <50D35882.20209@pacific.net> On 12/19/2012 6:59 PM, Joseph Tam wrote: > Rajesh M writes: > >> i am planning to migrate from qmail pop3 to dovecot pop3 >> >> the number of users on the server is large over 5000 >> ... >> also data volume is large - over 3.5 tb -- ie many users several 1000s of >> emails in their inbox > > If you stay on the list, you might find some people here whose > mail metrics are several orders of magnitude larger than this. > >> 1) will the migration cause all the emails on the server to re-download >> ... >> 4) has anybody migrated from qmail pop3 to dovecot pop3 successfully >> without emails being downloaded again > > A proper migration will avoid this. Google is your friend > > http://lmgtfy.com/q=POP+qmail+to+dovecot+migration > > The top hits provide exactly what you're looking for. > >> 2) can dovecot be configured to allow only one download at a time - pop3 >> locking with time out setting that can be customized We migrated 5000+ from qpopper years ago. Dovecot is sooo much better on system load. Yes, locking and timeouts are in the config file. >> >> 3) can dovecot pop3 be configured so that it will allow download of >> emails >> only of the last say 15 days ie even if the same pop3 user is >> configure on >> another machine it will download only messages of the last 15 days That's not part of pop3, so no, it's not possible with dovecot alone. You could probably work out a plugin to move read mail after x days, or there may be one out there ? Or some imap robot could do it.. Ken A. Pacific.Net > I can't answer this, but if this is an attempt to prevent mass download, > the answer to 1+4 makes these questions irrelevant. > > Joseph Tam > -- Ken Anderson Pacific Internet - http://www.pacific.net Latest Pacific.Net Status - http://twitter.com/pacnetstatus From tim at titan21.co.uk Fri Dec 21 00:14:40 2012 From: tim at titan21.co.uk (Tim Smith) Date: Thu, 20 Dec 2012 22:14:40 +0000 Subject: [Dovecot] Understanding Sockets Message-ID: <50D38DD0.4080709@titan21.co.uk> Hi, Just trying to consolidate my knowledge of Dovecot and I want to understand various things rather than just key out lines of config in dovecot.conf with the hope of it working. What I wanted to clarify is my understanding the "socket listen" section of the config file. From my limited understanding, this section details how other processes can access the userdb defined in Dovecot. The master socket is used for "internal" processes which is mainly dovecot-lda so that when Dovecot receives mail it knows where to deliver it and client is defined for "external" processes, for example Postfix who would use the info to determine if a user existed. Would you say this is a fair (albeit) dumbed down!!) synopsis of sockets and their purpose? Thanks in advance! Tim From ben at morrow.me.uk Fri Dec 21 02:21:12 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Fri, 21 Dec 2012 00:21:12 +0000 Subject: [Dovecot] Understanding Sockets In-Reply-To: <50D38DD0.4080709@titan21.co.uk> References: <50D38DD0.4080709@titan21.co.uk> Message-ID: <20121221002111.GA66720@anubis.morrow.me.uk> At 10PM +0000 on 20/12/12 Tim Smith wrote: > > Just trying to consolidate my knowledge of Dovecot and I want to > understand various things rather than just key out lines of config in > dovecot.conf with the hope of it working. > > What I wanted to clarify is my understanding the "socket listen" section > of the config file. From my limited understanding, this section details > how other processes can access the userdb defined in Dovecot. The master > socket is used for "internal" processes which is mainly dovecot-lda so > that when Dovecot receives mail it knows where to deliver it and client > is defined for "external" processes, for example Postfix who would use > the info to determine if a user existed. Would you say this is a fair > (albeit) dumbed down!!) synopsis of sockets and their purpose? Your mention of 'socket listen' and 'master' auth sockets suggests you are using Dovecot 1.x. That description is pretty-much correct for 1.x, however you should upgrade to 2.x as soon as you reasonably can, since 1.x is no longer supported. See http://wiki2.dovecot.org/Services#auth for a description of the socket types available with Dovecot 2. [The statement there that 'client' sockets can safely be exposed to the entire world, including over inet sockets, is not entirely true. AFAIK there is no rate limiting, so an exposed 'client' socket is a password oracle and should therefore be somewhat protected. The risk is approximately equivalent to an unshadowed password file, with the encrypted passwords exposed.] Ben From tim at titan21.co.uk Fri Dec 21 10:37:55 2012 From: tim at titan21.co.uk (Tim Smith) Date: Fri, 21 Dec 2012 08:37:55 +0000 Subject: [Dovecot] Understanding Sockets In-Reply-To: <20121221002111.GA66720@anubis.morrow.me.uk> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> Message-ID: <50D41FE3.2070505@titan21.co.uk> Thanks Ben, I'm using an Ubuntu Server OS (10.04) and it seems that the latest package they provide is 1.2.9. Do you know if anyone has had any success getting a Dovecot 2 package on this Ubuntu distro and how they went about it (Not comfortable compiling sources at this point!!)? Tim On 21/12/12 00:21, Ben Morrow wrote: > At 10PM +0000 on 20/12/12 Tim Smith wrote: >> Just trying to consolidate my knowledge of Dovecot and I want to >> understand various things rather than just key out lines of config in >> dovecot.conf with the hope of it working. >> >> What I wanted to clarify is my understanding the "socket listen" section >> of the config file. From my limited understanding, this section details >> how other processes can access the userdb defined in Dovecot. The master >> socket is used for "internal" processes which is mainly dovecot-lda so >> that when Dovecot receives mail it knows where to deliver it and client >> is defined for "external" processes, for example Postfix who would use >> the info to determine if a user existed. Would you say this is a fair >> (albeit) dumbed down!!) synopsis of sockets and their purpose? > Your mention of 'socket listen' and 'master' auth sockets suggests you > are using Dovecot 1.x. That description is pretty-much correct for 1.x, > however you should upgrade to 2.x as soon as you reasonably can, since > 1.x is no longer supported. See http://wiki2.dovecot.org/Services#auth > for a description of the socket types available with Dovecot 2. > > [The statement there that 'client' sockets can safely be exposed to the > entire world, including over inet sockets, is not entirely true. AFAIK > there is no rate limiting, so an exposed 'client' socket is a password > oracle and should therefore be somewhat protected. The risk is > approximately equivalent to an unshadowed password file, with the > encrypted passwords exposed.] > > Ben > From brong at fastmail.fm Fri Dec 21 10:43:55 2012 From: brong at fastmail.fm (Bron Gondwana) Date: Fri, 21 Dec 2012 09:43:55 +0100 Subject: [Dovecot] Non-dovecot user looking for feedback In-Reply-To: References: <0FCA5F60-8758-400E-8988-054018DB36F4@distal.com> <3084200369644457166@unknownmsgid> Message-ID: <1356079435.23703.140661168747061.77A5911B@webmail.messagingengine.com> God, that's ancient data for Cyrus. I should go update that. Cyrus 2.4.17 fails a couple of edge cases (searching for "" and some complex list-extended cases where we're not iterating both the mailboxes and subscriptions databases concurrently correctly). Cyrus git master only fails the list-extended. In other words, don't believe every wiki you read on the internet! Bron. On Tue, Dec 18, 2012, at 07:19 AM, Chris Ross wrote: > > Thank you for that. That mostly rules out Cyrus, as it seems much the lesser of Dovecot and UW-IMAP. > > But, it mostly just declares it's statements about accordance with the standards. While I appreciate that, I'm more interested in how it behaves with common mail clients. And, the note about dovecot Expunge Fetch says "depends on storage", but gives no more information. What sorts of storage options are available, and what the pros and cons of them are, was one of my original questions. > > Is there some "give me all the details to read through" document somewhere? What it does, it's capabilities, and how it does things? > > Thanks again to all for any help. > > - Chris > > On Dec 17, 2012, at 07:48 , David Morsberger wrote: > > > Check out: > > > > http://imapwiki.org/ImapTest/ServerStatus > > > > -- > > David Morsberger > > 301-758-7387 > > Sent from my iPhone > > > > On Dec 17, 2012, at 2:00 AM, Chris Ross wrote: > > > >> > >> I've been using UW-IMAPd for neigh on forever (at least since 2001). But, as it's basically stalled, and I'm about to update the hardware that is my mail server, I thought it was time to review existing open-source IMAP servers. Dovecot is the top three in my looking. > >> > >> The other of the top three candidates, because I know of people who've used it, is Cyrus IMAP. So, I should note that my thoughts are "uw-imapd, because I already know how to use it", "Cyrus, because someone I know/trust liked it years ago", and dovecot, because "it seems stable, professional, and to meet all of my needs". > >> > >> I guess the biggest question I have is how files/folders are stored in the filesystem. uw-imapd has a "mbx" format that all of my folders are in, and also has support for mbox and maildir (i think). mbx had some advantages for speed access, which would be unimportant I assume with dovecot's indexes, but IIRC there was also some reason the mbox format coped poorly with multiple clients accessing the same folder at the same time. > >> > >> So, am I right that dovecot supports only the "one big full file" mbox format, and the maildir format? And if so, is it known to allow multiple simultaneous IMAP clients to access and monitor and/or modify the same folder simultaneously? > >> > >> After those questions, it's just a "what do you think the pros and cons of each are?" I know asking in this forum, that I will get most if not all votes for Dovecot. And that's fine, as long as you have specific reasons why it would be better for someone with only a handful of users and minimal time available to administer the systems in question. > >> > >> Thanks! I appreciate any and all feedback. > >> > >> - Chris > >> > -- Bron Gondwana brong at fastmail.fm From doug at impalanetworks.com Fri Dec 21 11:18:51 2012 From: doug at impalanetworks.com (Douglas Mortensen) Date: Fri, 21 Dec 2012 02:18:51 -0700 Subject: [Dovecot] dovecot Digest, Vol 116, Issue 38 Message-ID: Austinator, What's the JLG maintenance schedule? I should show you how to setup a CW Service Template & then you can have it as a weekly ticket. :-) - Doug Mortensen Impala Networks Sent from my Windows Phone ________________________________ From: dovecot-request at dovecot.org Sent: ?12/?21/?2012 1:44 AM To: dovecot at dovecot.org Subject: dovecot Digest, Vol 116, Issue 38 Send dovecot mailing list submissions to dovecot at dovecot.org To subscribe or unsubscribe via the World Wide Web, visit http://dovecot.org/cgi-bin/mailman/listinfo/dovecot or, via email, send a message with subject or body 'help' to dovecot-request at dovecot.org You can reach the person managing the list at dovecot-owner at dovecot.org When replying, please edit your Subject line so it is more specific than "Re: Contents of dovecot digest..." From 24x7server at 24x7server.net Fri Dec 21 13:41:48 2012 From: 24x7server at 24x7server.net (Rajesh M) Date: Fri, 21 Dec 2012 17:11:48 +0530 (Asi) Subject: [Dovecot] migration to dovecot pop3 In-Reply-To: <50D35882.20209@pacific.net> References: <50D35882.20209@pacific.net> Message-ID: <.120.61.0.15.1356090108.squirrel@24x7server.net> > > > On 12/19/2012 6:59 PM, Joseph Tam wrote: >> Rajesh M writes: >> >>> i am planning to migrate from qmail pop3 to dovecot pop3 >>> >>> the number of users on the server is large over 5000 >>> ... >>> also data volume is large - over 3.5 tb -- ie many users several 1000s >>> of >>> emails in their inbox >> >> If you stay on the list, you might find some people here whose >> mail metrics are several orders of magnitude larger than this. >> >>> 1) will the migration cause all the emails on the server to re-download >>> ... >>> 4) has anybody migrated from qmail pop3 to dovecot pop3 successfully >>> without emails being downloaded again >> >> A proper migration will avoid this. Google is your friend >> >> http://lmgtfy.com/q=POP+qmail+to+dovecot+migration >> >> The top hits provide exactly what you're looking for. >> >>> 2) can dovecot be configured to allow only one download at a time - >>> pop3 >>> locking with time out setting that can be customized > > We migrated 5000+ from qpopper years ago. Dovecot is sooo much better on > system load. Yes, locking and timeouts are in the config file. > >>> >>> 3) can dovecot pop3 be configured so that it will allow download of >>> emails >>> only of the last say 15 days ie even if the same pop3 user is >>> configure on >>> another machine it will download only messages of the last 15 days > > That's not part of pop3, so no, it's not possible with dovecot alone. > You could probably work out a plugin to move read mail after x days, or > there may be one out there ? Or some imap robot could do it.. > Ken A. > Pacific.Net > > >> I can't answer this, but if this is an attempt to prevent mass download, >> the answer to 1+4 makes these questions irrelevant. >> >> Joseph Tam >> > > -- > Ken Anderson > Pacific Internet - http://www.pacific.net > Latest Pacific.Net Status - http://twitter.com/pacnetstatus > thanks joseph and ken for your replies ken, if possible can you please give me some more information concerning the servers that you use. i am using qmailtoaster my server has over 3 tb of data. Q1) which email server software are you using for your 5000+ users Q2) what is your server hardware configuration for handling 5000+ users Q3) do you users store several 1000's of emails in their inboxes. Q4) i want to try out by running dovecot pop3 on a separate port other than 110 while qmail toaster pop3 continues to run on port 110 and try downloading from specific a test mailbox. do you forsee any problems in this ? thank you once again for your kind help. rajesh From daniel.parthey at informatik.tu-chemnitz.de Fri Dec 21 14:15:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 21 Dec 2012 13:15:02 +0100 Subject: [Dovecot] Understanding Sockets In-Reply-To: <50D41FE3.2070505@titan21.co.uk> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> Message-ID: <20121221121502.GA3003@daniel.localdomain> Hi Tim, Tim Smith wrote: > I'm using an Ubuntu Server OS (10.04) and it seems that the latest > package they provide is 1.2.9. > > Do you know if anyone has had any success getting a Dovecot 2 > package on this Ubuntu distro and how they went about it (Not > comfortable compiling sources at this point!!)? We downloaded the ubuntu dovecot source package from packages.ubuntu.com and updated the dovecot tarball to a current 2.x version using the uupdate tool (comes with ubuntu). Then we replaced the pigeonhole directory with a current version from the pigeonhole tarball to fix some crashing bug regarding managesieve. With dch -i you can edit the changelog and increase package version or patchlevel. Finally build the deb packages with dpkg-buildpackage -b -uc -us Good luck, Daniel -- https://plus.google.com/103021802792276734820 From tim at titan21.co.uk Fri Dec 21 18:09:57 2012 From: tim at titan21.co.uk (Tim Smith) Date: Fri, 21 Dec 2012 16:09:57 +0000 Subject: [Dovecot] Understanding Sockets In-Reply-To: <20121221121502.GA3003@daniel.localdomain> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> <20121221121502.GA3003@daniel.localdomain> Message-ID: <50D489D5.1000506@titan21.co.uk> I'm a bit green around the gills with this kind of thing. I download the original source at http://packages.ubuntu.com/source/precise/mail/dovecot And the Pigeonhole source at http://pigeonhole.dovecot.org/download.html This is where I got stuck really - I wasn't sure how to integrate the pigeonhole source into the dovecot source. On 21/12/12 12:15, Daniel Parthey wrote: > Hi Tim, > > Tim Smith wrote: >> I'm using an Ubuntu Server OS (10.04) and it seems that the latest >> package they provide is 1.2.9. >> >> Do you know if anyone has had any success getting a Dovecot 2 >> package on this Ubuntu distro and how they went about it (Not >> comfortable compiling sources at this point!!)? > We downloaded the ubuntu dovecot source package from packages.ubuntu.com > and updated the dovecot tarball to a current 2.x version using the > uupdate tool (comes with ubuntu). > > Then we replaced the pigeonhole directory with a current > version from the pigeonhole tarball to fix some crashing > bug regarding managesieve. > > With dch -i you can edit the changelog and increase > package version or patchlevel. > > Finally build the deb packages with > dpkg-buildpackage -b -uc -us > > Good luck, > Daniel From daniel.parthey at informatik.tu-chemnitz.de Fri Dec 21 21:01:34 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 21 Dec 2012 20:01:34 +0100 Subject: [Dovecot] Building Dovecot 2.x on Ubuntu Hardy 10.04 In-Reply-To: <50D489D5.1000506@titan21.co.uk> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> <20121221121502.GA3003@daniel.localdomain> <50D489D5.1000506@titan21.co.uk> Message-ID: <20121221190134.GA4737@daniel.localdomain> Tim Smith wrote: > This is where I got stuck really - I wasn't sure how to integrate > the pigeonhole source into the dovecot source. > You extract the dovecot source package with dpkg-source -x dovecot*.dsc there should be a pigeonhole directory somewhere in the extracted dovecot-$VERSION directory. The old pigeonhole version is included in the dovecot*.diff of the ubuntu source package. Just untar the download from pigeonhole and replace the pigeonhole directory in the dovecot-$VERSION directory with the new pigeonhole directory from the download. In order to include current dovecot versions, you will need to run uupdate to integrate the new tarball into the package. See uupdate --help Then you can build the package as described in previous mails. Regards Daniel -- https://plus.google.com/103021802792276734820 From info at simonecaruso.com Sat Dec 22 03:21:08 2012 From: info at simonecaruso.com (Simone Caruso) Date: Sat, 22 Dec 2012 02:21:08 +0100 Subject: [Dovecot] [Antispam]rev 990a43d44c73 breaks compilation for dovecot 2.1 Message-ID: <50D50B04.4030408@simonecaruso.com> Dovecot 2.1.12 and antispam-plugin 0319240072d8 bash-# make Entering directory src. signature-log.c: In function 'signature_log_transaction_begin': signature-log.c:122: error: too many arguments to function 'dict_init' Failed to compile signature-log.c (plugin)! make[3]: *** [signature-log.plugin.o] Error 1 make[2]: *** [all] Error 2 make[1]: *** [src] Error 2 make: *** [all] Error 2 Reversing the deff the builing process ends with no error. -- Simone Caruso IT Consultant +39 349 65 90 805 From noel.butler at ausics.net Sat Dec 22 04:04:15 2012 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 22 Dec 2012 12:04:15 +1000 Subject: [Dovecot] Understanding Sockets In-Reply-To: <50D41FE3.2070505@titan21.co.uk> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> Message-ID: <1356141855.4162.18.camel@tardis> Why are people shit scared of abandoning these antiquated distro versions and using the "source" On Fri, 2012-12-21 at 08:37 +0000, Tim Smith wrote: > Thanks Ben, > > I'm using an Ubuntu Server OS (10.04) and it seems that the latest > package they provide is 1.2.9. > > Do you know if anyone has had any success getting a Dovecot 2 package on > this Ubuntu distro and how they went about it (Not comfortable compiling > sources at this point!!)? > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From h.reindl at thelounge.net Sat Dec 22 10:50:09 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 22 Dec 2012 09:50:09 +0100 Subject: [Dovecot] Understanding Sockets In-Reply-To: <1356141855.4162.18.camel@tardis> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> <1356141855.4162.18.camel@tardis> Message-ID: <50D57441.8040905@thelounge.net> because they are too lazy to lern how tu buld packages for their distribution which is at least for redhat-based distribution trivial it is no rocket science to take the existing source package, replace the tarball and after change some lines in the SPEC-fle rebuild on the other hand - Ubuntu Server OS (10.04) whoever installed this crap (sorry but ubuntu prdouction is a joke) knew that there wll be no upgrades because that is why LTS versions are there - you can not have both Am 22.12.2012 03:04, schrieb Noel Butler: > Why are people shit scared of abandoning these antiquated distro > versions and using the "source" > > On Fri, 2012-12-21 at 08:37 +0000, Tim Smith wrote: > >> Thanks Ben, >> >> I'm using an Ubuntu Server OS (10.04) and it seems that the latest >> package they provide is 1.2.9. >> >> Do you know if anyone has had any success getting a Dovecot 2 package on >> this Ubuntu distro and how they went about it (Not comfortable compiling >> sources at this point!!)? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From dovecot-list at puzzled.xs4all.nl Sat Dec 22 13:16:43 2012 From: dovecot-list at puzzled.xs4all.nl (Patrick Lists) Date: Sat, 22 Dec 2012 12:16:43 +0100 Subject: [Dovecot] Understanding Sockets In-Reply-To: <50D57441.8040905@thelounge.net> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> <1356141855.4162.18.camel@tardis> <50D57441.8040905@thelounge.net> Message-ID: <50D5969B.7090002@puzzled.xs4all.nl> On 12/22/2012 09:50 AM, Reindl Harald wrote: > because they are too lazy to lern how tu buld > packages for their distribution which is at > least for redhat-based distribution trivial Calling people lazy is a bit over the top now isn't it? The reason that organizations use Red Hat RHEL is, among other things, support. And Red Hat only supports what they ship. The ability to create an RPM of the latest version is not the issue. Loosing support for that piece of software because you rolled your own is. Regards, Patrick From h.reindl at thelounge.net Sat Dec 22 15:56:15 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 22 Dec 2012 14:56:15 +0100 Subject: [Dovecot] Understanding Sockets In-Reply-To: <50D5969B.7090002@puzzled.xs4all.nl> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> <1356141855.4162.18.camel@tardis> <50D57441.8040905@thelounge.net> <50D5969B.7090002@puzzled.xs4all.nl> Message-ID: <50D5BBFF.8080408@thelounge.net> Am 22.12.2012 12:16, schrieb Patrick Lists: > On 12/22/2012 09:50 AM, Reindl Harald wrote: >> because they are too lazy to lern how tu buld >> packages for their distribution which is at >> least for redhat-based distribution trivial > > Calling people lazy is a bit over the top now isn't it? The reason that organizations use Red Hat RHEL is, among > other things, support. And Red Hat only supports what they ship. The ability to create an RPM of the latest version > is not the issue. Loosing support for that piece of software because you rolled your own is. you missed the context of the question "where can i get a more recent build" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From h.reindl at thelounge.net Sat Dec 22 15:58:16 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 22 Dec 2012 14:58:16 +0100 Subject: [Dovecot] Understanding Sockets In-Reply-To: <50D5969B.7090002@puzzled.xs4all.nl> References: <50D38DD0.4080709@titan21.co.uk> <20121221002111.GA66720@anubis.morrow.me.uk> <50D41FE3.2070505@titan21.co.uk> <1356141855.4162.18.camel@tardis> <50D57441.8040905@thelounge.net> <50D5969B.7090002@puzzled.xs4all.nl> Message-ID: <50D5BC78.1050201@thelounge.net> Am 22.12.2012 12:16, schrieb Patrick Lists: > On 12/22/2012 09:50 AM, Reindl Harald wrote: >> because they are too lazy to lern how tu buld >> packages for their distribution which is at >> least for redhat-based distribution trivial > > Calling people lazy is a bit over the top now isn't it? The reason that organizations use Red Hat RHEL is, among > other things, support. And Red Hat only supports what they ship. The ability to create an RPM of the latest version > is not the issue. Loosing support for that piece of software because you rolled your own is besides the context "where can i get recenct binary builds?" so then they should call their paid support and leave us in peace with since years outdated versions nobody on the list is using -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From mitya at mageia.org Sun Dec 23 03:36:48 2012 From: mitya at mageia.org (Dimitri) Date: Sun, 23 Dec 2012 05:36:48 +0400 Subject: [Dovecot] Using -module flag on sieve libs Message-ID: <1356226608.3111.19.camel@localhost> Some modern distros (Mageia, Mandriva) use -no-undefined as a default linker flag for building software. However, undefined symbols are OK if the binary being linked is a plugin. To detect plugins, build system looks for presence of "-module" libtool flag in makefiles. There are two libraries in Pigeonhole that couldn't be linked with -no-undefined: src/lib-sieve/plugins/mailbox/libsieve_ext_mailbox.la src/lib-sieve/libdovecot-sieve.la These modules do contain undefined symbols, but they are not linked against library that provides them. It would be good if corresponding makefiles contained "-module" flags, so that build system could selectively turn off that -no-undefined linker flag. Please see proposed patch (attached). Thanks, Dimitri Mageia Linux packager -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-2.1-pigeonhole-0.3.3-module.patch Type: text/x-patch Size: 686 bytes Desc: not available URL: From mitya at mageia.org Sun Dec 23 03:37:18 2012 From: mitya at mageia.org (Dimitri) Date: Sun, 23 Dec 2012 05:37:18 +0400 Subject: [Dovecot] clucene-config.h location Message-ID: <1356226638.3111.20.camel@localhost> By deafult, CLucene installs the clucene-config.h header to /usr/lib/CLucene, but fts-lucene tries to include it from /usr/include/CLucene and fails. Here is how it is fixed in Fedora, for instance: sed -i '/DEFAULT_INCLUDES *=/s|$| '"$(pkg-config --cflags libclucene-core)|" src/plugins/fts-lucene/Makefile.in Indeed, Lucene's pkgconfig file reflects the fact that some headers reside in /usr/lib/CLucene. It would be great if Dovecot used pkgconfig for CLucene. Thanks, Dimitri Mageia Linux packager From stephan at rename-it.nl Sun Dec 23 11:39:05 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 23 Dec 2012 10:39:05 +0100 Subject: [Dovecot] Using -module flag on sieve libs In-Reply-To: <1356226608.3111.19.camel@localhost> References: <1356226608.3111.19.camel@localhost> Message-ID: <50D6D139.8070609@rename-it.nl> On 12/23/2012 2:36 AM, Dimitri wrote: > Some modern distros (Mageia, Mandriva) use -no-undefined as a default > linker flag for building software. However, undefined symbols are OK if > the binary being linked is a plugin. To detect plugins, build system > looks for presence of "-module" libtool flag in makefiles. > > There are two libraries in Pigeonhole that couldn't be linked with > -no-undefined: > > src/lib-sieve/plugins/mailbox/libsieve_ext_mailbox.la > src/lib-sieve/libdovecot-sieve.la > > These modules do contain undefined symbols, but they are not linked > against library that provides them. It would be good if corresponding > makefiles contained "-module" flags, so that build system could > selectively turn off that -no-undefined linker flag. Please see proposed > patch (attached). These are not plugins or modules. So this would likely be a bug. What version is this? Could you show me the errors? Any idea which libraries are missing? Regards, Stephan. From mitya at mageia.org Sun Dec 23 19:18:59 2012 From: mitya at mageia.org (Dimitri) Date: Sun, 23 Dec 2012 21:18:59 +0400 Subject: [Dovecot] Using -module flag on sieve libs In-Reply-To: <50D6D139.8070609@rename-it.nl> References: <1356226608.3111.19.camel@localhost> <50D6D139.8070609@rename-it.nl> Message-ID: <1356283139.3230.5.camel@localhost> > These are not plugins or modules. So this would likely be a bug. What > version is this? Could you show me the errors? Any idea which libraries > are missing? Dovecot 2.1.12 + Pigeonhole 0.3.3, Mageia Linux (Cauldron), GCC 4.7.2. Here is an excerpt from the build log (with Mageia's default flags, including -no-undefined): http://pastebin.com/bYqiYRKJ The library that is missing is /src/lib-storage/libdovecot-storage.la. Dimitri From fesarlis at gmail.com Sun Dec 23 21:27:28 2012 From: fesarlis at gmail.com (aristidis fesarlis) Date: Sun, 23 Dec 2012 21:27:28 +0200 Subject: [Dovecot] Dovecot 1.2.7 and Roundcube LIST-EXTENDED commands Message-ID: Hi all, we use Dovecot 1.2.7 with Maildir, and recently we have set up the latest Roundcube webmail. Inside its config file,it is mentioned that: // By default list of subscribed folders is determined using LIST-EXTENDED // extension if available. Some servers (dovecot 1.x) returns wrong results // for shared namespaces in this case. http://trac.roundcube.net/ticket/1486225 // Enable this option to force LSUB command usage instead. I notice that it seems to work fine, though. We don't have shared namespaces. So my question is: should I change it to LSUB, or will I have problems with my Maildir subscriptions? Thanks From tlhackque at yahoo.com Mon Dec 24 23:22:13 2012 From: tlhackque at yahoo.com (tlhackque) Date: Mon, 24 Dec 2012 16:22:13 -0500 Subject: [Dovecot] Undeserved permissions error with g+s folder permissions In-Reply-To: <1355863256.13277.54.camel@hurina> References: <50BA297E.4070104@yahoo.com> <1355855958.13277.11.camel@hurina> <50D0C063.1000501@yahoo.com> <1355863256.13277.54.camel@hurina> Message-ID: <50D8C785.4090601@yahoo.com> On 18-Dec-12 15:40, Timo Sirainen wrote: > On Tue, 2012-12-18 at 14:13 -0500, tlhackque wrote: >>>> Unable to rename across conflicting directory permisssions >>>> >>>> If I chmod g-s Vendors, the RENAME command succeeds. >> Thanks for looking at this! > .. >> dovecot --version >> 2.1.10 > Looks like this was fixed in v2.1.11. > > > Got an upgrade window and confirmed that this is fixed in 2.1.12. Thanks! -- This communication may not represent my employer's views, if any, on the matters discussed. From rgm at htt-consult.com Mon Dec 24 23:26:45 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Mon, 24 Dec 2012 16:26:45 -0500 Subject: [Dovecot] Postfix/mysql/dovecot - Understanding password encryption Message-ID: <50D8C895.8050802@htt-consult.com> I am switching from a fedora/postfix/mysql/couriermail/squirrelmail to Centos/.../dovecot/roundcubemail and adding postfixadmin to the mix. My tutorial before was an earlier version (on F14) of: http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 Now I am using http://www.campworld.net/thewiki/pmwiki.php/LinuxServersCentOS/Cent6VirtMailServer to get me started. I am up to roundcubemail setup and am stumbling to understand what the author here is doing with encrypted passwords, so felt it was time to delve deeper into this. My old setup uses mysql-crypt for the password. MYSQL_CRYPT_PWFIELD password and users could be added to the table with: INSERT INTO `users` (`email`, `password`, `quota`) VALUES ('sales at example.com', ENCRYPT('secret'), 10485760); But where this was all simple and no choices, I get to figure out what to do with my dovecot setup. Some of the 'secret' is hinted at in postfixadmin's config.inc.php: // Encrypt // In what way do you want the passwords to be crypted? // md5crypt = internal postfix admin md5 // md5 = md5 sum of the password // system = whatever you have set as your PHP system default // cleartext = clear text passwords (ouch!) // mysql_encrypt = useful for PAM integration // authlib = support for courier-authlib style passwords // dovecot:CRYPT-METHOD = use dovecotpw -s 'CRYPT-METHOD'. Example: dovecot:CRAM-MD5 $CONF['encrypt'] = 'md5crypt'; Where is there information on the different choices and how to choose. Is it as 'simple' as setting up postfixadmin to control the password encryption format then 'inform' dovecot in the dovecot-mysql.conf with default_pass_scheme = MD5-CRYPT Thank you for any pointers. From rgm at htt-consult.com Mon Dec 24 23:44:17 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Mon, 24 Dec 2012 16:44:17 -0500 Subject: [Dovecot] Postfix/mysql/dovecot - Understanding password encryption In-Reply-To: <50D8C895.8050802@htt-consult.com> References: <50D8C895.8050802@htt-consult.com> Message-ID: <50D8CCB1.20309@htt-consult.com> On 12/24/2012 04:26 PM, Robert Moskowitz wrote: > I am switching from a fedora/postfix/mysql/couriermail/squirrelmail to > Centos/.../dovecot/roundcubemail and adding postfixadmin to the mix. > > My tutorial before was an earlier version (on F14) of: > > http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 > > > Now I am using > > http://www.campworld.net/thewiki/pmwiki.php/LinuxServersCentOS/Cent6VirtMailServer > > > to get me started. I am up to roundcubemail setup and am stumbling to > understand what the author here is doing with encrypted passwords, so > felt it was time to delve deeper into this. > > My old setup uses mysql-crypt for the password. > > MYSQL_CRYPT_PWFIELD password > > and users could be added to the table with: > > INSERT INTO `users` (`email`, `password`, `quota`) VALUES > ('sales at example.com', ENCRYPT('secret'), 10485760); > > But where this was all simple and no choices, I get to figure out what > to do with my dovecot setup. > > Some of the 'secret' is hinted at in postfixadmin's config.inc.php: > > // Encrypt > // In what way do you want the passwords to be crypted? > // md5crypt = internal postfix admin md5 > // md5 = md5 sum of the password > // system = whatever you have set as your PHP system default > // cleartext = clear text passwords (ouch!) > // mysql_encrypt = useful for PAM integration > // authlib = support for courier-authlib style passwords > // dovecot:CRYPT-METHOD = use dovecotpw -s 'CRYPT-METHOD'. Example: > dovecot:CRAM-MD5 > $CONF['encrypt'] = 'md5crypt'; > > Where is there information on the different choices and how to choose. > > Is it as 'simple' as setting up postfixadmin to control the password > encryption format then 'inform' dovecot in the dovecot-mysql.conf with > > default_pass_scheme = MD5-CRYPT > Oh, the dovecot.conf has the line: auth_mechanisms = plain login Which adds to my confusion. From h.reindl at thelounge.net Mon Dec 24 23:54:39 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 24 Dec 2012 22:54:39 +0100 Subject: [Dovecot] Postfix/mysql/dovecot - Understanding password encryption In-Reply-To: <50D8CCB1.20309@htt-consult.com> References: <50D8C895.8050802@htt-consult.com> <50D8CCB1.20309@htt-consult.com> Message-ID: <50D8CF1F.3090801@thelounge.net> Am 24.12.2012 22:44, schrieb Robert Moskowitz: > > On 12/24/2012 04:26 PM, Robert Moskowitz wrote: >> I am switching from a fedora/postfix/mysql/couriermail/squirrelmail to Centos/.../dovecot/roundcubemail and >> adding postfixadmin to the mix. >> >> My tutorial before was an earlier version (on F14) of: >> >> http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 >> >> Now I am using >> >> http://www.campworld.net/thewiki/pmwiki.php/LinuxServersCentOS/Cent6VirtMailServer >> >> to get me started. I am up to roundcubemail setup and am stumbling to understand what the author here is doing >> with encrypted passwords, so felt it was time to delve deeper into this. >> >> My old setup uses mysql-crypt for the password. >> >> MYSQL_CRYPT_PWFIELD password >> >> and users could be added to the table with: >> >> INSERT INTO `users` (`email`, `password`, `quota`) VALUES ('sales at example.com', ENCRYPT('secret'), 10485760); >> >> But where this was all simple and no choices, I get to figure out what to do with my dovecot setup. >> >> Some of the 'secret' is hinted at in postfixadmin's config.inc.php: >> >> // Encrypt >> // In what way do you want the passwords to be crypted? >> // md5crypt = internal postfix admin md5 >> // md5 = md5 sum of the password >> // system = whatever you have set as your PHP system default >> // cleartext = clear text passwords (ouch!) >> // mysql_encrypt = useful for PAM integration >> // authlib = support for courier-authlib style passwords >> // dovecot:CRYPT-METHOD = use dovecotpw -s 'CRYPT-METHOD'. Example: dovecot:CRAM-MD5 >> $CONF['encrypt'] = 'md5crypt'; >> >> Where is there information on the different choices and how to choose. >> >> Is it as 'simple' as setting up postfixadmin to control the password encryption format then 'inform' dovecot in >> the dovecot-mysql.conf with >> >> default_pass_scheme = MD5-CRYPT >> > > Oh, the dovecot.conf has the line: > > auth_mechanisms = plain login > Which adds to my confusion. maybe you should read some basic documentations see the large bumber of your posts on dovecot/postfix list and that i was able to setup my first mailserver years ago with only reading the docs and subcribe for mailing-lists a year later it feels like you try to replace reading manuals with posting basic questions auth-mech = client/server start with * http://wiki.dovecot.org/ * http://wiki.dovecot.org/Authentication/Mechanisms * http://www.postfix.org/documentation.html >> // cleartext = clear text passwords (ouch!) if you want / need to provide different auth-mchs you may have no other option because the server will not be able to generate the data for CRAM-MD5/MD5-DIGEST from a hashed column this is also eplained here http://wiki.dovecot.org/Authentication/Mechanisms -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From rgm at htt-consult.com Tue Dec 25 04:03:40 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Mon, 24 Dec 2012 21:03:40 -0500 Subject: [Dovecot] Postfix/mysql/dovecot - Understanding password encryption In-Reply-To: <50D8CF1F.3090801@thelounge.net> References: <50D8C895.8050802@htt-consult.com> <50D8CCB1.20309@htt-consult.com> <50D8CF1F.3090801@thelounge.net> Message-ID: <50D9097C.4040903@htt-consult.com> On 12/24/2012 04:54 PM, Reindl Harald wrote: > > Am 24.12.2012 22:44, schrieb Robert Moskowitz: >> On 12/24/2012 04:26 PM, Robert Moskowitz wrote: >>> I am switching from a fedora/postfix/mysql/couriermail/squirrelmail to Centos/.../dovecot/roundcubemail and >>> adding postfixadmin to the mix. >>> >>> My tutorial before was an earlier version (on F14) of: >>> >>> http://www.howtoforge.com/virtual-users-and-domains-with-postfix-courier-mysql-and-squirrelmail-centos-6.2-x86_64 >>> >>> Now I am using >>> >>> http://www.campworld.net/thewiki/pmwiki.php/LinuxServersCentOS/Cent6VirtMailServer >>> >>> to get me started. I am up to roundcubemail setup and am stumbling to understand what the author here is doing >>> with encrypted passwords, so felt it was time to delve deeper into this. >>> >>> My old setup uses mysql-crypt for the password. >>> >>> MYSQL_CRYPT_PWFIELD password >>> >>> and users could be added to the table with: >>> >>> INSERT INTO `users` (`email`, `password`, `quota`) VALUES ('sales at example.com', ENCRYPT('secret'), 10485760); >>> >>> But where this was all simple and no choices, I get to figure out what to do with my dovecot setup. >>> >>> Some of the 'secret' is hinted at in postfixadmin's config.inc.php: >>> >>> // Encrypt >>> // In what way do you want the passwords to be crypted? >>> // md5crypt = internal postfix admin md5 >>> // md5 = md5 sum of the password >>> // system = whatever you have set as your PHP system default >>> // cleartext = clear text passwords (ouch!) >>> // mysql_encrypt = useful for PAM integration >>> // authlib = support for courier-authlib style passwords >>> // dovecot:CRYPT-METHOD = use dovecotpw -s 'CRYPT-METHOD'. Example: dovecot:CRAM-MD5 >>> $CONF['encrypt'] = 'md5crypt'; >>> >>> Where is there information on the different choices and how to choose. >>> >>> Is it as 'simple' as setting up postfixadmin to control the password encryption format then 'inform' dovecot in >>> the dovecot-mysql.conf with >>> >>> default_pass_scheme = MD5-CRYPT >>> >> Oh, the dovecot.conf has the line: >> >> auth_mechanisms = plain login >> Which adds to my confusion. > maybe you should read some basic documentations > see the large bumber of your posts on dovecot/postfix list > and that i was able to setup my first mailserver years ago > with only reading the docs and subcribe for mailing-lists > a year later it feels like you try to replace reading > manuals with posting basic questions With all due respect, the manuals have grown over the years. I have spent time over the past month going through the manuals and putting together notes. Then I have gone through a few tutorials to get some lessons learned from others. Some tools like postfixadmin do a lot more than what I need, so I am plowing through extra stuff. You ask, why use postfixadmin and not just build it from scratch? I have a few domains and others are responsible for those domains. The tool I used before was difficult for multiple admins. My reading on postfixadmin make rather attractive. Then follows a lot of other stuff. Challenge is, I can only put a couple hours a day in on this. Like many here I have other assignments. I do appreciate your help; I try to help (mostly on other lists) where I can. But my expertise in secure data communications is rather specialized. > > auth-mech = client/server > > start with > * http://wiki.dovecot.org/ > * http://wiki.dovecot.org/Authentication/Mechanisms > * http://www.postfix.org/documentation.html > >>> // cleartext = clear text passwords (ouch!) > if you want / need to provide different auth-mchs you may have > no other option because the server will not be able to generate > the data for CRAM-MD5/MD5-DIGEST from a hashed column > > this is also eplained here > http://wiki.dovecot.org/Authentication/Mechanisms > From fesarlis at gmail.com Tue Dec 25 06:49:10 2012 From: fesarlis at gmail.com (Aristidis Fesarlis) Date: Tue, 25 Dec 2012 06:49:10 +0200 Subject: [Dovecot] Dovecot 1.2.7 and Roundcube LIST-EXTENDED commands Message-ID: <50D93046.3040307@gmail.com> Anyone? From stephan at rename-it.nl Wed Dec 26 01:56:59 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 26 Dec 2012 00:56:59 +0100 Subject: [Dovecot] Using -module flag on sieve libs In-Reply-To: <1356283139.3230.5.camel@localhost> References: <1356226608.3111.19.camel@localhost> <50D6D139.8070609@rename-it.nl> <1356283139.3230.5.camel@localhost> Message-ID: <50DA3D4B.3010606@rename-it.nl> Op 12/23/2012 6:18 PM, Dimitri schreef: >> These are not plugins or modules. So this would likely be a bug. What >> version is this? Could you show me the errors? Any idea which libraries >> are missing? > Dovecot 2.1.12 + Pigeonhole 0.3.3, Mageia Linux (Cauldron), GCC 4.7.2. > > Here is an excerpt from the build log (with Mageia's default flags, > including -no-undefined): http://pastebin.com/bYqiYRKJ > > The library that is missing is > /src/lib-storage/libdovecot-storage.la. How does it work with this patch? diff -r fc0bf6b1cb6b src/lib-sieve/Makefile.am --- a/src/lib-sieve/Makefile.am Sat Dec 22 22:27:34 2012 +0100 +++ b/src/lib-sieve/Makefile.am Wed Dec 26 00:55:47 2012 +0100 @@ -70,8 +70,8 @@ $(extdir)/vnd.dovecot/duplicate/libsieve_ext_duplicate.la \ $(unfinished_plugins) -libdovecot_sieve_la_DEPENDENCIES = $(plugins) $(LIBDOVECOT_LDA_DEPS) -libdovecot_sieve_la_LIBADD = $(plugins) $(LIBDOVECOT) $(LIBDOVECOT_LDA) +libdovecot_sieve_la_DEPENDENCIES = $(plugins) $(LIBDOVECOT_LDA_DEPS) $(LIBDOVECOT_STORAGE_DEPS) $(LIBDOVECOT_DEPS) +libdovecot_sieve_la_LIBADD = $(plugins) $(LIBDOVECOT_LDA) $(LIBDOVECOT_STORAGE) $(LIBDOVECOT) libdovecot_sieve_la_SOURCES = \ rfc2822.c \ From mitya at mageia.org Wed Dec 26 03:05:16 2012 From: mitya at mageia.org (Dimitri) Date: Wed, 26 Dec 2012 05:05:16 +0400 Subject: [Dovecot] Using -module flag on sieve libs In-Reply-To: <50DA3D4B.3010606@rename-it.nl> References: <1356226608.3111.19.camel@localhost> <50D6D139.8070609@rename-it.nl> <1356283139.3230.5.camel@localhost> <50DA3D4B.3010606@rename-it.nl> Message-ID: <1356483916.1131.1.camel@localhost> > How does it work with this patch? Works like a charm (after replacing spaces with tabs)! Thank you! Dimitri From campee at gmail.com Wed Dec 26 04:26:27 2012 From: campee at gmail.com (Eric) Date: Tue, 25 Dec 2012 18:26:27 -0800 Subject: [Dovecot] dovecot crashing? Message-ID: Happy holidays! I am experiencing an issue when trying to check my mail using IMAP. with Dovecot I have tried checking my mail using a full GUI client (Thunderbird) and telnet. Both times I get disconnected before all of my messages can be downloaded and I see an error in my mail log. Here are the details: [root at cust19-1-prod-domain userqa]# dovecot --version 2.0.9 [root at cust19-1-prod-domain userqa]# dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-164.11.1.el5 x86_64 CentOS release 5.4 (Final) disable_plaintext_auth = no login_trusted_networks = 172.19.136.0 mail_location = maildir:~/Maildir mail_max_userip_connections = 100 mbox_write_locks = fcntl mmap_disable = yes passdb { args = scheme=plain username_format=%n /etc/dovecot/users driver = passwd-file } protocols = imap ssl = no userdb { args = username_format=%n /etc/dovecot/users driver = passwd-file } [root at cust19-1-prod-domain userqa]# i try to check my mail: username at ops1-1-domain:~$ telnet cust19-1-prod-domain imap Trying 172.19.136.223... Connected to cust19-1-prod-domain.domain.net (172.19.136.223). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 1 LOGIN userqa mypassword 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in 3 EXAMINE INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 1 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1356130761] UIDs valid * OK [UIDNEXT 5] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 3 OK [READ-ONLY] Select completed. 4 FETCH 1 BODY[] I get some binary output and some mail headers, but then it crashes.. Not sure if you guys want to see all of the extremely verbose output, so I put it at the end of this message. The last messages that it processes is a message with an Excel spreadsheet attached to it (a .xlsx file) i enabled core dumps: echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot Now I see this in /var/log/maillog: 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: service(imap): child 11265 killed with signal 11 (core dumped) core dumps are being written here, but they're empty: [root at cust19-1-prod-domain userqa]# pwd /mnt/mail/userqa [root at cust19-1-prod-domain userqa]# ls -lh total 20K -rw------- 1 userqa userqa 0 Dec 25 17:52 core.11111 -rw------- 1 userqa userqa 0 Dec 25 17:53 core.11265 -rw------- 1 userqa userqa 0 Dec 25 17:58 core.11812 drwx------ 7 userqa userqa 4.0K Dec 25 17:58 Maildir [root at cust19-1-prod-domain userqa]# What should I try now? Is it possible that Dovecot is having difficulty processing the attachment file? If I delete this user's mailbox file and send basic text e-mail to the user I can read/retrieve them just fine.. there only seems to be an issue when this message with its attachment arrives. The attachment seems small in size: Content-Disposition: attachment; filename="report_amex.xlsx"; size=20527; That means the attachment is 20527 bytes, correct? Thank you for any suggestions/help you can offer! Here's the message that it seems to be having issues with: Return-Path: Received: from mxout.mailprovider.com (slb1-prod-domain.domain.net[172.19.136.4]) by cust19-1-prod-domain.domain.net (8.13.8/8.13.8) with ESMTP id qBOM8oIE029715 for ; Mon, 24 Dec 2012 14:08:50 -0800 Received: from mxout.mailprovider.com (localhost [127.0.0.1]) by mxout.mailprovider.com (Postfix) with ESMTP id 017E455325B for ; Mon, 24 Dec 2012 17:08:51 -0500 (EST) X-Virus-Scanned: by SpamTitan at mail.lan Received: from HUB025.mail.lan (unknown [10.110.2.1]) by mxout.mailprovider.com (Postfix) with ESMTP id 63DA0553132 for ; Mon, 24 Dec 2012 17:08:50 -0500 (EST) Received: from MAILR001.mail.lan ([10.110.18.28]) by HUB025.mail.lan ([10.110.17.25]) with mapi; Mon, 24 Dec 2012 17:08:48 -0500 From: User Name To: "userqa_2938 at integration.company.com" Date: Mon, 24 Dec 2012 17:08:47 -0500 Subject: Thread-Index: Ac3fx0lCAoza6rTzQTSh8g52mx84GwAC2GGwAAH1lkAAkiyekA== Message-ID: <0370E60157CA7E4097D81B9E09728A941CB269A29D at MAILR001.mail.lan> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/mixed; boundary="_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" MIME-Version: 1.0 --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ Content-Type: multipart/alternative; boundary="_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable From: User Name Sent: Friday, December 21, 2012 6:23 PM To: 'userqa_2938 at integration.company.com' Subject: FW: With Best Regards, User Name From: User Name Sent: Friday, December 21, 2012 5:27 PM To: 'userqa_2938 at integration.company.com' Subject: FW: With Best Regards, User Name From: User Name Sent: Friday, December 21, 2012 4:05 PM To: 'userqa_2938 at integration.company.com' Subject: With Best Regards, User Name --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

 

 

With Best Regards,

User Name

______________________= _

s= kype: user

cell phone: +1 224 600 0072

 

From: User Name
Sent: Friday, Dec= ember 21, 2012 6:23 PM
To: 'userqa_2938 at integration.aggregateknow= ledge.com'
Subject: FW:

 

 

With Best Regards,

User Name

_______________________

skype: eg= irik

cell phone: +1 224 600 0072

 

=

From: User Name
Sent: Friday, December 21, = 2012 5:27 PM
To: 'userqa_2938 at integration.company.com'=
Subject: FW:

 

 

With Best Regards,

User Name

_______________________

skype: user<= /o:p>

cell pho= ne: +1 224 600 0072

 

From: User Name
Sent: Friday, December 21, 2012 4:0= 5 PM
To: 'userqa_2938 at integration.company.com'
S= ubject:

&nb= sp;

 

 

With Best Regards,

User Name

______= _________________

skype: user

cell phone: +1 224 600 0072

 

= --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="report_company.xlsx" Content-Description: report_company.xlsx Content-Disposition: attachment; filename="report_company.xlsx"; size=20527; creation-date="Thu, 11 Oct 2012 22:38:14 GMT"; modification-date="Mon, 24 Dec 2012 22:08:22 GMT" Content-Transfer-Encoding: base64 UEsDBBQABgAIAAAAIQDretKTYgEAAJAEAAATANwBW0NvbnRlbnRfVHlwZXNdLnhtbCCi2AEooAAC AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAArFTLTsMwELwj8Q+RryhxywEh1LQHHkeoBHyAsTeNVce2vNvS/j2bhFaASqSq vSSKop2ZnRl7Mts0LltDQht8KcbFSGTgdTDWL0rx/vaU34oMSXmjXPBQii2gmE0vLyZv2wiY8bTH UtRE8U5K1DU0CosQwfOfKqRGEX+mhYxKL9UC5PVodCN18ASecmoxxHTywgKSNZDNVaJn1TCP3DhJ jAb9c1wwnsju+8GWuxQqRme1IlYu1978Yc1DVVkNJuhVw1xFB3bVosh/CZG2DvBkKowJlMEagBpX 9KA75geo1MpR9rhhB3rTEzg8brVvMwue7NbH2kYcYBj2btiTz5CWHyEsz+1K607RKOt3ug+VgNOb pxBRctYnC4DWcgMmjwwJiSzsPTvEzQVsd+9iRNm9Tm/h72rs8Yc8YB1YqwTmlRKfyrPX8yf2kI59 FjokOD6MXWfb6QMJyO4+mX4BAAD//wMAUEsDBBQABgAIAAAAIQC1VTAj9QAAAEwCAAALAM4BX3Jl bHMvLnJlbHMgosoBKKAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADlDAAAeGwv c3R5bGVzLnhtbFBLAQItABQABgAIAAAAIQDppiW4ggYAAFMbAAATAAAAAAAAAAAAAAAAALIUAAB4 bC90aGVtZS90aGVtZTEueG1sUEsBAi0AFAAGAAgAAAAhAOhJXyi8LAAAyx8BABgAAAAAAAAAAAAA AAAAZRsAAHhsL3dvcmtzaGVldHMvc2hlZXQxLnhtbFBLAQItABQABgAIAAAAIQAU45/9UAEAAGMC AAARAAAAAAAAAAAAAAAAAFdIAABkb2NQcm9wcy9jb3JlLnhtbFBLAQItABQABgAIAAAAIQBxujxc hQEAAAMDAAAQAAAAAAAAAAAAAAAAAN5KAABkb2NQcm9wcy9hcHAueG1sUEsFBgAAAAAKAAoAgAIA AJlNAAAAAA== --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- Connection closed by foreign host. From lazy404 at gmail.com Wed Dec 26 22:01:25 2012 From: lazy404 at gmail.com (Lazy) Date: Wed, 26 Dec 2012 21:01:25 +0100 Subject: [Dovecot] 2 node dovecot Message-ID: Hi, We run dovecot 2.1 on 2 nodes with shared nfs storage. Index files are kept on local disk. Second node is usually used only for email snapshots access. If primary node fails it is configured to take place of the primary imap server. Snapshots are additional namespaces with mail from various points in time. We need a way to easly copy multiple messages from snapshots to current mailboxes. It would be best to make current mailbox available as another namespace so one would simply copy messages from one folder to another. Is it safe ? There will be times when given user is writing to the same nfs based Maildir mailbox from 2 nodes both of them having separate index files. What will happen if already present message gets copied back from the snapshot ? Regards, Micha? Grz?dzicki From rgm at htt-consult.com Thu Dec 27 20:28:19 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Thu, 27 Dec 2012 13:28:19 -0500 Subject: [Dovecot] dovecot testinstallation does not tell how to quit Message-ID: <50DC9343.1000903@htt-consult.com> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing Dovecot login, and sure enough I found some at: wiki.dovecot.org/Testinstallation Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the wiki! Oh, I just guessed it: a logout From h.reindl at thelounge.net Thu Dec 27 20:33:31 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 27 Dec 2012 19:33:31 +0100 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DC9343.1000903@htt-consult.com> References: <50DC9343.1000903@htt-consult.com> Message-ID: <50DC947B.1080701@thelounge.net> Am 27.12.2012 19:28, schrieb Robert Moskowitz: > I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing > Dovecot login, and sure enough I found some at: > > wiki.dovecot.org/Testinstallation > > Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about > how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the > wiki! > > Oh, I just guessed it: > > a logout google "imap quit telnet session" leads to http://www.yuki-onna.co.uk/email/imap.html -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From rgm at htt-consult.com Thu Dec 27 21:38:46 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Thu, 27 Dec 2012 14:38:46 -0500 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DC947B.1080701@thelounge.net> References: <50DC9343.1000903@htt-consult.com> <50DC947B.1080701@thelounge.net> Message-ID: <50DCA3C6.8080607@htt-consult.com> On 12/27/2012 01:33 PM, Reindl Harald wrote: > > Am 27.12.2012 19:28, schrieb Robert Moskowitz: >> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing >> Dovecot login, and sure enough I found some at: >> >> wiki.dovecot.org/Testinstallation >> >> Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about >> how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the >> wiki! >> >> Oh, I just guessed it: >> >> a logout > google "imap quit telnet session" leads to > http://www.yuki-onna.co.uk/email/imap.html > So there you have c logout and I got a logout to work as well. But I might think that a testing doc can include this little tidbit, rather than do yet another search. Since this is a Dovecot test doc, I also might think it would have POP3 testing instructions! But I was happy to find the IMAP. Now to figure out why RoundCube fails to login with the same user that I logged in via Telnet. Thanks for the pointer. From janfrode at tanso.net Thu Dec 27 23:17:49 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 27 Dec 2012 22:17:49 +0100 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? Message-ID: I'm preparing to set up a new set of directors on dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. Will it be OK to set up a ring of directors with 2x dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? -jf From tss at iki.fi Fri Dec 28 03:02:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 28 Dec 2012 03:02:54 +0200 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? In-Reply-To: References: Message-ID: On 27.12.2012, at 23.17, Jan-Frode Myklebust wrote: > I'm preparing to set up a new set of directors on > dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. > Will it be OK to set up a ring of directors with 2x > dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? The new v2.1 director code can handle running with old v2.1 directors (there were some protocol changes that improve things). I think v2.0 director is protocol compatible with the old v2.1 directors, so I think in theory it should work.. But it's definitely not ever been tested in practise, and v2.1 did fix a ton of director bugs. So if you end up testing it, I think you should be ready to quicky upgrade the other director as well if any errors show up in logs. From dave at morsberger.com Fri Dec 28 05:28:21 2012 From: dave at morsberger.com (David Morsberger) Date: Thu, 27 Dec 2012 22:28:21 -0500 Subject: [Dovecot] Missing Emails Message-ID: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again. Help!!!! This is a company email server. They live and die by their emails. Emails show up in inbox and then disappear. Anyone know why our emails are disappearing? I see a reference to it in the dovecot.index.cache file (last item) ^@^@^@Q^@^@^@0^@^@^@^@^@^@^@Message-ID: <1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> ^@^@^@^M^@^@^@7^@^@^@4^@^@^@^@^@^@^@Subject: Funeral program for Eileen Zbignewich ^@^E^@^@^@^@^@^@^@^F^@^@^@Z^@^@^@7^@^@^@^@^@^@^@Content-Type: multipart/mixed; boundary="-1578497492-264297203-1356660917=:93498" ^@^@^G^@^@^@4^@^@^@1^@^@^@^@^@^@^@Date: Thu, 27 Dec 2012 18:15:17 -0800 (PST) ^@^@^@^@^@^@^@^K^@^@^@^@^@^@^@^L^@^@^@^@^@^@^@^N^@^@^@8^@^@^@5^@^@^@^@^@^@^@To: "info at mmpcrofton.com" I searched the filesystem and cannot find them. bash-3.2# find . -exec grep Zbignewich {} \; -print Dec 04 00:30:26 master: Info: Dovecot v2.0.19apple1 starting up (core dumps disabled) I believe I turned on all debug and info messages. Here is what I see in postfix log: Dec 27 21:15:39 mini.mmpcrofton.com postfix/smtpd[20081]: 3CE164F4420: client=pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:39 mini.mmpcrofton.com postfix/cleanup[20086]: 3CE164F4420: message-id=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: from=, size=307659, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20081]: disconnect from pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: connect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: 5168E4F4447: client=localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/cleanup[20086]: 5168E4F4447: message-id=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: disconnect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: from=, size=308299, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtp[20102]: 3CE164F4420: to=, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.85/0.01/0/0.27, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 5168E4F4447) Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: removed Dec 27 21:15:40 mini.mmpcrofton.com postfix/pipe[20110]: 5168E4F4447: to=, orig_to=, relay=dovecot, delay=0.39, delays=0.03/0.01/0/0.35, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 27 21:15:41 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: removed dovecot_info.log Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: msgid=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com>: saved mail to INBOX Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: push notification enabled Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: notify: graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: data sent: 1680 dovecot_debug.log Dec 27 21:15:40 lda: Debug: Loading modules from directory: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib10_quota_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_fts_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_push_notify_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_zlib_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib21_fts_sk_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib90_sieve_plugin.so Dec 27 21:15:40 lda: Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota=maildir:User quota:noenforcing Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=0 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Effective uid=214, gid=6, home= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args=noenforcing Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: maildir++: root=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, index=, control=, inbox=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: none: root=, index=, control=, inbox=, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts_sk: Disabled with in-memory indexes Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts: No backends enabled by the fts setting Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Destination address: graphicartist at mini.mmpcrofton.com (source: user at hostname) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user's script path /Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve doesn't exist (using global script path in stead) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user has no valid personal script Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: no scripts to execute: reverting to default delivery. Anyone know why our emails are disappearing? From sven at svenhartge.de Fri Dec 28 05:54:19 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 28 Dec 2012 04:54:19 +0100 Subject: [Dovecot] Missing Emails References: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> Message-ID: <09clpmsmvov8@mids.svenhartge.de> David Morsberger wrote: > I reported a problem with disappearing emails on my Apple Mountain > Lion server. Not sure if it ever stopped but I do know it is happening > again. > Help!!!! This is a company email server. They live and die by their > emails. > Emails show up in inbox and then disappear. > Anyone know why our emails are disappearing? You should configure the mail_log plugin to log all actions clients do to your mails: http://wiki2.dovecot.org/Plugins/MailLog I've had to debug similar problems in the past time (on a different IMAP server) and in _all_ cases it was something the user did, like having a client downloading the mails via POP3 (and forgetting about this) and complaining about missing mails from "the Webmailer Website". Or having configured a filter inside Thunderbird (and forgetting about this), instructing the client to delete mails matching a special rule. > I see a reference to it in the dovecot.index.cache file (last item) If there is a reference in this file, the mail must have reached dovecot. So the next step would be to find out, _what exactly_ the client does with it. See mail_log again. Gr??e, Sven. -- Sigmentation fault. Core dumped. From dave at morsberger.com Fri Dec 28 06:40:55 2012 From: dave at morsberger.com (David Morsberger) Date: Thu, 27 Dec 2012 23:40:55 -0500 Subject: [Dovecot] Missing Emails In-Reply-To: <09clpmsmvov8@mids.svenhartge.de> References: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> <09clpmsmvov8@mids.svenhartge.de> Message-ID: <99C2001A-B076-4F90-BE4A-C91B6C54F99F@morsberger.com> Sven, Thanks for the response. 1. Nobody should be using pop3. The missing email appears to be random. I believe pop downloads would delete them all. I have now turned off pop3. 2. Would a mail rule place it in the 'Trash'? I did not find the email on the file system. I'm trying a wider search. 3. I followed the instructions on the wiki but it still doesn't appear to be logging everything. conf.d/10-logging.conf # Log file to use for informational messages. Defaults to log_path. #info_log_path = info_log_path = /Library/Logs/Mail/dovecot_info.log # Log file to use for debug messages. Defaults to info_log_path. debug_log_path = /Library/Logs/Mail/dovecot_debug.log mail_plugins = $mail_plugins mail_log notify plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. mail_log_fields = uid box msgid size from subject size flags } I am not seeing messages of the following form in the dovecot_debug.log or dovecot_info.log imap(user): copy -> Trash: uid=908, msgid=<123.foo at bar> imap(user): deleted: uid=908, msgid=<123.foo at bar> imap(user): expunged: uid=908, msgid=<123.foo at bar> On Dec 27, 2012, at 10:54 PM, Sven Hartge wrote: > David Morsberger wrote: > >> I reported a problem with disappearing emails on my Apple Mountain >> Lion server. Not sure if it ever stopped but I do know it is happening >> again. > >> Help!!!! This is a company email server. They live and die by their >> emails. > >> Emails show up in inbox and then disappear. > >> Anyone know why our emails are disappearing? > > You should configure the mail_log plugin to log all actions clients do > to your mails: http://wiki2.dovecot.org/Plugins/MailLog > > I've had to debug similar problems in the past time (on a different IMAP > server) and in _all_ cases it was something the user did, like having a > client downloading the mails via POP3 (and forgetting about this) and > complaining about missing mails from "the Webmailer Website". Or having > configured a filter inside Thunderbird (and forgetting about this), > instructing the client to delete mails matching a special rule. > >> I see a reference to it in the dovecot.index.cache file (last item) > > If there is a reference in this file, the mail must have reached > dovecot. So the next step would be to find out, _what exactly_ the > client does with it. See mail_log again. > > Gr??e, > Sven. > > -- > Sigmentation fault. Core dumped. > From campee at gmail.com Fri Dec 28 07:21:38 2012 From: campee at gmail.com (Eric) Date: Thu, 27 Dec 2012 21:21:38 -0800 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: Message-ID: Can anyone help with this? On Tue, Dec 25, 2012 at 6:26 PM, Eric wrote: > Happy holidays! I am experiencing an issue when trying to check my mail > using IMAP. with Dovecot I have tried checking my mail using a full GUI > client (Thunderbird) and telnet. Both times I get disconnected before all > of my messages can be downloaded and I see an error in my mail log. Here > are the details: > > > [root at cust19-1-prod-domain userqa]# dovecot --version > 2.0.9 > > [root at cust19-1-prod-domain userqa]# dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.18-164.11.1.el5 x86_64 CentOS release 5.4 (Final) > disable_plaintext_auth = no > login_trusted_networks = 172.19.136.0 > mail_location = maildir:~/Maildir > mail_max_userip_connections = 100 > mbox_write_locks = fcntl > mmap_disable = yes > passdb { > args = scheme=plain username_format=%n /etc/dovecot/users > driver = passwd-file > } > protocols = imap > ssl = no > userdb { > args = username_format=%n /etc/dovecot/users > driver = passwd-file > } > [root at cust19-1-prod-domain userqa]# > > i try to check my mail: > > username at ops1-1-domain:~$ telnet cust19-1-prod-domain imap > Trying 172.19.136.223... > Connected to cust19-1-prod-domain.domain.net (172.19.136.223). > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > AUTH=PLAIN] Dovecot ready. > > 1 LOGIN userqa mypassword > 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT > CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC > ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in > > 3 EXAMINE INBOX > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) > * OK [PERMANENTFLAGS ()] Read-only mailbox. > * 1 EXISTS > * 0 RECENT > * OK [UNSEEN 1] First unseen. > * OK [UIDVALIDITY 1356130761] UIDs valid > * OK [UIDNEXT 5] Predicted next UID > * OK [HIGHESTMODSEQ 1] Highest > 3 OK [READ-ONLY] Select completed. > > 4 FETCH 1 BODY[] > > I get some binary output and some mail headers, but then it crashes.. > > Not sure if you guys want to see all of the extremely verbose output, so I > put it at the end of this message. The last messages that it processes is a > message with an Excel spreadsheet attached to it (a .xlsx file) > > i enabled core dumps: > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot > > Now I see this in /var/log/maillog: > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > service(imap): child 11265 killed with signal 11 (core dumped) > > core dumps are being written here, but they're empty: > > [root at cust19-1-prod-domain userqa]# pwd > /mnt/mail/userqa > [root at cust19-1-prod-domain userqa]# ls -lh > total 20K > -rw------- 1 userqa userqa 0 Dec 25 17:52 core.11111 > -rw------- 1 userqa userqa 0 Dec 25 17:53 core.11265 > -rw------- 1 userqa userqa 0 Dec 25 17:58 core.11812 > drwx------ 7 userqa userqa 4.0K Dec 25 17:58 Maildir > [root at cust19-1-prod-domain userqa]# > > What should I try now? Is it possible that Dovecot is having difficulty > processing the attachment file? If I delete this user's mailbox file and > send basic text e-mail to the user I can read/retrieve them just fine.. > there only seems to be an issue when this message with its attachment > arrives. The attachment seems small in size: > > Content-Disposition: attachment; filename="report_amex.xlsx"; size=20527; > > > That means the attachment is 20527 bytes, correct? > > Thank you for any suggestions/help you can offer! > > > Here's the message that it seems to be having issues with: > > Return-Path: > Received: from mxout.mailprovider.com (slb1-prod-domain.domain.net[172.19.136.4]) > by cust19-1-prod-domain.domain.net (8.13.8/8.13.8) with ESMTP id > qBOM8oIE029715 > for ; Mon, 24 Dec 2012 14:08:50 > -0800 > Received: from mxout.mailprovider.com (localhost [127.0.0.1]) > by mxout.mailprovider.com (Postfix) with ESMTP id 017E455325B > for ; Mon, 24 Dec 2012 17:08:51 > -0500 (EST) > X-Virus-Scanned: by SpamTitan at mail.lan > Received: from HUB025.mail.lan (unknown [10.110.2.1]) > by mxout.mailprovider.com (Postfix) with ESMTP id 63DA0553132 > for ; Mon, 24 Dec 2012 17:08:50 > -0500 (EST) > Received: from MAILR001.mail.lan ([10.110.18.28]) by HUB025.mail.lan > ([10.110.17.25]) with mapi; Mon, 24 Dec 2012 17:08:48 -0500 > From: User Name > To: "userqa_2938 at integration.company.com" > > Date: Mon, 24 Dec 2012 17:08:47 -0500 > Subject: > Thread-Index: Ac3fx0lCAoza6rTzQTSh8g52mx84GwAC2GGwAAH1lkAAkiyekA== > Message-ID: <0370E60157CA7E4097D81B9E09728A941CB269A29D at MAILR001.mail.lan> > Accept-Language: en-US > Content-Language: en-US > X-MS-Has-Attach: yes > X-MS-TNEF-Correlator: > acceptlanguage: en-US > Content-Type: multipart/mixed; > > boundary="_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" > MIME-Version: 1.0 > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: multipart/alternative; > > boundary="_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: text/plain; charset="us-ascii" > Content-Transfer-Encoding: quoted-printable > > From: User Name > Sent: Friday, December 21, 2012 6:23 PM > To: 'userqa_2938 at integration.company.com' > Subject: FW: > > > With Best Regards, > User Name > > From: User Name > Sent: Friday, December 21, 2012 5:27 PM > To: 'userqa_2938 at integration.company.com' > Subject: FW: > > > With Best Regards, > User Name > > From: User Name > Sent: Friday, December 21, 2012 4:05 PM > To: 'userqa_2938 at integration.company.com' > Subject: > > > > With Best Regards, > User Name > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: text/html; charset="us-ascii" > Content-Transfer-Encoding: quoted-printable > > xmlns:o=3D"urn:schemas-micr= > osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" > = > xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" > xmlns=3D"http:= > //www.w3.org/TR/REC-html40"> CONTENT= > =3D"text/html; charset=3Dus-ascii"> content=3D"Micros= > oft Word 12 (filtered medium)"> vli= > nk=3Dpurple>

style=3D'c= > olor:#1F497D'> 

=3D'color:#1F497D'> 

class=3DMsoNormal> pan style=3D'color:#1F497D'>With Best Regards,

clas= > s=3DMsoNormal>User Name p>

style=3D'color:#1F497D'>______________________= > _

style=3D'color:#1F497D'>s= > kype: user

:#1F497D'>cell phone: +1 224 600 0072

=3DMsoNormal> style=3D'color:#1F497D'> 

>
0in= > 0in 0in'>

style=3D'font-size:10.0pt;font-fami= > ly:"Tahoma","sans-serif"'>From: style=3D'font-size:10.0pt;f= > ont-family:"Tahoma","sans-serif"'> User Name
Sent: Friday, Dec= > ember 21, 2012 6:23 PM
To: 'userqa_2938 at integration.aggregateknow > = > ledge.com'
Subject: FW:

clas= > s=3DMsoNormal> 

style=3D'colo= > r:#1F497D'> 

styl= > e=3D'color:#1F497D'>With Best Regards,

class=3DMsoN= > ormal>User Name

ss=3DMsoNormal> style=3D'color:#1F497D'>_______________________ o:p>

skype: > eg= > irik

style=3D'color:#1F497D= > '>cell phone: +1 224 600 0072

class=3DMsoNorm= > al> 

styl= > e=3D'border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in > 0in'>= >

style=3D'font-size:10.0pt;font-family:"Tahoma= > ","sans-serif"'>From: style=3D'font-size:10.0pt;font-family= > :"Tahoma","sans-serif"'> User Name
Sent: Friday, December 21, = > 2012 5:27 PM
To: 'userqa_2938 at integration.company.com'= >
Subject: FW:

class=3DMsoNor= > mal> 

style=3D'color:#1F497D'= > > 

style=3D'color= > :#1F497D'>With Best Regards,

class=3DMsoNormal> n style=3D'color:#1F497D'>User Name

rmal> style=3D'color:#1F497D'>_______________________ >

skype: user<= > /o:p>

cell > pho= > ne: +1 224 600 0072

s= > tyle=3D'color:#1F497D'> 

style=3D'borde= > r:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>

=3DMsoNormal> style=3D'font-size:10.0pt;font-family:"Tahoma","sans-= > serif"'>From: style=3D'font-size:10.0pt;font-family:"Tahoma= > ","sans-serif"'> User Name
Sent: Friday, December 21, 2012 4:0= > 5 PM
To: 'userqa_2938 at integration.company.com'
S= > ubject:

class=3DMsoNormal>&nb= > sp;

 

class=3DMsoNormal= > > 

With Best > Regards, >

User Name

______= > _________________

skype: user p>

cell phone: +1 224 600 0072

cla= > ss=3DMsoNormal> 

= > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: > application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; > name="report_company.xlsx" > Content-Description: report_company.xlsx > Content-Disposition: attachment; filename="report_company.xlsx"; > size=20527; > creation-date="Thu, 11 Oct 2012 22:38:14 GMT"; > modification-date="Mon, 24 Dec 2012 22:08:22 GMT" > Content-Transfer-Encoding: base64 > > > UEsDBBQABgAIAAAAIQDretKTYgEAAJAEAAATANwBW0NvbnRlbnRfVHlwZXNdLnhtbCCi2AEooAAC > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAArFTLTsMwELwj8Q+RryhxywEh1LQHHkeoBHyAsTeNVce2vNvS/j2bhFaASqSq > > vSSKop2ZnRl7Mts0LltDQht8KcbFSGTgdTDWL0rx/vaU34oMSXmjXPBQii2gmE0vLyZv2wiY8bTH > > UtRE8U5K1DU0CosQwfOfKqRGEX+mhYxKL9UC5PVodCN18ASecmoxxHTywgKSNZDNVaJn1TCP3DhJ > > jAb9c1wwnsju+8GWuxQqRme1IlYu1978Yc1DVVkNJuhVw1xFB3bVosh/CZG2DvBkKowJlMEagBpX > > 9KA75geo1MpR9rhhB3rTEzg8brVvMwue7NbH2kYcYBj2btiTz5CWHyEsz+1K607RKOt3ug+VgNOb > > pxBRctYnC4DWcgMmjwwJiSzsPTvEzQVsd+9iRNm9Tm/h72rs8Yc8YB1YqwTmlRKfyrPX8yf2kI59 > > FjokOD6MXWfb6QMJyO4+mX4BAAD//wMAUEsDBBQABgAIAAAAIQC1VTAj9QAAAEwCAAALAM4BX3Jl > > bHMvLnJlbHMgosoBKKAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADlDAAAeGwv > > c3R5bGVzLnhtbFBLAQItABQABgAIAAAAIQDppiW4ggYAAFMbAAATAAAAAAAAAAAAAAAAALIUAAB4 > > bC90aGVtZS90aGVtZTEueG1sUEsBAi0AFAAGAAgAAAAhAOhJXyi8LAAAyx8BABgAAAAAAAAAAAAA > > AAAAZRsAAHhsL3dvcmtzaGVldHMvc2hlZXQxLnhtbFBLAQItABQABgAIAAAAIQAU45/9UAEAAGMC > > AAARAAAAAAAAAAAAAAAAAFdIAABkb2NQcm9wcy9jb3JlLnhtbFBLAQItABQABgAIAAAAIQBxujxc > > hQEAAAMDAAAQAAAAAAAAAAAAAAAAAN5KAABkb2NQcm9wcy9hcHAueG1sUEsFBgAAAAAKAAoAgAIA > AJlNAAAAAA== > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- > Connection closed by foreign host. > > > From kamath at moltingpenguin.com Fri Dec 28 08:11:26 2012 From: kamath at moltingpenguin.com (Sean Kamath) Date: Thu, 27 Dec 2012 22:11:26 -0800 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DCA3C6.8080607@htt-consult.com> References: <50DC9343.1000903@htt-consult.com> <50DC947B.1080701@thelounge.net> <50DCA3C6.8080607@htt-consult.com> Message-ID: <411FD36C-D6F6-4EBF-9DD4-DB9B56800EC1@moltingpenguin.com> On Dec 27, 2012, at 11:38 AM, Robert Moskowitz wrote: > > On 12/27/2012 01:33 PM, Reindl Harald wrote: >> >> Am 27.12.2012 19:28, schrieb Robert Moskowitz: >>> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing >>> Dovecot login, and sure enough I found some at: >>> >>> wiki.dovecot.org/Testinstallation >>> >>> Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about >>> how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the >>> wiki! >>> >>> Oh, I just guessed it: >>> >>> a logout >> google "imap quit telnet session" leads to >> http://www.yuki-onna.co.uk/email/imap.html >> > So there you have > > c logout > > and I got > > a logout > > to work as well. Almost any identifier before the 'logout' will work. IMAP protocol uses a tagged command structure, so that commands can be interleaved and replies will respond with the identifier provided. I usually use '1 logout'. Note identifiers can be reused as well ;-) Sean PS At least it's now in the mail archives. :-) > But I might think that a testing doc can include this little tidbit, rather than do yet another search. Since this is a Dovecot test doc, I also might think it would have POP3 testing instructions! But I was happy to find the IMAP. Now to figure out why RoundCube fails to login with the same user that I logged in via Telnet. > > Thanks for the pointer. > > From pj.netfilter at gmail.com Fri Dec 28 09:58:26 2012 From: pj.netfilter at gmail.com (Joy) Date: Fri, 28 Dec 2012 13:28:26 +0530 Subject: [Dovecot] Help Regarding Multiple Base DN Message-ID: Dear Expert, Can i specify multiple Base DN for user lookup in dovecot like :- dc=abc,dc=com dc=abc,dc=net dc=xzy,dc=com dc=xyz,dc=net Thanks From janfrode at tanso.net Fri Dec 28 13:43:00 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 12:43:00 +0100 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? In-Reply-To: References: Message-ID: On Fri, Dec 28, 2012 at 2:02 AM, Timo Sirainen wrote: > > The new v2.1 director code can handle running with old v2.1 directors (there were some protocol changes that improve things). I think v2.0 director is protocol compatible with the old v2.1 directors, so I think in theory it should work.. But it's definitely not ever been tested in practise, and v2.1 did fix a ton of director bugs. So if you end up testing it, I think you should be ready to quicky upgrade the other director as well if any errors show up in logs. > Ok, I don't think I want to test this -- realistic testing is too hard. I'll rather upgrade the old directors (keeping same ip-addresses), so that I quickly can rollback in case something doesn't work as well as expected. BTW: What's the status of LMTP proxying in v2.1 (or more specifically dovecot-ee-2.1.10.3-1)? Do you know of many users of it, and has it proven itself much better than v2.0.14 ? I intend to upgrade the directors first, and leave the backend servers running v2.0.14 for a while.. that should be OK, right ? -jf From janfrode at tanso.net Fri Dec 28 13:51:14 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 12:51:14 +0100 Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: Don't know if having multiple Base DNs can work, but you can use %variables in it. We use this one to be able to have a simple onelevel scope on all lookups: base = ou=people,o=%d,o=ISP,o=example,c=com scope = onelevel -jf From janfrode at tanso.net Fri Dec 28 14:04:43 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 13:04:43 +0100 Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: Just checked the Variables documentation http://wiki2.dovecot.org/Variables, which says: %D - return "sub.domain.org" as "sub,dc=domain,dc=org" (for LDAP queries) so it seems* you should be able to use "base = %D" [*] assuming the wiki meant to say "dc=sub,dc=domain,dc=org" -jf From tomislav.mihalicek at gmail.com Fri Dec 28 13:41:44 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Fri, 28 Dec 2012 03:41:44 -0800 (PST) Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: <1356694904082-39423.post@n4.nabble.com> You can use multiple databases http://wiki2.dovecot.org/Authentication/MultipleDatabases -- View this message in context: http://dovecot.2317879.n4.nabble.com/Help-Regarding-Multiple-Base-DN-tp39422p39423.html Sent from the Dovecot mailing list archive at Nabble.com. From a.miederhoefer at gmx.de Fri Dec 28 14:17:56 2012 From: a.miederhoefer at gmx.de (=?iso-8859-1?Q?=22Antje_Miederh=F6fer=22?=) Date: Fri, 28 Dec 2012 13:17:56 +0100 Subject: [Dovecot] dovecot 2.1.12 panic in mbox-sync.c Message-ID: <20121228121756.22540@gmx.net> Hello! I use dovecot 2.1.12 locally on a 32bit Linux with an ext4 filesystem and after deleting a lot of emails from a mbox folder, I now get the following messages in the log: dovecot: imap(amied): Panic: file mbox-sync.c: line 1351 (mbox_sync_handle_eof_updates): assertion failed: (offset == 0 || offset > 31) dovecot: imap(amied): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4559a) [0x6f68959a] -> /usr/lib/dovecot/libdovecot.so.0(+0x45611) [0x6f689611] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x6f658fa0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x2d707) [0x6f708707] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_sync+0x53) [0x6f7091d3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_storage_sync_init+0x6d) [0x6f70936d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x3b) [0x6f72333b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3f) [0x6f72347f] -> dovecot/imap(cmd_select_full+0x16b) [0x805529b] -> dovecot/imap(cmd_select+0x17) [0x8055c57] -> dovecot/imap(command_exec+0x32) [0x80596f2] -> dovecot/imap() [0x80586fd] -> dovecot/imap() [0x805880d] -> dovecot/imap(client_handle_input+0x125) [0x8058a05] -> dovecot/imap(client_input+0x60) [0x80592f0] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x44) [0x6f6981f4] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xce) [0x6f6991ce] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x6f697cd0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2e) [0x6f680dbe] -> dovecot/imap(main+0x279) [0x804fdd9] -> /lib/libc.so.6(__libc_start_main+0xf5) [0x6f49bad5] -> dovecot/imap() [0x804ff51] The mbox file seems to be unchanged and a .lock file remains even after stopping dovecot. The folder is not accessible any more. A fix would be nice. :-) dovecot config: listen = 127.0.0.1 mail_fsync = never mail_location = maildir:/var/mails/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = no location = mbox:/var/mails/mbox/%u prefix = mbox/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = * driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap ssl_cert = Hi, we are currently moving our mailserver to a new server with Dovecot, virtual users in LDAP, Passwords in Kerberos Setup. Everything works fine except for GSSAPI which seems to be a bit buggy. The thing is, that when using a .k5login [1] file it seems that SASL does not get passed the home directory specified userdb. In other words, mails for user1 (see below) are stored in /home/domain.at/user1, while the home dir defined in LDAP is /afs/domain.at/home/user1 (virtual users, so only dovecot, not the system does know about this user and home dir). If I do create a .k5login file in /home/domain.at/user1 with the content "someotheruser at DOMAIN.AT", then someotheruser should be able to authenticate himself as user1 via GSSAPI. However, this .k5login file is completely ignored. So it seems to me that the home is not passed on to SASL. If I do add ldap to my nsswitch (for testing only) I additionally have real system users. Now if I create a .k5login in their home defined in LDAP which now also the system knows about everything works just fine. It is still the wrong home since its the one in LDAP and not the one defined by dovecot but at least it shows that our setup is working. See also debug log output below, a failed GSSAPI attempt produces no log output at all. Our System is Debian Wheezy on an amd64 (virtualized), dovecot Version 2.1.7, filesystem is ext4. Everything is tested with Firefox 17.0 on an Ubuntu Lucid client. Example LDAP user (not all of it...): ===================== dn: uid=user1,ou=people,dc=domain,dc=at structuralObjectClass: inetOrgPerson objectClass: inetOrgPerson objectClass: posixAccount objectClass: qmailUser uid: username uidNumber: 12345 gidNumber: 100 mail: username at domain.at homeDirectory: /afs/domain.at/home/user1 userPassword: {sasl}user1 at DOMAIN.AT And our dovecot userdb/passdb looks like this: ============================ root at mail201212 /etc/dovecot (git)-[master] # cat conf.d/10-auth.conf auth_gssapi_hostname = "$ALL" auth_krb5_keytab = /etc/dovecot/imap_smtp_mail201212.keytab auth_mechanisms = plain gssapi !include auth-virtual.conf.ext root at mail201212 /etc/dovecot (git)-[master] # cat conf.d/auth-virtual.conf.ext mail_uid = mailowner mail_gid = mailowner userdb { driver = ldap args = /etc/dovecot/ldap-userdb-user_g2.conf.ext } passdb { driver = pam } root at mail201212 /etc/dovecot (git)-[master] # cat /etc/dovecot/ldap-userdb-user_g2.conf.ext #http://www.postfix.org/ldap_table.5.html hosts = ldap1 ldap2 base = ou=people,dc=domain,dc=at user_attrs = uid=home=/home/domain.at/%$ user_filter = (&(objectClass=inetOrgPerson)(|(mail=%u)(mailalternateaddress=%u)(uid=%u))) Debug log output with system users (testing only) and a working GSSAPI auth: ================================================ Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_pgsql.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_sqlite.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: passwd-file /etc/dovecot/shared_users: Read 1 users in 0 secs Dec 28 14:18:40 mail201212 dovecot: auth: Debug: auth client connected (pid=11875) Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: AUTH#0111#011GSSAPI#011service=imap#011secured#011session=1RaMgOnRZADAqCoq#011lip=192.168.43.100#011rip=192.168.42.42#011lport=993#011rport=55140 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(?,192.168.42.42,<1RaMgOnRZADAqCoq>): Using all keytab entries Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(user1 at domain.at,192.168.42.42,<1RaMgOnRZADAqCoq>): security context state completed. Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011YIGZBgkqhkiG9xIBAgICAG+BiTCBhqADAgEFoQMCAQ+iejB4oAMCARKicQRvMQu0Yxgom2SVOHW25FpxDbqalw/8nuMN1XH78FJUzJ/7CIv9dlQNUrKjFywqS9kNOxQY2sJR 7Ii0hw3i7BGV3VPmoeRJOsbYD5ahBh74NKqxdacN6rLj/cO5vWCee6Oel3rPgLV8kEcOVZOdAt6y Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(user1 at domain.at,192.168.42.42,<1RaMgOnRZADAqCoq>): Negotiated security layer Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011BQQF/wAMAAAAAAAAC5QPNQH///+qs6lgevrvypjd1l4= Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: OK#0111#011user=user1 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: master in: REQUEST#0111935278081#01111875#0111#0118d08e90a585981154d7c045ca230b1f9 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: ldap(user1,192.168.42.42,<1RaMgOnRZADAqCoq>): user search: base=ou=people,dc=domain,dc=at scope=subtree filter=(&(objectClass=inetOrgPerson)(|(mail=user1)(mailalternateaddress=user1)(uid=user1))) fields=uid Dec 28 14:18:41 mail201212 dovecot: auth: Debug: ldap(user1,192.168.42.42,<1RaMgOnRZADAqCoq>): result: uid=user1 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: master out: USER#0111935278081#011user1#011home=/home/domain.at/user1 Dec 28 14:18:41 mail201212 dovecot: imap-login: Login: user=, method=GSSAPI, rip=192.168.42.42, lip=192.168.43.100, mpid=11878, TLS, session=<1RaMgOnRZADAqCoq> Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Effective uid=996, gid=997, home=/home/domain.at/user1 Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/maildir Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: maildir++: root=/home/domain.at/user1/maildir, index=, control=, inbox=/home/domain.at/user1/maildir, alt= Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Namespace : type=public, prefix=PublicLists/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/listcaptor/maildir/ Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: maildir++: root=/home/listcaptor/maildir, index=, control=, inbox=, alt= [1] http://web.mit.edu/kerberos/krb5-current/doc/user/user_config/k5login.html -- J?rg Herzinger - EDV Team GLOBAL 2000 - Friends of the Earth Austria Neustiftgasse 36, A-1070 Wien tel +43-699-14200030 Dieses Mail wurde mit Oekostrom und Opensource Software erstellt. From p.heinlein at heinlein-support.de Sat Dec 29 00:27:43 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Fri, 28 Dec 2012 23:27:43 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CC3381.1050608@hardwarefreak.com> References: <50CC2A64.30309@heinlein-support.de> <50CC3381.1050608@hardwarefreak.com> Message-ID: <50DE1CDF.8050902@heinlein-support.de> Am 15.12.2012 09:23, schrieb Stan Hoeppner:> On 12/15/2012 1:44 AM, Peer Heinlein wrote: >> But we're having much more then >> 30 TB of maildata and doing an fsck >> on huge partitions takes too much (down-) time for our mailsystem. > > Peer are you using NFS or a cluster filesystem? Linux on the hosts or > other? I don't understand the reason for the question. Even a NFS is based on a "real" filesystem that needs to be checked. So: Where's the difference?! But to answer your question: No, I'm using local Filesystems (and that's good!) and I'd absolutely avoid NFS or a ClusterFS for setups as big as this. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Sat Dec 29 00:35:53 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Fri, 28 Dec 2012 23:35:53 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CECA38.3070403@um.es> References: <50CC2A64.30309@heinlein-support.de> <50CECA38.3070403@um.es> Message-ID: <50DE1EC9.5070500@heinlein-support.de> Am 17.12.2012 08:31, schrieb Angel L. Mateo: >> But we're having much more then >> 30 TB of maildata and doing an fsck >> on huge partitions takes too much (down-) time for our mailsystem. >> > Wouldn't be easier just to split your users between different > filesystems? I mean having different altstorages, but not as you propose > but one for the half of your users and other for the other half. For sure we DO have users split up into several 5 TB-partitions. This helps a little, but not a lot. And it creates some extra work and some extra sources of errors: You'll need Symlinks on the "real" fs or a user-dependend storage path in LDAP. But anyway, those partitions are tooo big for short filesystem checks (or if you make them smaller, you'd have too many). And, anyway: As I explained I'm interested in zero-downtime-checks, which wouldn't work just with several partitions. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From mattk at kraner.us Sat Dec 29 03:27:08 2012 From: mattk at kraner.us (mattk at kraner.us) Date: Fri, 28 Dec 2012 19:27:08 -0600 Subject: [Dovecot] question Message-ID: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> I just install Dovecot and postfix. When I'm pull dovecot I see in the log that its checking for mail. if a put a test message locally on the server I can pull the message down to my cell phone and other computers. But when I try to a message from gmail or aol it doesn't come in to the server. it always bounces back to the place were I sent it from From simon.buongiorno at gmail.com Sat Dec 29 03:40:24 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Fri, 28 Dec 2012 20:40:24 -0500 Subject: [Dovecot] question In-Reply-To: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: On Dec 28, 2012 8:28 PM, wrote: > > I just install Dovecot and postfix. When I'm pull dovecot I see in the log > that its checking for mail. if a put a test message locally on the server > I can pull the message down to my cell phone and other computers. But when > I try to a message from gmail or aol it doesn't come in to the server. > > > it always bounces back to the place were I sent it from That would indicate a postfix issue since it would seem you are not getting mail from outside your network/host. But either way you'll need config and log files of you'd like real help. Simon From h.reindl at thelounge.net Sat Dec 29 03:44:52 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 29 Dec 2012 02:44:52 +0100 Subject: [Dovecot] question In-Reply-To: References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: <50DE4B14.2040502@thelounge.net> Am 29.12.2012 02:40, schrieb Simon Brereton: > On Dec 28, 2012 8:28 PM, wrote: >> >> I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> that its checking for mail. if a put a test message locally on the server >> I can pull the message down to my cell phone and other computers. But when >> I try to a message from gmail or aol it doesn't come in to the server. >> >> >> it always bounces back to the place were I sent it from > > That would indicate a postfix issue since it would seem you are not getting > mail from outside your network/host. > > But either way you'll need config and log files of you'd like real help without logs it is impossible to say anything at least we ned the content of the bounce since our glassball died what is the destination domain? is the server reachable from the internet? is the MX or at least A-record configured? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From martin.rabl at rablnet.de Sat Dec 29 04:41:15 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 03:41:15 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? Message-ID: <50DE584B.3020207@rablnet.de> Hi, yesterday I did an update from dovecot 1.2 to 2.0.19 (Ubuntu 10.04 -> 12.04). After fixing the configuration dovecot startups as it should, but with one error, I don't understand: the INBOX will not be delivered to the Mailclient and will not be filled by "deliver". Instead, dovecot create the two dirs "new" and "cur" directly in "Maildir". the filesystem looks now like: domain/user1/Maildir/INBOX # official INBOX domain/user1/Maildir/new # new mail domain/user1/Maildir/cur # read mail We have searched for an configuration error, but didn't found anything - or did not see one ;-) Maybe there is someone in the list, which see our error in a moment? We are using only imap/s and managesieve, no pop3. Maildir-Layout is FS. Here a snippet of our configuration: ------------ mail_home = mail_location = maildir:~/Maildir:LAYOUT=fs namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir/:INDEX=%%h/Maildir/shared/%u:LAYOUT=fs prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { list = yes location = maildir:/srv/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } protocol lda { mail_plugins = sieve autocreate } protocol imap { imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags mail_max_userip_connections = 10 mail_plugins = acl autocreate imap_acl } ------------ Hope you can help! Thank you! Martin From tss at iki.fi Sat Dec 29 04:47:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 29 Dec 2012 04:47:02 +0200 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: <50DE584B.3020207@rablnet.de> References: <50DE584B.3020207@rablnet.de> Message-ID: No idea how that worked with your previous configuration (I guess accidentally/unintentionally), but I guess you want this: mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs On 29.12.2012, at 4.41, Martin Rabl wrote: > Hi, > > yesterday I did an update from dovecot 1.2 to 2.0.19 (Ubuntu 10.04 -> 12.04). > After fixing the configuration dovecot startups as it should, but with one error, I don't understand: the INBOX will not be delivered to the Mailclient and will not be filled by "deliver". > Instead, dovecot create the two dirs "new" and "cur" directly in "Maildir". > > the filesystem looks now like: > domain/user1/Maildir/INBOX # official INBOX > domain/user1/Maildir/new # new mail > domain/user1/Maildir/cur # read mail > > We have searched for an configuration error, but didn't found anything - or did not see one ;-) > > Maybe there is someone in the list, which see our error in a moment? > > We are using only imap/s and managesieve, no pop3. Maildir-Layout is FS. > > Here a snippet of our configuration: > > ------------ > > mail_home = > mail_location = maildir:~/Maildir:LAYOUT=fs > > > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > list = yes > location = maildir:%%h/Maildir/:INDEX=%%h/Maildir/shared/%u:LAYOUT=fs > prefix = shared/%%u/ > separator = / > subscriptions = no > type = shared > } > namespace { > list = yes > location = maildir:/srv/vmail/public:LAYOUT=fs > prefix = public/ > separator = / > subscriptions = no > type = public > } > > protocol lda { > mail_plugins = sieve autocreate > } > protocol imap { > imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags > mail_max_userip_connections = 10 > mail_plugins = acl autocreate imap_acl > } > > ------------ > > Hope you can help! > > Thank you! > > Martin > From martin.rabl at rablnet.de Sat Dec 29 04:50:43 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 03:50:43 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: References: <50DE584B.3020207@rablnet.de> Message-ID: <50DE5A83.2050908@rablnet.de> Hi, Am 29.12.12 03:47, schrieb Timo Sirainen: > No idea how that worked with your previous configuration (I guess accidentally/unintentionally), but I guess you want this: that were the "bugfixes" ;-) > mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs Thank you, I give it a try. Greetings, Martin From martin.rabl at rablnet.de Sat Dec 29 05:23:40 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 04:23:40 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: <50DE5A83.2050908@rablnet.de> References: <50DE584B.3020207@rablnet.de> <50DE5A83.2050908@rablnet.de> Message-ID: <50DE623C.4070603@rablnet.de> Thank you Timo! Runs! It is to late for configuring ... ;-)) Greetings, Martin Am 29.12.12 03:50, schrieb Martin Rabl: > Hi, > > Am 29.12.12 03:47, schrieb Timo Sirainen: >> No idea how that worked with your previous configuration (I guess >> accidentally/unintentionally), but I guess you want this: > that were the "bugfixes" ;-) > >> mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs > Thank you, I give it a try. > > Greetings, > Martin > From kjonca at o2.pl Sat Dec 29 17:17:28 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 16:17:28 +0100 Subject: [Dovecot] lda crash? Message-ID: <87623ksx9z.fsf@alfa.kjonca> When I try to refilter some messages lda crash: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lda-log.txt URL: -------------- next part -------------- doveconf -n output -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot.confn Type: application/octet-stream Size: 1558 bytes Desc: not available URL: -------------- next part -------------- KJ -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Little known fact about Middle Earth: The Hobbits had a very sophisticated computer network! It was a Tolkien Ring... From kjonca at o2.pl Sat Dec 29 17:30:25 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 16:30:25 +0100 Subject: [Dovecot] lda crash? References: <87623ksx9z.fsf@alfa.kjonca> Message-ID: <87y5ggri3y.fsf@alfa.kjonca> kjonca at o2.pl (Kamil Jo?ca) writes: > When I try to refilter some messages lda crash: > KJ Sorry for wrong attachment in previoous post. -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lda-log.txt URL: -------------- next part -------------- -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Ditat Deus. [God enriches] From rs at sys4.de Sat Dec 29 18:09:42 2012 From: rs at sys4.de (Robert Schetterer) Date: Sat, 29 Dec 2012 17:09:42 +0100 Subject: [Dovecot] lda crash? In-Reply-To: <87623ksx9z.fsf@alfa.kjonca> References: <87623ksx9z.fsf@alfa.kjonca> Message-ID: <50DF15C6.4080600@sys4.de> Am 29.12.2012 16:17, schrieb Kamil Jo?ca: > include: sieve_global_dir is not set; have a look on this Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From kjonca at o2.pl Sat Dec 29 18:23:48 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 17:23:48 +0100 Subject: [Dovecot] lda crash? References: <87623ksx9z.fsf@alfa.kjonca> <50DF15C6.4080600@sys4.de> Message-ID: <87txr4rfmz.fsf@alfa.kjonca> Robert Schetterer writes: > Am 29.12.2012 16:17, schrieb Kamil Jo?ca: >> include: sieve_global_dir is not set; > have a look on this > No change after setting this parameter, lda crashes. KJ -- http://blogdebart.pl/2009/12/22/mamy-chorych-dzieci/ What we do not understand we do not possess. -- Goethe From rs at sys4.de Sat Dec 29 18:26:35 2012 From: rs at sys4.de (Robert Schetterer) Date: Sat, 29 Dec 2012 17:26:35 +0100 Subject: [Dovecot] lda crash? In-Reply-To: <87txr4rfmz.fsf@alfa.kjonca> References: <87623ksx9z.fsf@alfa.kjonca> <50DF15C6.4080600@sys4.de> <87txr4rfmz.fsf@alfa.kjonca> Message-ID: <50DF19BB.5020305@sys4.de> Am 29.12.2012 17:23, schrieb Kamil Jo?ca: > Robert Schetterer writes: > >> Am 29.12.2012 16:17, schrieb Kamil Jo?ca: >>> include: sieve_global_dir is not set; >> have a look on this >> > No change after setting this parameter, lda crashes. yeah, wait for other responses about your debug > > KJ > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From jtl+dovecot at uvm.edu Sat Dec 29 22:18:27 2012 From: jtl+dovecot at uvm.edu (Jim Lawson) Date: Sat, 29 Dec 2012 15:18:27 -0500 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: Message-ID: <50DF5013.8020507@uvm.edu> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Eric, On 12/25/12 9:26 PM, Eric wrote: > Happy holidays! I am experiencing an issue when trying to check my mail > using IMAP. with Dovecot I have tried checking my mail using a full GUI > client (Thunderbird) and telnet. Both times I get disconnected before all > of my messages can be downloaded and I see an error in my mail log. Here > are the details: > > > [root at cust19-1-prod-domain userqa]# dovecot --version > 2.0.9 There have been a lot of fixes since that version; can you confirm that this problem is not in 2.0.19 (or better yet, 2.1.12?) > i enabled core dumps: > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot Does that work? The point is to set "ulimit -c unlimited". I don't know what package you're using, but Dovecot doesn't ship with an init script (at least, 2.0.9 didn't.) The only thing I know of is at http://wiki.dovecot.org/DovecotInit, and that doesn't use /etc/sysconfig at all. > > > Now I see this in /var/log/maillog: > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > service(imap): child 11265 killed with signal 11 (core dumped) > > core dumps are being written here, but they're empty: If you're still getting core dumps with 2.0.19, check your setting of "ulimit -c". It should be "unlimited" for this case. You may need to modify /etc/init.d/dovecot. My guess is that your /etc/sysconfig/dovecot modification is having no effect. Jim -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQIcBAEBAgAGBQJQ31ASAAoJELUeD3oQ5ZpZkfIQAKEoVPO0Cldfec12WC/dGGoZ gdkZ10boxc+OoWP3Yhx4reWgIrvodaHaz7jxAhXGwasILXWRTP4vPxWCd77PjNNB JXGQpimCJZaFtcQ6PKONqqz7jqZ6zj07ZzKJeZXrSSxzmH7zrgAveA0xi3k+OGpr qCv60j4qlHEyw3I2FBDzO1GokpCbWS0Z3FDBUM1Zf5yFgRNSvt3FK9FQXejRwYnO vsNiMINO/Z5x8FLp0CfqbsQDnInAPPFV73UnGPVkFOpnswCytRX6ILNm2e9jIs9s G2qSalVOIATbgxnL1DkjLpex+gslJBrBqQy2lIeUv0GMxn/vMCw7dmxPAW+ankup qd1izm6iKUXEhnz7CKgh3FX3kp/W0ijvBKwDRqwzPCKkOTdLKkjygKzfxtfZE6Ay NFyeN21zorb+EZUmDtoQNxDT7iLKNf9dK0dZDY4xVU7KnyFbheppK0CUVsCUq1F0 oYggVUJXtT2rshVUocPjYFF56y+Hgi8a0rAWfi5j+qmD1eqTjKJcRbIdu9AhUkW+ OD4tqgMNRAW5Ry4HDdWVCaPnyzILL+p2g/ujKN9MV5m82DFOUWy+jiB5F5iXXc/r H2ywrPH/ko0WGnTi7inPQJQ3ecu0seJ+wkwFPYNAmbXSV1Fp0NReJA5Cn6m/PKEC 1OxYVGRIJdLlF99zxDMw =jurE -----END PGP SIGNATURE----- From mattk at kraner.us Sat Dec 29 22:46:56 2012 From: mattk at kraner.us (Matt K) Date: Sat, 29 Dec 2012 15:46:56 -0500 Subject: [Dovecot] question In-Reply-To: References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: <20121229204653.15A111AE87DB@dovecot.org> At 08:40 PM 12/28/2012, Simon Brereton wrote: >On Dec 28, 2012 8:28 PM, wrote: > > > > I just install Dovecot and postfix. When I'm pull dovecot I see in the log > > that its checking for mail. if a put a test message locally on the server > > I can pull the message down to my cell phone and other computers. But when > > I try to a message from gmail or aol it doesn't come in to the server. > > > > > > it always bounces back to the place were I sent it from > >That would indicate a postfix issue since it would seem you are not getting >mail from outside your network/host. > >But either way you'll need config and log files of you'd like real help. > >Simon here is what i was able to find in /var/log/mail.err Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms Dec 29 18:06:06 kraner postfix[27406]: fatal: usage: postfix [-c config_dir] [-Dv] command Dec 29 18:19:38 kraner postfix/smtpd[27511]: fatal: no SASL authentication mechanisms Dec 29 18:22:48 kraner postfix/smtpd[27514]: fatal: no SASL authentication mechanisms Dec 29 20:20:43 kraner postfix/smtpd[27862]: fatal: no SASL authentication mechanisms Dec 29 20:42:03 kraner postfix/smtpd[27969]: fatal: no SASL authentication mechanisms Postfix config file alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = regexp:/etc/postfix/body_checks command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/lib/postfix data_directory = /var/lib/postfix debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 header_checks = regexp:/etc/postfix/header_checks home_mailbox = Maildir/ inet_protocols = ipv4 local_recipient_maps = proxy:unix:passwd.byname $alias_maps mailbox_size_limit = 1073741824 mailq_path = /usr/bin/mailq message_size_limit = 10485760 mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain mydomain = kraner.org myhostname = kraner.org mynetworks = 127.0.0.0/8 myorigin = $mydomain newaliases_path = /usr/bin/newaliases sendmail_path = /usr/sbin/postfix setgid_group = postdrop smtpd_banner = $myhostname ESMTP $mail_name (@@DISTRO@@) smtpd_client_restrictions = permit_mynetworks,reject_unknown_client,permit smtpd_recipient_restrictions = permit_mynetworks,permit_auth_destination,permit_sasl_authenticated,reject smtpd_sasl_auth_enable = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot unknown_local_recipient_reject_code = 550 From h.reindl at thelounge.net Sat Dec 29 22:57:46 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 29 Dec 2012 21:57:46 +0100 Subject: [Dovecot] question In-Reply-To: <20121229204653.15A111AE87DB@dovecot.org> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> <20121229204653.15A111AE87DB@dovecot.org> Message-ID: <50DF594A.3060609@thelounge.net> Am 29.12.2012 21:46, schrieb Matt K: > At 08:40 PM 12/28/2012, Simon Brereton wrote: >> On Dec 28, 2012 8:28 PM, wrote: >> > >> > I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> > that its checking for mail. if a put a test message locally on the server >> > I can pull the message down to my cell phone and other computers. But when >> > I try to a message from gmail or aol it doesn't come in to the server. >> > >> > >> > it always bounces back to the place were I sent it from >> >> That would indicate a postfix issue since it would seem you are not getting >> mail from outside your network/host. >> >> But either way you'll need config and log files of you'd like real help. >> >> Simon > > here is what i was able to find in /var/log/mail.err > Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms > Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms > Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms > Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms > Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms and what is set in your dovecot.conf? does IMAP/POP3 work? auth_mechanisms = CRAM-MD5 DIGEST-MD5 APOP PLAIN LOGIN -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From simon.buongiorno at gmail.com Sat Dec 29 23:02:25 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Sat, 29 Dec 2012 16:02:25 -0500 Subject: [Dovecot] question In-Reply-To: <50df56bc.889c320a.4d8b.6eefSMTPIN_ADDED_MISSING@mx.google.com> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> <50df56bc.889c320a.4d8b.6eefSMTPIN_ADDED_MISSING@mx.google.com> Message-ID: On Dec 29, 2012 3:46 PM, "Matt K" wrote: > > At 08:40 PM 12/28/2012, Simon Brereton wrote: >> >> On Dec 28, 2012 8:28 PM, wrote: >> > >> > I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> > that its checking for mail. if a put a test message locally on the server >> > I can pull the message down to my cell phone and other computers. But when >> > I try to a message from gmail or aol it doesn't come in to the server. >> > >> > >> > it always bounces back to the place were I sent it from >> >> That would indicate a postfix issue since it would seem you are not getting >> mail from outside your network/host. >> >> But either way you'll need config and log files of you'd like real help. >> >> Simon > > > here is what i was able to find in /var/log/mail.err > Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms > Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms > Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms > Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms > Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms > Dec 29 18:06:06 kraner postfix[27406]: fatal: usage: postfix [-c config_dir] [-Dv] command > Dec 29 18:19:38 kraner postfix/smtpd[27511]: fatal: no SASL authentication mechanisms > Dec 29 18:22:48 kraner postfix/smtpd[27514]: fatal: no SASL authentication mechanisms > Dec 29 20:20:43 kraner postfix/smtpd[27862]: fatal: no SASL authentication mechanisms > Dec 29 20:42:03 kraner postfix/smtpd[27969]: fatal: no SASL authentication mechanisms > > Postfix config file > > alias_database = hash:/etc/aliases > alias_maps = hash:/etc/aliases > body_checks = regexp:/etc/postfix/body_checks > command_directory = /usr/sbin > config_directory = /etc/postfix > daemon_directory = /usr/lib/postfix > data_directory = /var/lib/postfix > debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 > header_checks = regexp:/etc/postfix/header_checks > home_mailbox = Maildir/ > inet_protocols = ipv4 > local_recipient_maps = proxy:unix:passwd.byname $alias_maps > mailbox_size_limit = 1073741824 > mailq_path = /usr/bin/mailq > message_size_limit = 10485760 > mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain > mydomain = kraner.org > myhostname = kraner.org > mynetworks = 127.0.0.0/8 > myorigin = $mydomain > newaliases_path = /usr/bin/newaliases > sendmail_path = /usr/sbin/postfix > setgid_group = postdrop > smtpd_banner = $myhostname ESMTP $mail_name (@@DISTRO@@) > smtpd_client_restrictions = permit_mynetworks,reject_unknown_client,permit > smtpd_recipient_restrictions = permit_mynetworks,permit_auth_destination,permit_sasl_authenticated,reject > smtpd_sasl_auth_enable = yes > smtpd_sasl_local_domain = $myhostname > smtpd_sasl_path = private/auth > smtpd_sasl_security_options = noanonymous > smtpd_sasl_type = dovecot > unknown_local_recipient_reject_code = 550 > fatal: no SASL authentication mechanisms is pretty clear. Postfix doesn't allow external hosts to connect & relay mail, which explains what you're seeing. Why you're seeing that is better addressed on the postfix list, although you seem to have told postfix to use Dovecot for sasl auth, so maybe, since this is the Dovecot list you should send your Dovecot conf so we can see why it's not working. Also, if you ask on the postfix list you will be asked for the out-put of postfinger which can diagnose sasl problems. Simon From campee at gmail.com Sun Dec 30 11:15:44 2012 From: campee at gmail.com (Eric) Date: Sun, 30 Dec 2012 01:15:44 -0800 Subject: [Dovecot] dovecot crashing? In-Reply-To: <50DF5013.8020507@uvm.edu> References: <50DF5013.8020507@uvm.edu> Message-ID: Isn't the version I have (2.0.9) newer than 2.0.19? The newest RPM I could find for CentOS was dovecot-2.0.9-2, not all that much newer than what I am using. I am not opposed to upgrading, just not sure if I am seeing much in the way of RPMs for my system that I can use to upgrade to a version that is much newer than what I already have. I had taken the " echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot" command from the Dovecot page on enabling core dumps for Red Hat (http://www.dovecot.org/bugreport.html). I have also added unlimited core dump files to /etc/security/limits.conf and verified that whenever myself or anyone else opens a shell that "ulimit -c" shows an output of "unlimited". I don't see any mention of limits in my Dovecot init file either. The init script came with my RPM package and I have not modified it. Even though I have unlimited core dump files allowed, I am still getting core files that are 0 bytes in size in the mail user's home directory. Any idea why? [root at imapserver ~]# su - dovecot -bash-3.2$ ulimit -c unlimited -bash-3.2$ id uid=97(dovecot) gid=97(dovecot) groups=97(dovecot) [root at imapserver ~]# service dovecot restart Stopping Dovecot Imap: [ OK ] Starting Dovecot Imap: [ OK ] $ telnet imapserver imap Trying 1.1.1.1... Connected to imapserver (1.1.1.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 1 LOGIN imapuser imapuserpassword 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTOR E QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in 2 select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1356130761] UIDs valid * OK [UIDNEXT 8] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 2 OK [READ-WRITE] Select completed. 3 FETCH 1 BODY[] * 1 FETCH (FLAGS (\Seen) BODY[] {39306} ..... some brief message output ..... Connection closed by foreign host. And then I get an empty core file: [root at imapserver]# pwd /mnt/mail/imapuser [root at imapserver]# ls -lh core* -rw------- 1 imapuser imapuser 0 Dec 30 00:56 core.7319 On Sat, Dec 29, 2012 at 12:18 PM, Jim Lawson wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Eric, > > On 12/25/12 9:26 PM, Eric wrote: > > Happy holidays! I am experiencing an issue when trying to check my mail > > using IMAP. with Dovecot I have tried checking my mail using a full GUI > > client (Thunderbird) and telnet. Both times I get disconnected before all > > of my messages can be downloaded and I see an error in my mail log. Here > > are the details: > > > > > > [root at cust19-1-prod-domain userqa]# dovecot --version > > 2.0.9 > > There have been a lot of fixes since that version; can you confirm that > this problem is not in 2.0.19 (or better yet, 2.1.12?) > > > > i enabled core dumps: > > > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot > > Does that work? The point is to set "ulimit -c unlimited". I don't > know what package you're using, but Dovecot doesn't ship with an init > script (at least, 2.0.9 didn't.) The only thing I know of is at > http://wiki.dovecot.org/DovecotInit, and that doesn't use /etc/sysconfig > at all. > > > > > > > > Now I see this in /var/log/maillog: > > > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > > service(imap): child 11265 killed with signal 11 (core dumped) > > > > core dumps are being written here, but they're empty: > > If you're still getting core dumps with 2.0.19, check your setting of > "ulimit -c". It should be "unlimited" for this case. You may need to > modify /etc/init.d/dovecot. My guess is that your > /etc/sysconfig/dovecot modification is having no effect. > > Jim > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.12 (Darwin) > Comment: Using GnuPG with undefined - http://www.enigmail.net/ > > iQIcBAEBAgAGBQJQ31ASAAoJELUeD3oQ5ZpZkfIQAKEoVPO0Cldfec12WC/dGGoZ > gdkZ10boxc+OoWP3Yhx4reWgIrvodaHaz7jxAhXGwasILXWRTP4vPxWCd77PjNNB > JXGQpimCJZaFtcQ6PKONqqz7jqZ6zj07ZzKJeZXrSSxzmH7zrgAveA0xi3k+OGpr > qCv60j4qlHEyw3I2FBDzO1GokpCbWS0Z3FDBUM1Zf5yFgRNSvt3FK9FQXejRwYnO > vsNiMINO/Z5x8FLp0CfqbsQDnInAPPFV73UnGPVkFOpnswCytRX6ILNm2e9jIs9s > G2qSalVOIATbgxnL1DkjLpex+gslJBrBqQy2lIeUv0GMxn/vMCw7dmxPAW+ankup > qd1izm6iKUXEhnz7CKgh3FX3kp/W0ijvBKwDRqwzPCKkOTdLKkjygKzfxtfZE6Ay > NFyeN21zorb+EZUmDtoQNxDT7iLKNf9dK0dZDY4xVU7KnyFbheppK0CUVsCUq1F0 > oYggVUJXtT2rshVUocPjYFF56y+Hgi8a0rAWfi5j+qmD1eqTjKJcRbIdu9AhUkW+ > OD4tqgMNRAW5Ry4HDdWVCaPnyzILL+p2g/ujKN9MV5m82DFOUWy+jiB5F5iXXc/r > H2ywrPH/ko0WGnTi7inPQJQ3ecu0seJ+wkwFPYNAmbXSV1Fp0NReJA5Cn6m/PKEC > 1OxYVGRIJdLlF99zxDMw > =jurE > -----END PGP SIGNATURE----- > > From h.reindl at thelounge.net Sun Dec 30 14:05:26 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 30 Dec 2012 13:05:26 +0100 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: <50DF5013.8020507@uvm.edu> Message-ID: <50E02E06.2060701@thelounge.net> Am 30.12.2012 10:15, schrieb Eric: > Isn't the version I have (2.0.9) newer than 2.0.19? since when is 9 greater than 19? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From jtl+dovecot at uvm.edu Sun Dec 30 16:19:29 2012 From: jtl+dovecot at uvm.edu (Jim Lawson) Date: Sun, 30 Dec 2012 09:19:29 -0500 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: <50DF5013.8020507@uvm.edu> Message-ID: <50E04D71.4070904@uvm.edu> On 12/30/12 4:15 AM, Eric wrote: > Isn't the version I have (2.0.9) newer than 2.0.19? The newest RPM I could find for CentOS was dovecot-2.0.9-2, not all that much newer than what I am using. I am not opposed to upgrading, just not sure if I am seeing much in the way of RPMs for my system that I can use to upgrade to a version that is much newer than what I already have. 2.0.19 is newer than 2.0.9. 2.1.12 is newer than that. You may have to take the spec file and rpmbuild your own RPM, if you want to stick with RPMs. > I had taken the " echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot" command from the Dovecot page on enabling core dumps for Red Hat (http://www.dovecot.org/bugreport.html). I have also added unlimited core dump files to /etc/security/limits.conf and verified that whenever myself or anyone else opens a shell that "ulimit -c" shows an output of "unlimited". > > I don't see any mention of limits in my Dovecot init file either. The init script came with my RPM package and I have not modified it. > > Even though I have unlimited core dump files allowed, I am still getting core files that are 0 bytes in size in the mail user's home directory. Any idea why? Check disk space on the filesystem where Dovecot is trying to dump? Is there some other reason it can't write there (but can create files) ? Jim -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 896 bytes Desc: OpenPGP digital signature URL: From bra at fsn.hu Sun Dec 30 23:32:48 2012 From: bra at fsn.hu (Attila Nagy) Date: Sun, 30 Dec 2012 22:32:48 +0100 Subject: [Dovecot] Non-standard fields? Message-ID: <50E0B300.3010900@fsn.hu> Hi, Non-standard fields are mentioned here: http://wiki2.dovecot.org/MailboxFormat/Maildir and they are stated as currently not used. Questions: - am I right that if they will be used, they will be key=value pairs, like fields in the base filename? Like: 1035478339.27041_118.foo.org,S=1000,W=1030:2,S,X=12,A=something - or are they supposed to be flags, like: 1035478339.27041_118.foo.org,S=1000,W=1030:2,S,ABCD - are there any plans to utilize these? Thanks, From ben at morrow.me.uk Mon Dec 31 02:26:57 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Mon, 31 Dec 2012 00:26:57 +0000 Subject: [Dovecot] Kerberos/GSSAPI auth via .k5login file In-Reply-To: <50DDB480.1070906@global2000.at> References: <50DDB480.1070906@global2000.at> Message-ID: <20121231002656.GA2428@anubis.morrow.me.uk> At 4PM +0100 on 28/12/12 you (J?rg Herzinger) wrote: > Hi, we are currently moving our mailserver to a new server with Dovecot, > virtual users in LDAP, Passwords in Kerberos Setup. Everything works > fine except for GSSAPI which seems to be a bit buggy. > > The thing is, that when using a .k5login [1] file it seems that SASL > does not get passed the home directory specified userdb. In other words, > mails for user1 (see below) are stored in /home/domain.at/user1, while > the home dir defined in LDAP is /afs/domain.at/home/user1 (virtual > users, so only dovecot, not the system does know about this user and > home dir). If I do create a .k5login file in /home/domain.at/user1 with > the content "someotheruser at DOMAIN.AT", then someotheruser should be able > to authenticate himself as user1 via GSSAPI. However, this .k5login file > is completely ignored. So it seems to me that the home is not passed on > to SASL. That is correct. Dovecot's handling of .k5login is currently implemented by calling your system's krb5_kuserok or equivalent with the name of the system user Dovecot will be using. This means it's not possible to use .k5login (or cross-realm auth, I would assume) unless you're using system users. I've been wondering for a while about patching Dovecot to support its own krb5 ACL file under the Dovecot directory, not least because it would be useful to be able to give a principal IMAP access without necessarily giving it shell access, but it's not entirely straightforward since currently Dovecot verifies the Kerberos creds before it even tries to look up the user in the userdb. (Actually I've been thinking along the lines of some sort of 'authdb', parallel to the pass- and userdbs, which would subsume both kuserok and the current master user stuff, but I haven't had a chance yet to try a concrete implementation.) Ben From chchai at acelsys.com Mon Dec 31 04:43:08 2012 From: chchai at acelsys.com (Ch Chai) Date: Mon, 31 Dec 2012 10:43:08 +0800 Subject: [Dovecot] Vacation Notice Not Working Message-ID: To Dovecot, When I try to active Vacation Notice using Egroupware, I can see (xxxx.sieve) generated in mail server. but not working. OS : Fedora 14 Installed Packages: - Postfix - Dovecot (2.0.15) note : come with Fedora 14 - Dovecot-pigeonhole (2.0.15) note: come with Fedora 14 - ispconfig 2 - Egroupware (Email Client) my setting in /etc/dovecot/dovecot.conf protocols = sieve imap pop3 plugin { plugin = sieve sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service managesieve-login { inet_listener managesieve-login { address = * port = 2000 } } protocol lda { #hostname = example.com mail_plugins = sieve quota postmaster_address = postmaster at example.com auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-deliver.log } protocol sieve { managesieve_implementation_string = Cyrus timsieved v2.2.13 managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } From daniel.parthey at informatik.tu-chemnitz.de Mon Dec 31 05:18:46 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 31 Dec 2012 04:18:46 +0100 Subject: [Dovecot] Vacation Notice Not Working In-Reply-To: References: Message-ID: <20121231031845.GA12712@daniel.localdomain> Ch Chai wrote: > When I try to active Vacation Notice using Egroupware, I can see (xxxx.sieve) generated in mail server. but not working. * Which sieve related lines can you see in your dovecot logfiles? * Is .dovecot.sieve correctly symlinked to xxxx.sieve? * Can you post the contents of the xxxx.sieve file? * Do you have the problem with vacation of a current www.tine20.org release? Regards Daniel -- https://plus.google.com/103021802792276734820 From dormitionskete at hotmail.com Mon Dec 31 05:19:31 2012 From: dormitionskete at hotmail.com (DormitionSkete@hotmail.com) Date: Sun, 30 Dec 2012 20:19:31 -0700 Subject: [Dovecot] Dovecot Virtual Users with Sendmail Message-ID: I'm trying to get Dovecot working with Virtual Users and Sendmail on OpenIndiana 151a7. OpenIndiana is the Open Source continuation of OpenSolaris after Oracle tried to kill it off a couple of years ago shortly after acquiring Sun Microsystems. I'm not sure if this is so much a Dovecot problem, as much of a Sendmail problem. I thought this would probably be a better list to start with, though. If not, please let me know. I initially used this Dovecot wiki page to approach this: Simple Virtual User Installation http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall I had to make few minor changes, but I don't think anything significant to the problem I'm having. I can log into SquirrelMail with both virtual users, and with system users. I can send mail to system users from both virtual and system users. I can see the mail that I sent in the Sent Messages folder for both types of users. I just can't send mail to virtual users. When I try to, I get the following message: ERROR: Message not sent. Server replied: Requested action not taken: mailbox unavailable 550 5.1.1 ... User unknown My configuration info is as follows: systemuser at openindiana:~# /usr/local/sbin/dovecot --version 2.1.12 systemuser at openindiana:~# /usr/local/sbin/dovecot -n # 2.1.12: /usr/local/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 101 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_location = mbox:/home/vmail/%u/mail:INBOX=/var/mail/%u passdb { args = /usr/local/etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } ssl = no userdb { args = uid=vmail gid=vmail home=/home/vmail/%u driver = static } protocol lda { postmaster_address = systemuser at localhost } --- My dovecot password file looks something like this, though changed for obvious security reasons: systemuser:{PLAIN} systemuserPASS virtualuser1:{PLAIN}virtualuser1PASS virtualuser2:{PLAIN}virtualuser2PASS --- I read on this page that I needed to put the following in my sendmail dovecot.m4 file: Dovecot LDA with Sendmail http://wiki2.dovecot.org/LDA/Sendmail So this is my dovecot.m4 file, which shows up in my sendmail.cf file after recompiling my sendmail.mc file. ######################*****############## ### DOVECOT Mailer specification ### ##################*****################## Mdovecot, P=/usr/local/libexec/dovecot/dovecot-lda, F=DFMPhnu9, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP/HdrFromSMTP, T=DNS/RFC822/X-Unix, A=/usr/local/libexec/dovecot/dovecot-lda -d $u --- Finally, this is my sendmail.mc file: divert(-1) # # Copyright (c) 1983 Eric P. Allman # Copyright (c) 1988, 1993 # The Regents of the University of California. All rights reserved. # # Copyright 2009 Sun Microsystems, Inc. All rights reserved. # Use is subject to license terms. # # This is a configuration file for SunOS 5.8 (a.k.a. Solaris 8) and later # subsidiary machines. It has support for local and SMTP mail. The # confFALLBACK_SMARTHOST macro is enabled, which means that messages will # be sent to that host (which is set to mailhost.$m [$m is the local domain]) # if MX records are unavailable. A short-cut rule is also defined, which # says if the recipient host is in the local domain, send to it directly # instead of the smart host. # # If you want to customize this further, copy it to a name appropriate # for your environment and do the modifications there. # divert(0)dnl VERSIONID(`sendmail.mc (Sun)') OSTYPE(`solaris8')dnl DOMAIN(`solaris-generic')dnl define(`confFALLBACK_SMARTHOST', `mailhost$?m.$m$.')dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl FEATURE(local_procmail,`',`procmail -t -Y -a $h -d $u')dnl MAILER(`local')dnl MAILER(`smtp')dnl MAILER(`procmail')dnl MAILER(`dovecot')dnl LOCAL_NET_CONFIG R$* < @ $* .$m. > $* $#esmtp $@ $2.$m $: $1 < @ $2.$m. > $3 --- I think it is obvious that it is a problem with Sendmail not recognizing Dovecot's virtual users. But how do I fix it? If anyone could help me with this, I would *greatly* appreciate it. I've been picking away at this for about three weeks now, and I'm pretty much out of ideas of anything else to try. Cordially, Peter, hieromonk ---- Dormition Skete Monastery Website: http://www.DormitionSkete.org Convent Website: http://www.HolyApostlesConvent.org ---- From m at sys4.de Mon Dec 31 05:23:25 2012 From: m at sys4.de (Marc Schiffbauer) Date: Mon, 31 Dec 2012 04:23:25 +0100 Subject: [Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more) Message-ID: <1839842.HpUryo95cv@bart> Hi all, I am having a problem indexing one of my mailboxes using the solr fts backend in dovecot 2.1.12 For many mailboxes it works just fine, but on one mailbox I currently always get a panic. solr setup: Java: icedtea 6.1.11.5 Solr: 3.6.2 running in tomcat 7.0.32 Command to reproduce error: doveadm index -u my at user badmailbox I already noticed that there have been some solr backend fixes just before 2.1.21 release... Is this another bug in the backend? Any idea? IMO relevant logs line parts: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) complete dovecot log: doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198: mismatched tag (near: Apache Tomcat/7.0.32-gentoo - Error report

 

 

With Best Regards,

User Name

______________________= _

s= kype: user

cell phone: +1 224 600 0072

 

From: User Name
Sent: Friday, Dec= ember 21, 2012 6:23 PM
To: 'userqa_2938 at integration.aggregateknow= ledge.com'
Subject: FW:

 

 

With Best Regards,

User Name

_______________________

skype: eg= irik

cell phone: +1 224 600 0072

 

=

From: User Name
Sent: Friday, December 21, = 2012 5:27 PM
To: 'userqa_2938 at integration.company.com'=
Subject: FW:

 

 

With Best Regards,

User Name

_______________________

skype: user<= /o:p>

cell pho= ne: +1 224 600 0072

 

From: User Name
Sent: Friday, December 21, 2012 4:0= 5 PM
To: 'userqa_2938 at integration.company.com'
S= ubject:

&nb= sp;

 

 

With Best Regards,

User Name

______= _________________

skype: user

cell phone: +1 224 600 0072

 

= --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="report_company.xlsx" Content-Description: report_company.xlsx Content-Disposition: attachment; filename="report_company.xlsx"; size=20527; creation-date="Thu, 11 Oct 2012 22:38:14 GMT"; modification-date="Mon, 24 Dec 2012 22:08:22 GMT" Content-Transfer-Encoding: base64 UEsDBBQABgAIAAAAIQDretKTYgEAAJAEAAATANwBW0NvbnRlbnRfVHlwZXNdLnhtbCCi2AEooAAC AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAArFTLTsMwELwj8Q+RryhxywEh1LQHHkeoBHyAsTeNVce2vNvS/j2bhFaASqSq vSSKop2ZnRl7Mts0LltDQht8KcbFSGTgdTDWL0rx/vaU34oMSXmjXPBQii2gmE0vLyZv2wiY8bTH UtRE8U5K1DU0CosQwfOfKqRGEX+mhYxKL9UC5PVodCN18ASecmoxxHTywgKSNZDNVaJn1TCP3DhJ jAb9c1wwnsju+8GWuxQqRme1IlYu1978Yc1DVVkNJuhVw1xFB3bVosh/CZG2DvBkKowJlMEagBpX 9KA75geo1MpR9rhhB3rTEzg8brVvMwue7NbH2kYcYBj2btiTz5CWHyEsz+1K607RKOt3ug+VgNOb pxBRctYnC4DWcgMmjwwJiSzsPTvEzQVsd+9iRNm9Tm/h72rs8Yc8YB1YqwTmlRKfyrPX8yf2kI59 FjokOD6MXWfb6QMJyO4+mX4BAAD//wMAUEsDBBQABgAIAAAAIQC1VTAj9QAAAEwCAAALAM4BX3Jl bHMvLnJlbHMgosoBKKAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADlDAAAeGwv c3R5bGVzLnhtbFBLAQItABQABgAIAAAAIQDppiW4ggYAAFMbAAATAAAAAAAAAAAAAAAAALIUAAB4 bC90aGVtZS90aGVtZTEueG1sUEsBAi0AFAAGAAgAAAAhAOhJXyi8LAAAyx8BABgAAAAAAAAAAAAA AAAAZRsAAHhsL3dvcmtzaGVldHMvc2hlZXQxLnhtbFBLAQItABQABgAIAAAAIQAU45/9UAEAAGMC AAARAAAAAAAAAAAAAAAAAFdIAABkb2NQcm9wcy9jb3JlLnhtbFBLAQItABQABgAIAAAAIQBxujxc hQEAAAMDAAAQAAAAAAAAAAAAAAAAAN5KAABkb2NQcm9wcy9hcHAueG1sUEsFBgAAAAAKAAoAgAIA AJlNAAAAAA== --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- Connection closed by foreign host. From lazy404 at gmail.com Wed Dec 26 22:01:25 2012 From: lazy404 at gmail.com (Lazy) Date: Wed, 26 Dec 2012 21:01:25 +0100 Subject: [Dovecot] 2 node dovecot Message-ID: Hi, We run dovecot 2.1 on 2 nodes with shared nfs storage. Index files are kept on local disk. Second node is usually used only for email snapshots access. If primary node fails it is configured to take place of the primary imap server. Snapshots are additional namespaces with mail from various points in time. We need a way to easly copy multiple messages from snapshots to current mailboxes. It would be best to make current mailbox available as another namespace so one would simply copy messages from one folder to another. Is it safe ? There will be times when given user is writing to the same nfs based Maildir mailbox from 2 nodes both of them having separate index files. What will happen if already present message gets copied back from the snapshot ? Regards, Micha? Grz?dzicki From rgm at htt-consult.com Thu Dec 27 20:28:19 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Thu, 27 Dec 2012 13:28:19 -0500 Subject: [Dovecot] dovecot testinstallation does not tell how to quit Message-ID: <50DC9343.1000903@htt-consult.com> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing Dovecot login, and sure enough I found some at: wiki.dovecot.org/Testinstallation Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the wiki! Oh, I just guessed it: a logout From h.reindl at thelounge.net Thu Dec 27 20:33:31 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 27 Dec 2012 19:33:31 +0100 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DC9343.1000903@htt-consult.com> References: <50DC9343.1000903@htt-consult.com> Message-ID: <50DC947B.1080701@thelounge.net> Am 27.12.2012 19:28, schrieb Robert Moskowitz: > I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing > Dovecot login, and sure enough I found some at: > > wiki.dovecot.org/Testinstallation > > Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about > how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the > wiki! > > Oh, I just guessed it: > > a logout google "imap quit telnet session" leads to http://www.yuki-onna.co.uk/email/imap.html -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From rgm at htt-consult.com Thu Dec 27 21:38:46 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Thu, 27 Dec 2012 14:38:46 -0500 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DC947B.1080701@thelounge.net> References: <50DC9343.1000903@htt-consult.com> <50DC947B.1080701@thelounge.net> Message-ID: <50DCA3C6.8080607@htt-consult.com> On 12/27/2012 01:33 PM, Reindl Harald wrote: > > Am 27.12.2012 19:28, schrieb Robert Moskowitz: >> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing >> Dovecot login, and sure enough I found some at: >> >> wiki.dovecot.org/Testinstallation >> >> Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about >> how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the >> wiki! >> >> Oh, I just guessed it: >> >> a logout > google "imap quit telnet session" leads to > http://www.yuki-onna.co.uk/email/imap.html > So there you have c logout and I got a logout to work as well. But I might think that a testing doc can include this little tidbit, rather than do yet another search. Since this is a Dovecot test doc, I also might think it would have POP3 testing instructions! But I was happy to find the IMAP. Now to figure out why RoundCube fails to login with the same user that I logged in via Telnet. Thanks for the pointer. From janfrode at tanso.net Thu Dec 27 23:17:49 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 27 Dec 2012 22:17:49 +0100 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? Message-ID: I'm preparing to set up a new set of directors on dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. Will it be OK to set up a ring of directors with 2x dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? -jf From tss at iki.fi Fri Dec 28 03:02:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 28 Dec 2012 03:02:54 +0200 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? In-Reply-To: References: Message-ID: On 27.12.2012, at 23.17, Jan-Frode Myklebust wrote: > I'm preparing to set up a new set of directors on > dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. > Will it be OK to set up a ring of directors with 2x > dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? The new v2.1 director code can handle running with old v2.1 directors (there were some protocol changes that improve things). I think v2.0 director is protocol compatible with the old v2.1 directors, so I think in theory it should work.. But it's definitely not ever been tested in practise, and v2.1 did fix a ton of director bugs. So if you end up testing it, I think you should be ready to quicky upgrade the other director as well if any errors show up in logs. From dave at morsberger.com Fri Dec 28 05:28:21 2012 From: dave at morsberger.com (David Morsberger) Date: Thu, 27 Dec 2012 22:28:21 -0500 Subject: [Dovecot] Missing Emails Message-ID: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again. Help!!!! This is a company email server. They live and die by their emails. Emails show up in inbox and then disappear. Anyone know why our emails are disappearing? I see a reference to it in the dovecot.index.cache file (last item) ^@^@^@Q^@^@^@0^@^@^@^@^@^@^@Message-ID: <1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> ^@^@^@^M^@^@^@7^@^@^@4^@^@^@^@^@^@^@Subject: Funeral program for Eileen Zbignewich ^@^E^@^@^@^@^@^@^@^F^@^@^@Z^@^@^@7^@^@^@^@^@^@^@Content-Type: multipart/mixed; boundary="-1578497492-264297203-1356660917=:93498" ^@^@^G^@^@^@4^@^@^@1^@^@^@^@^@^@^@Date: Thu, 27 Dec 2012 18:15:17 -0800 (PST) ^@^@^@^@^@^@^@^K^@^@^@^@^@^@^@^L^@^@^@^@^@^@^@^N^@^@^@8^@^@^@5^@^@^@^@^@^@^@To: "info at mmpcrofton.com" I searched the filesystem and cannot find them. bash-3.2# find . -exec grep Zbignewich {} \; -print Dec 04 00:30:26 master: Info: Dovecot v2.0.19apple1 starting up (core dumps disabled) I believe I turned on all debug and info messages. Here is what I see in postfix log: Dec 27 21:15:39 mini.mmpcrofton.com postfix/smtpd[20081]: 3CE164F4420: client=pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:39 mini.mmpcrofton.com postfix/cleanup[20086]: 3CE164F4420: message-id=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: from=, size=307659, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20081]: disconnect from pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: connect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: 5168E4F4447: client=localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/cleanup[20086]: 5168E4F4447: message-id=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: disconnect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: from=, size=308299, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtp[20102]: 3CE164F4420: to=, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.85/0.01/0/0.27, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 5168E4F4447) Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: removed Dec 27 21:15:40 mini.mmpcrofton.com postfix/pipe[20110]: 5168E4F4447: to=, orig_to=, relay=dovecot, delay=0.39, delays=0.03/0.01/0/0.35, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 27 21:15:41 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: removed dovecot_info.log Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: msgid=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com>: saved mail to INBOX Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: push notification enabled Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: notify: graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: data sent: 1680 dovecot_debug.log Dec 27 21:15:40 lda: Debug: Loading modules from directory: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib10_quota_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_fts_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_push_notify_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_zlib_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib21_fts_sk_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib90_sieve_plugin.so Dec 27 21:15:40 lda: Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota=maildir:User quota:noenforcing Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=0 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Effective uid=214, gid=6, home= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args=noenforcing Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: maildir++: root=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, index=, control=, inbox=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: none: root=, index=, control=, inbox=, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts_sk: Disabled with in-memory indexes Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts: No backends enabled by the fts setting Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Destination address: graphicartist at mini.mmpcrofton.com (source: user at hostname) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user's script path /Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve doesn't exist (using global script path in stead) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user has no valid personal script Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: no scripts to execute: reverting to default delivery. Anyone know why our emails are disappearing? From sven at svenhartge.de Fri Dec 28 05:54:19 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 28 Dec 2012 04:54:19 +0100 Subject: [Dovecot] Missing Emails References: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> Message-ID: <09clpmsmvov8@mids.svenhartge.de> David Morsberger wrote: > I reported a problem with disappearing emails on my Apple Mountain > Lion server. Not sure if it ever stopped but I do know it is happening > again. > Help!!!! This is a company email server. They live and die by their > emails. > Emails show up in inbox and then disappear. > Anyone know why our emails are disappearing? You should configure the mail_log plugin to log all actions clients do to your mails: http://wiki2.dovecot.org/Plugins/MailLog I've had to debug similar problems in the past time (on a different IMAP server) and in _all_ cases it was something the user did, like having a client downloading the mails via POP3 (and forgetting about this) and complaining about missing mails from "the Webmailer Website". Or having configured a filter inside Thunderbird (and forgetting about this), instructing the client to delete mails matching a special rule. > I see a reference to it in the dovecot.index.cache file (last item) If there is a reference in this file, the mail must have reached dovecot. So the next step would be to find out, _what exactly_ the client does with it. See mail_log again. Gr??e, Sven. -- Sigmentation fault. Core dumped. From dave at morsberger.com Fri Dec 28 06:40:55 2012 From: dave at morsberger.com (David Morsberger) Date: Thu, 27 Dec 2012 23:40:55 -0500 Subject: [Dovecot] Missing Emails In-Reply-To: <09clpmsmvov8@mids.svenhartge.de> References: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> <09clpmsmvov8@mids.svenhartge.de> Message-ID: <99C2001A-B076-4F90-BE4A-C91B6C54F99F@morsberger.com> Sven, Thanks for the response. 1. Nobody should be using pop3. The missing email appears to be random. I believe pop downloads would delete them all. I have now turned off pop3. 2. Would a mail rule place it in the 'Trash'? I did not find the email on the file system. I'm trying a wider search. 3. I followed the instructions on the wiki but it still doesn't appear to be logging everything. conf.d/10-logging.conf # Log file to use for informational messages. Defaults to log_path. #info_log_path = info_log_path = /Library/Logs/Mail/dovecot_info.log # Log file to use for debug messages. Defaults to info_log_path. debug_log_path = /Library/Logs/Mail/dovecot_debug.log mail_plugins = $mail_plugins mail_log notify plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. mail_log_fields = uid box msgid size from subject size flags } I am not seeing messages of the following form in the dovecot_debug.log or dovecot_info.log imap(user): copy -> Trash: uid=908, msgid=<123.foo at bar> imap(user): deleted: uid=908, msgid=<123.foo at bar> imap(user): expunged: uid=908, msgid=<123.foo at bar> On Dec 27, 2012, at 10:54 PM, Sven Hartge wrote: > David Morsberger wrote: > >> I reported a problem with disappearing emails on my Apple Mountain >> Lion server. Not sure if it ever stopped but I do know it is happening >> again. > >> Help!!!! This is a company email server. They live and die by their >> emails. > >> Emails show up in inbox and then disappear. > >> Anyone know why our emails are disappearing? > > You should configure the mail_log plugin to log all actions clients do > to your mails: http://wiki2.dovecot.org/Plugins/MailLog > > I've had to debug similar problems in the past time (on a different IMAP > server) and in _all_ cases it was something the user did, like having a > client downloading the mails via POP3 (and forgetting about this) and > complaining about missing mails from "the Webmailer Website". Or having > configured a filter inside Thunderbird (and forgetting about this), > instructing the client to delete mails matching a special rule. > >> I see a reference to it in the dovecot.index.cache file (last item) > > If there is a reference in this file, the mail must have reached > dovecot. So the next step would be to find out, _what exactly_ the > client does with it. See mail_log again. > > Gr??e, > Sven. > > -- > Sigmentation fault. Core dumped. > From campee at gmail.com Fri Dec 28 07:21:38 2012 From: campee at gmail.com (Eric) Date: Thu, 27 Dec 2012 21:21:38 -0800 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: Message-ID: Can anyone help with this? On Tue, Dec 25, 2012 at 6:26 PM, Eric wrote: > Happy holidays! I am experiencing an issue when trying to check my mail > using IMAP. with Dovecot I have tried checking my mail using a full GUI > client (Thunderbird) and telnet. Both times I get disconnected before all > of my messages can be downloaded and I see an error in my mail log. Here > are the details: > > > [root at cust19-1-prod-domain userqa]# dovecot --version > 2.0.9 > > [root at cust19-1-prod-domain userqa]# dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.18-164.11.1.el5 x86_64 CentOS release 5.4 (Final) > disable_plaintext_auth = no > login_trusted_networks = 172.19.136.0 > mail_location = maildir:~/Maildir > mail_max_userip_connections = 100 > mbox_write_locks = fcntl > mmap_disable = yes > passdb { > args = scheme=plain username_format=%n /etc/dovecot/users > driver = passwd-file > } > protocols = imap > ssl = no > userdb { > args = username_format=%n /etc/dovecot/users > driver = passwd-file > } > [root at cust19-1-prod-domain userqa]# > > i try to check my mail: > > username at ops1-1-domain:~$ telnet cust19-1-prod-domain imap > Trying 172.19.136.223... > Connected to cust19-1-prod-domain.domain.net (172.19.136.223). > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > AUTH=PLAIN] Dovecot ready. > > 1 LOGIN userqa mypassword > 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT > CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC > ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in > > 3 EXAMINE INBOX > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) > * OK [PERMANENTFLAGS ()] Read-only mailbox. > * 1 EXISTS > * 0 RECENT > * OK [UNSEEN 1] First unseen. > * OK [UIDVALIDITY 1356130761] UIDs valid > * OK [UIDNEXT 5] Predicted next UID > * OK [HIGHESTMODSEQ 1] Highest > 3 OK [READ-ONLY] Select completed. > > 4 FETCH 1 BODY[] > > I get some binary output and some mail headers, but then it crashes.. > > Not sure if you guys want to see all of the extremely verbose output, so I > put it at the end of this message. The last messages that it processes is a > message with an Excel spreadsheet attached to it (a .xlsx file) > > i enabled core dumps: > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot > > Now I see this in /var/log/maillog: > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > service(imap): child 11265 killed with signal 11 (core dumped) > > core dumps are being written here, but they're empty: > > [root at cust19-1-prod-domain userqa]# pwd > /mnt/mail/userqa > [root at cust19-1-prod-domain userqa]# ls -lh > total 20K > -rw------- 1 userqa userqa 0 Dec 25 17:52 core.11111 > -rw------- 1 userqa userqa 0 Dec 25 17:53 core.11265 > -rw------- 1 userqa userqa 0 Dec 25 17:58 core.11812 > drwx------ 7 userqa userqa 4.0K Dec 25 17:58 Maildir > [root at cust19-1-prod-domain userqa]# > > What should I try now? Is it possible that Dovecot is having difficulty > processing the attachment file? If I delete this user's mailbox file and > send basic text e-mail to the user I can read/retrieve them just fine.. > there only seems to be an issue when this message with its attachment > arrives. The attachment seems small in size: > > Content-Disposition: attachment; filename="report_amex.xlsx"; size=20527; > > > That means the attachment is 20527 bytes, correct? > > Thank you for any suggestions/help you can offer! > > > Here's the message that it seems to be having issues with: > > Return-Path: > Received: from mxout.mailprovider.com (slb1-prod-domain.domain.net[172.19.136.4]) > by cust19-1-prod-domain.domain.net (8.13.8/8.13.8) with ESMTP id > qBOM8oIE029715 > for ; Mon, 24 Dec 2012 14:08:50 > -0800 > Received: from mxout.mailprovider.com (localhost [127.0.0.1]) > by mxout.mailprovider.com (Postfix) with ESMTP id 017E455325B > for ; Mon, 24 Dec 2012 17:08:51 > -0500 (EST) > X-Virus-Scanned: by SpamTitan at mail.lan > Received: from HUB025.mail.lan (unknown [10.110.2.1]) > by mxout.mailprovider.com (Postfix) with ESMTP id 63DA0553132 > for ; Mon, 24 Dec 2012 17:08:50 > -0500 (EST) > Received: from MAILR001.mail.lan ([10.110.18.28]) by HUB025.mail.lan > ([10.110.17.25]) with mapi; Mon, 24 Dec 2012 17:08:48 -0500 > From: User Name > To: "userqa_2938 at integration.company.com" > > Date: Mon, 24 Dec 2012 17:08:47 -0500 > Subject: > Thread-Index: Ac3fx0lCAoza6rTzQTSh8g52mx84GwAC2GGwAAH1lkAAkiyekA== > Message-ID: <0370E60157CA7E4097D81B9E09728A941CB269A29D at MAILR001.mail.lan> > Accept-Language: en-US > Content-Language: en-US > X-MS-Has-Attach: yes > X-MS-TNEF-Correlator: > acceptlanguage: en-US > Content-Type: multipart/mixed; > > boundary="_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" > MIME-Version: 1.0 > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: multipart/alternative; > > boundary="_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: text/plain; charset="us-ascii" > Content-Transfer-Encoding: quoted-printable > > From: User Name > Sent: Friday, December 21, 2012 6:23 PM > To: 'userqa_2938 at integration.company.com' > Subject: FW: > > > With Best Regards, > User Name > > From: User Name > Sent: Friday, December 21, 2012 5:27 PM > To: 'userqa_2938 at integration.company.com' > Subject: FW: > > > With Best Regards, > User Name > > From: User Name > Sent: Friday, December 21, 2012 4:05 PM > To: 'userqa_2938 at integration.company.com' > Subject: > > > > With Best Regards, > User Name > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: text/html; charset="us-ascii" > Content-Transfer-Encoding: quoted-printable > > xmlns:o=3D"urn:schemas-micr= > osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" > = > xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" > xmlns=3D"http:= > //www.w3.org/TR/REC-html40"> CONTENT= > =3D"text/html; charset=3Dus-ascii"> content=3D"Micros= > oft Word 12 (filtered medium)"> vli= > nk=3Dpurple>

style=3D'c= > olor:#1F497D'> 

=3D'color:#1F497D'> 

class=3DMsoNormal> pan style=3D'color:#1F497D'>With Best Regards,

clas= > s=3DMsoNormal>User Name p>

style=3D'color:#1F497D'>______________________= > _

style=3D'color:#1F497D'>s= > kype: user

:#1F497D'>cell phone: +1 224 600 0072

=3DMsoNormal> style=3D'color:#1F497D'> 

>
0in= > 0in 0in'>

style=3D'font-size:10.0pt;font-fami= > ly:"Tahoma","sans-serif"'>From: style=3D'font-size:10.0pt;f= > ont-family:"Tahoma","sans-serif"'> User Name
Sent: Friday, Dec= > ember 21, 2012 6:23 PM
To: 'userqa_2938 at integration.aggregateknow > = > ledge.com'
Subject: FW:

clas= > s=3DMsoNormal> 

style=3D'colo= > r:#1F497D'> 

styl= > e=3D'color:#1F497D'>With Best Regards,

class=3DMsoN= > ormal>User Name

ss=3DMsoNormal> style=3D'color:#1F497D'>_______________________ o:p>

skype: > eg= > irik

style=3D'color:#1F497D= > '>cell phone: +1 224 600 0072

class=3DMsoNorm= > al> 

styl= > e=3D'border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in > 0in'>= >

style=3D'font-size:10.0pt;font-family:"Tahoma= > ","sans-serif"'>From: style=3D'font-size:10.0pt;font-family= > :"Tahoma","sans-serif"'> User Name
Sent: Friday, December 21, = > 2012 5:27 PM
To: 'userqa_2938 at integration.company.com'= >
Subject: FW:

class=3DMsoNor= > mal> 

style=3D'color:#1F497D'= > > 

style=3D'color= > :#1F497D'>With Best Regards,

class=3DMsoNormal> n style=3D'color:#1F497D'>User Name

rmal> style=3D'color:#1F497D'>_______________________ >

skype: user<= > /o:p>

cell > pho= > ne: +1 224 600 0072

s= > tyle=3D'color:#1F497D'> 

style=3D'borde= > r:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>

=3DMsoNormal> style=3D'font-size:10.0pt;font-family:"Tahoma","sans-= > serif"'>From: style=3D'font-size:10.0pt;font-family:"Tahoma= > ","sans-serif"'> User Name
Sent: Friday, December 21, 2012 4:0= > 5 PM
To: 'userqa_2938 at integration.company.com'
S= > ubject:

class=3DMsoNormal>&nb= > sp;

 

class=3DMsoNormal= > > 

With Best > Regards, >

User Name

______= > _________________

skype: user p>

cell phone: +1 224 600 0072

cla= > ss=3DMsoNormal> 

= > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: > application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; > name="report_company.xlsx" > Content-Description: report_company.xlsx > Content-Disposition: attachment; filename="report_company.xlsx"; > size=20527; > creation-date="Thu, 11 Oct 2012 22:38:14 GMT"; > modification-date="Mon, 24 Dec 2012 22:08:22 GMT" > Content-Transfer-Encoding: base64 > > > UEsDBBQABgAIAAAAIQDretKTYgEAAJAEAAATANwBW0NvbnRlbnRfVHlwZXNdLnhtbCCi2AEooAAC > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAArFTLTsMwELwj8Q+RryhxywEh1LQHHkeoBHyAsTeNVce2vNvS/j2bhFaASqSq > > vSSKop2ZnRl7Mts0LltDQht8KcbFSGTgdTDWL0rx/vaU34oMSXmjXPBQii2gmE0vLyZv2wiY8bTH > > UtRE8U5K1DU0CosQwfOfKqRGEX+mhYxKL9UC5PVodCN18ASecmoxxHTywgKSNZDNVaJn1TCP3DhJ > > jAb9c1wwnsju+8GWuxQqRme1IlYu1978Yc1DVVkNJuhVw1xFB3bVosh/CZG2DvBkKowJlMEagBpX > > 9KA75geo1MpR9rhhB3rTEzg8brVvMwue7NbH2kYcYBj2btiTz5CWHyEsz+1K607RKOt3ug+VgNOb > > pxBRctYnC4DWcgMmjwwJiSzsPTvEzQVsd+9iRNm9Tm/h72rs8Yc8YB1YqwTmlRKfyrPX8yf2kI59 > > FjokOD6MXWfb6QMJyO4+mX4BAAD//wMAUEsDBBQABgAIAAAAIQC1VTAj9QAAAEwCAAALAM4BX3Jl > > bHMvLnJlbHMgosoBKKAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADlDAAAeGwv > > c3R5bGVzLnhtbFBLAQItABQABgAIAAAAIQDppiW4ggYAAFMbAAATAAAAAAAAAAAAAAAAALIUAAB4 > > bC90aGVtZS90aGVtZTEueG1sUEsBAi0AFAAGAAgAAAAhAOhJXyi8LAAAyx8BABgAAAAAAAAAAAAA > > AAAAZRsAAHhsL3dvcmtzaGVldHMvc2hlZXQxLnhtbFBLAQItABQABgAIAAAAIQAU45/9UAEAAGMC > > AAARAAAAAAAAAAAAAAAAAFdIAABkb2NQcm9wcy9jb3JlLnhtbFBLAQItABQABgAIAAAAIQBxujxc > > hQEAAAMDAAAQAAAAAAAAAAAAAAAAAN5KAABkb2NQcm9wcy9hcHAueG1sUEsFBgAAAAAKAAoAgAIA > AJlNAAAAAA== > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- > Connection closed by foreign host. > > > From kamath at moltingpenguin.com Fri Dec 28 08:11:26 2012 From: kamath at moltingpenguin.com (Sean Kamath) Date: Thu, 27 Dec 2012 22:11:26 -0800 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DCA3C6.8080607@htt-consult.com> References: <50DC9343.1000903@htt-consult.com> <50DC947B.1080701@thelounge.net> <50DCA3C6.8080607@htt-consult.com> Message-ID: <411FD36C-D6F6-4EBF-9DD4-DB9B56800EC1@moltingpenguin.com> On Dec 27, 2012, at 11:38 AM, Robert Moskowitz wrote: > > On 12/27/2012 01:33 PM, Reindl Harald wrote: >> >> Am 27.12.2012 19:28, schrieb Robert Moskowitz: >>> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing >>> Dovecot login, and sure enough I found some at: >>> >>> wiki.dovecot.org/Testinstallation >>> >>> Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about >>> how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the >>> wiki! >>> >>> Oh, I just guessed it: >>> >>> a logout >> google "imap quit telnet session" leads to >> http://www.yuki-onna.co.uk/email/imap.html >> > So there you have > > c logout > > and I got > > a logout > > to work as well. Almost any identifier before the 'logout' will work. IMAP protocol uses a tagged command structure, so that commands can be interleaved and replies will respond with the identifier provided. I usually use '1 logout'. Note identifiers can be reused as well ;-) Sean PS At least it's now in the mail archives. :-) > But I might think that a testing doc can include this little tidbit, rather than do yet another search. Since this is a Dovecot test doc, I also might think it would have POP3 testing instructions! But I was happy to find the IMAP. Now to figure out why RoundCube fails to login with the same user that I logged in via Telnet. > > Thanks for the pointer. > > From pj.netfilter at gmail.com Fri Dec 28 09:58:26 2012 From: pj.netfilter at gmail.com (Joy) Date: Fri, 28 Dec 2012 13:28:26 +0530 Subject: [Dovecot] Help Regarding Multiple Base DN Message-ID: Dear Expert, Can i specify multiple Base DN for user lookup in dovecot like :- dc=abc,dc=com dc=abc,dc=net dc=xzy,dc=com dc=xyz,dc=net Thanks From janfrode at tanso.net Fri Dec 28 13:43:00 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 12:43:00 +0100 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? In-Reply-To: References: Message-ID: On Fri, Dec 28, 2012 at 2:02 AM, Timo Sirainen wrote: > > The new v2.1 director code can handle running with old v2.1 directors (there were some protocol changes that improve things). I think v2.0 director is protocol compatible with the old v2.1 directors, so I think in theory it should work.. But it's definitely not ever been tested in practise, and v2.1 did fix a ton of director bugs. So if you end up testing it, I think you should be ready to quicky upgrade the other director as well if any errors show up in logs. > Ok, I don't think I want to test this -- realistic testing is too hard. I'll rather upgrade the old directors (keeping same ip-addresses), so that I quickly can rollback in case something doesn't work as well as expected. BTW: What's the status of LMTP proxying in v2.1 (or more specifically dovecot-ee-2.1.10.3-1)? Do you know of many users of it, and has it proven itself much better than v2.0.14 ? I intend to upgrade the directors first, and leave the backend servers running v2.0.14 for a while.. that should be OK, right ? -jf From janfrode at tanso.net Fri Dec 28 13:51:14 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 12:51:14 +0100 Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: Don't know if having multiple Base DNs can work, but you can use %variables in it. We use this one to be able to have a simple onelevel scope on all lookups: base = ou=people,o=%d,o=ISP,o=example,c=com scope = onelevel -jf From janfrode at tanso.net Fri Dec 28 14:04:43 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 13:04:43 +0100 Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: Just checked the Variables documentation http://wiki2.dovecot.org/Variables, which says: %D - return "sub.domain.org" as "sub,dc=domain,dc=org" (for LDAP queries) so it seems* you should be able to use "base = %D" [*] assuming the wiki meant to say "dc=sub,dc=domain,dc=org" -jf From tomislav.mihalicek at gmail.com Fri Dec 28 13:41:44 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Fri, 28 Dec 2012 03:41:44 -0800 (PST) Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: <1356694904082-39423.post@n4.nabble.com> You can use multiple databases http://wiki2.dovecot.org/Authentication/MultipleDatabases -- View this message in context: http://dovecot.2317879.n4.nabble.com/Help-Regarding-Multiple-Base-DN-tp39422p39423.html Sent from the Dovecot mailing list archive at Nabble.com. From a.miederhoefer at gmx.de Fri Dec 28 14:17:56 2012 From: a.miederhoefer at gmx.de (=?iso-8859-1?Q?=22Antje_Miederh=F6fer=22?=) Date: Fri, 28 Dec 2012 13:17:56 +0100 Subject: [Dovecot] dovecot 2.1.12 panic in mbox-sync.c Message-ID: <20121228121756.22540@gmx.net> Hello! I use dovecot 2.1.12 locally on a 32bit Linux with an ext4 filesystem and after deleting a lot of emails from a mbox folder, I now get the following messages in the log: dovecot: imap(amied): Panic: file mbox-sync.c: line 1351 (mbox_sync_handle_eof_updates): assertion failed: (offset == 0 || offset > 31) dovecot: imap(amied): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4559a) [0x6f68959a] -> /usr/lib/dovecot/libdovecot.so.0(+0x45611) [0x6f689611] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x6f658fa0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x2d707) [0x6f708707] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_sync+0x53) [0x6f7091d3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_storage_sync_init+0x6d) [0x6f70936d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x3b) [0x6f72333b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3f) [0x6f72347f] -> dovecot/imap(cmd_select_full+0x16b) [0x805529b] -> dovecot/imap(cmd_select+0x17) [0x8055c57] -> dovecot/imap(command_exec+0x32) [0x80596f2] -> dovecot/imap() [0x80586fd] -> dovecot/imap() [0x805880d] -> dovecot/imap(client_handle_input+0x125) [0x8058a05] -> dovecot/imap(client_input+0x60) [0x80592f0] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x44) [0x6f6981f4] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xce) [0x6f6991ce] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x6f697cd0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2e) [0x6f680dbe] -> dovecot/imap(main+0x279) [0x804fdd9] -> /lib/libc.so.6(__libc_start_main+0xf5) [0x6f49bad5] -> dovecot/imap() [0x804ff51] The mbox file seems to be unchanged and a .lock file remains even after stopping dovecot. The folder is not accessible any more. A fix would be nice. :-) dovecot config: listen = 127.0.0.1 mail_fsync = never mail_location = maildir:/var/mails/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = no location = mbox:/var/mails/mbox/%u prefix = mbox/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = * driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap ssl_cert = Hi, we are currently moving our mailserver to a new server with Dovecot, virtual users in LDAP, Passwords in Kerberos Setup. Everything works fine except for GSSAPI which seems to be a bit buggy. The thing is, that when using a .k5login [1] file it seems that SASL does not get passed the home directory specified userdb. In other words, mails for user1 (see below) are stored in /home/domain.at/user1, while the home dir defined in LDAP is /afs/domain.at/home/user1 (virtual users, so only dovecot, not the system does know about this user and home dir). If I do create a .k5login file in /home/domain.at/user1 with the content "someotheruser at DOMAIN.AT", then someotheruser should be able to authenticate himself as user1 via GSSAPI. However, this .k5login file is completely ignored. So it seems to me that the home is not passed on to SASL. If I do add ldap to my nsswitch (for testing only) I additionally have real system users. Now if I create a .k5login in their home defined in LDAP which now also the system knows about everything works just fine. It is still the wrong home since its the one in LDAP and not the one defined by dovecot but at least it shows that our setup is working. See also debug log output below, a failed GSSAPI attempt produces no log output at all. Our System is Debian Wheezy on an amd64 (virtualized), dovecot Version 2.1.7, filesystem is ext4. Everything is tested with Firefox 17.0 on an Ubuntu Lucid client. Example LDAP user (not all of it...): ===================== dn: uid=user1,ou=people,dc=domain,dc=at structuralObjectClass: inetOrgPerson objectClass: inetOrgPerson objectClass: posixAccount objectClass: qmailUser uid: username uidNumber: 12345 gidNumber: 100 mail: username at domain.at homeDirectory: /afs/domain.at/home/user1 userPassword: {sasl}user1 at DOMAIN.AT And our dovecot userdb/passdb looks like this: ============================ root at mail201212 /etc/dovecot (git)-[master] # cat conf.d/10-auth.conf auth_gssapi_hostname = "$ALL" auth_krb5_keytab = /etc/dovecot/imap_smtp_mail201212.keytab auth_mechanisms = plain gssapi !include auth-virtual.conf.ext root at mail201212 /etc/dovecot (git)-[master] # cat conf.d/auth-virtual.conf.ext mail_uid = mailowner mail_gid = mailowner userdb { driver = ldap args = /etc/dovecot/ldap-userdb-user_g2.conf.ext } passdb { driver = pam } root at mail201212 /etc/dovecot (git)-[master] # cat /etc/dovecot/ldap-userdb-user_g2.conf.ext #http://www.postfix.org/ldap_table.5.html hosts = ldap1 ldap2 base = ou=people,dc=domain,dc=at user_attrs = uid=home=/home/domain.at/%$ user_filter = (&(objectClass=inetOrgPerson)(|(mail=%u)(mailalternateaddress=%u)(uid=%u))) Debug log output with system users (testing only) and a working GSSAPI auth: ================================================ Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_pgsql.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_sqlite.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: passwd-file /etc/dovecot/shared_users: Read 1 users in 0 secs Dec 28 14:18:40 mail201212 dovecot: auth: Debug: auth client connected (pid=11875) Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: AUTH#0111#011GSSAPI#011service=imap#011secured#011session=1RaMgOnRZADAqCoq#011lip=192.168.43.100#011rip=192.168.42.42#011lport=993#011rport=55140 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(?,192.168.42.42,<1RaMgOnRZADAqCoq>): Using all keytab entries Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(user1 at domain.at,192.168.42.42,<1RaMgOnRZADAqCoq>): security context state completed. Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011YIGZBgkqhkiG9xIBAgICAG+BiTCBhqADAgEFoQMCAQ+iejB4oAMCARKicQRvMQu0Yxgom2SVOHW25FpxDbqalw/8nuMN1XH78FJUzJ/7CIv9dlQNUrKjFywqS9kNOxQY2sJR 7Ii0hw3i7BGV3VPmoeRJOsbYD5ahBh74NKqxdacN6rLj/cO5vWCee6Oel3rPgLV8kEcOVZOdAt6y Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(user1 at domain.at,192.168.42.42,<1RaMgOnRZADAqCoq>): Negotiated security layer Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011BQQF/wAMAAAAAAAAC5QPNQH///+qs6lgevrvypjd1l4= Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: OK#0111#011user=user1 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: master in: REQUEST#0111935278081#01111875#0111#0118d08e90a585981154d7c045ca230b1f9 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: ldap(user1,192.168.42.42,<1RaMgOnRZADAqCoq>): user search: base=ou=people,dc=domain,dc=at scope=subtree filter=(&(objectClass=inetOrgPerson)(|(mail=user1)(mailalternateaddress=user1)(uid=user1))) fields=uid Dec 28 14:18:41 mail201212 dovecot: auth: Debug: ldap(user1,192.168.42.42,<1RaMgOnRZADAqCoq>): result: uid=user1 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: master out: USER#0111935278081#011user1#011home=/home/domain.at/user1 Dec 28 14:18:41 mail201212 dovecot: imap-login: Login: user=, method=GSSAPI, rip=192.168.42.42, lip=192.168.43.100, mpid=11878, TLS, session=<1RaMgOnRZADAqCoq> Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Effective uid=996, gid=997, home=/home/domain.at/user1 Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/maildir Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: maildir++: root=/home/domain.at/user1/maildir, index=, control=, inbox=/home/domain.at/user1/maildir, alt= Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Namespace : type=public, prefix=PublicLists/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/listcaptor/maildir/ Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: maildir++: root=/home/listcaptor/maildir, index=, control=, inbox=, alt= [1] http://web.mit.edu/kerberos/krb5-current/doc/user/user_config/k5login.html -- J?rg Herzinger - EDV Team GLOBAL 2000 - Friends of the Earth Austria Neustiftgasse 36, A-1070 Wien tel +43-699-14200030 Dieses Mail wurde mit Oekostrom und Opensource Software erstellt. From p.heinlein at heinlein-support.de Sat Dec 29 00:27:43 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Fri, 28 Dec 2012 23:27:43 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CC3381.1050608@hardwarefreak.com> References: <50CC2A64.30309@heinlein-support.de> <50CC3381.1050608@hardwarefreak.com> Message-ID: <50DE1CDF.8050902@heinlein-support.de> Am 15.12.2012 09:23, schrieb Stan Hoeppner:> On 12/15/2012 1:44 AM, Peer Heinlein wrote: >> But we're having much more then >> 30 TB of maildata and doing an fsck >> on huge partitions takes too much (down-) time for our mailsystem. > > Peer are you using NFS or a cluster filesystem? Linux on the hosts or > other? I don't understand the reason for the question. Even a NFS is based on a "real" filesystem that needs to be checked. So: Where's the difference?! But to answer your question: No, I'm using local Filesystems (and that's good!) and I'd absolutely avoid NFS or a ClusterFS for setups as big as this. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Sat Dec 29 00:35:53 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Fri, 28 Dec 2012 23:35:53 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CECA38.3070403@um.es> References: <50CC2A64.30309@heinlein-support.de> <50CECA38.3070403@um.es> Message-ID: <50DE1EC9.5070500@heinlein-support.de> Am 17.12.2012 08:31, schrieb Angel L. Mateo: >> But we're having much more then >> 30 TB of maildata and doing an fsck >> on huge partitions takes too much (down-) time for our mailsystem. >> > Wouldn't be easier just to split your users between different > filesystems? I mean having different altstorages, but not as you propose > but one for the half of your users and other for the other half. For sure we DO have users split up into several 5 TB-partitions. This helps a little, but not a lot. And it creates some extra work and some extra sources of errors: You'll need Symlinks on the "real" fs or a user-dependend storage path in LDAP. But anyway, those partitions are tooo big for short filesystem checks (or if you make them smaller, you'd have too many). And, anyway: As I explained I'm interested in zero-downtime-checks, which wouldn't work just with several partitions. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From mattk at kraner.us Sat Dec 29 03:27:08 2012 From: mattk at kraner.us (mattk at kraner.us) Date: Fri, 28 Dec 2012 19:27:08 -0600 Subject: [Dovecot] question Message-ID: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> I just install Dovecot and postfix. When I'm pull dovecot I see in the log that its checking for mail. if a put a test message locally on the server I can pull the message down to my cell phone and other computers. But when I try to a message from gmail or aol it doesn't come in to the server. it always bounces back to the place were I sent it from From simon.buongiorno at gmail.com Sat Dec 29 03:40:24 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Fri, 28 Dec 2012 20:40:24 -0500 Subject: [Dovecot] question In-Reply-To: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: On Dec 28, 2012 8:28 PM, wrote: > > I just install Dovecot and postfix. When I'm pull dovecot I see in the log > that its checking for mail. if a put a test message locally on the server > I can pull the message down to my cell phone and other computers. But when > I try to a message from gmail or aol it doesn't come in to the server. > > > it always bounces back to the place were I sent it from That would indicate a postfix issue since it would seem you are not getting mail from outside your network/host. But either way you'll need config and log files of you'd like real help. Simon From h.reindl at thelounge.net Sat Dec 29 03:44:52 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 29 Dec 2012 02:44:52 +0100 Subject: [Dovecot] question In-Reply-To: References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: <50DE4B14.2040502@thelounge.net> Am 29.12.2012 02:40, schrieb Simon Brereton: > On Dec 28, 2012 8:28 PM, wrote: >> >> I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> that its checking for mail. if a put a test message locally on the server >> I can pull the message down to my cell phone and other computers. But when >> I try to a message from gmail or aol it doesn't come in to the server. >> >> >> it always bounces back to the place were I sent it from > > That would indicate a postfix issue since it would seem you are not getting > mail from outside your network/host. > > But either way you'll need config and log files of you'd like real help without logs it is impossible to say anything at least we ned the content of the bounce since our glassball died what is the destination domain? is the server reachable from the internet? is the MX or at least A-record configured? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From martin.rabl at rablnet.de Sat Dec 29 04:41:15 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 03:41:15 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? Message-ID: <50DE584B.3020207@rablnet.de> Hi, yesterday I did an update from dovecot 1.2 to 2.0.19 (Ubuntu 10.04 -> 12.04). After fixing the configuration dovecot startups as it should, but with one error, I don't understand: the INBOX will not be delivered to the Mailclient and will not be filled by "deliver". Instead, dovecot create the two dirs "new" and "cur" directly in "Maildir". the filesystem looks now like: domain/user1/Maildir/INBOX # official INBOX domain/user1/Maildir/new # new mail domain/user1/Maildir/cur # read mail We have searched for an configuration error, but didn't found anything - or did not see one ;-) Maybe there is someone in the list, which see our error in a moment? We are using only imap/s and managesieve, no pop3. Maildir-Layout is FS. Here a snippet of our configuration: ------------ mail_home = mail_location = maildir:~/Maildir:LAYOUT=fs namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir/:INDEX=%%h/Maildir/shared/%u:LAYOUT=fs prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { list = yes location = maildir:/srv/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } protocol lda { mail_plugins = sieve autocreate } protocol imap { imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags mail_max_userip_connections = 10 mail_plugins = acl autocreate imap_acl } ------------ Hope you can help! Thank you! Martin From tss at iki.fi Sat Dec 29 04:47:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 29 Dec 2012 04:47:02 +0200 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: <50DE584B.3020207@rablnet.de> References: <50DE584B.3020207@rablnet.de> Message-ID: No idea how that worked with your previous configuration (I guess accidentally/unintentionally), but I guess you want this: mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs On 29.12.2012, at 4.41, Martin Rabl wrote: > Hi, > > yesterday I did an update from dovecot 1.2 to 2.0.19 (Ubuntu 10.04 -> 12.04). > After fixing the configuration dovecot startups as it should, but with one error, I don't understand: the INBOX will not be delivered to the Mailclient and will not be filled by "deliver". > Instead, dovecot create the two dirs "new" and "cur" directly in "Maildir". > > the filesystem looks now like: > domain/user1/Maildir/INBOX # official INBOX > domain/user1/Maildir/new # new mail > domain/user1/Maildir/cur # read mail > > We have searched for an configuration error, but didn't found anything - or did not see one ;-) > > Maybe there is someone in the list, which see our error in a moment? > > We are using only imap/s and managesieve, no pop3. Maildir-Layout is FS. > > Here a snippet of our configuration: > > ------------ > > mail_home = > mail_location = maildir:~/Maildir:LAYOUT=fs > > > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > list = yes > location = maildir:%%h/Maildir/:INDEX=%%h/Maildir/shared/%u:LAYOUT=fs > prefix = shared/%%u/ > separator = / > subscriptions = no > type = shared > } > namespace { > list = yes > location = maildir:/srv/vmail/public:LAYOUT=fs > prefix = public/ > separator = / > subscriptions = no > type = public > } > > protocol lda { > mail_plugins = sieve autocreate > } > protocol imap { > imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags > mail_max_userip_connections = 10 > mail_plugins = acl autocreate imap_acl > } > > ------------ > > Hope you can help! > > Thank you! > > Martin > From martin.rabl at rablnet.de Sat Dec 29 04:50:43 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 03:50:43 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: References: <50DE584B.3020207@rablnet.de> Message-ID: <50DE5A83.2050908@rablnet.de> Hi, Am 29.12.12 03:47, schrieb Timo Sirainen: > No idea how that worked with your previous configuration (I guess accidentally/unintentionally), but I guess you want this: that were the "bugfixes" ;-) > mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs Thank you, I give it a try. Greetings, Martin From martin.rabl at rablnet.de Sat Dec 29 05:23:40 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 04:23:40 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: <50DE5A83.2050908@rablnet.de> References: <50DE584B.3020207@rablnet.de> <50DE5A83.2050908@rablnet.de> Message-ID: <50DE623C.4070603@rablnet.de> Thank you Timo! Runs! It is to late for configuring ... ;-)) Greetings, Martin Am 29.12.12 03:50, schrieb Martin Rabl: > Hi, > > Am 29.12.12 03:47, schrieb Timo Sirainen: >> No idea how that worked with your previous configuration (I guess >> accidentally/unintentionally), but I guess you want this: > that were the "bugfixes" ;-) > >> mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs > Thank you, I give it a try. > > Greetings, > Martin > From kjonca at o2.pl Sat Dec 29 17:17:28 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 16:17:28 +0100 Subject: [Dovecot] lda crash? Message-ID: <87623ksx9z.fsf@alfa.kjonca> When I try to refilter some messages lda crash: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lda-log.txt URL: -------------- next part -------------- doveconf -n output -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot.confn Type: application/octet-stream Size: 1558 bytes Desc: not available URL: -------------- next part -------------- KJ -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Little known fact about Middle Earth: The Hobbits had a very sophisticated computer network! It was a Tolkien Ring... From kjonca at o2.pl Sat Dec 29 17:30:25 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 16:30:25 +0100 Subject: [Dovecot] lda crash? References: <87623ksx9z.fsf@alfa.kjonca> Message-ID: <87y5ggri3y.fsf@alfa.kjonca> kjonca at o2.pl (Kamil Jo?ca) writes: > When I try to refilter some messages lda crash: > KJ Sorry for wrong attachment in previoous post. -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lda-log.txt URL: -------------- next part -------------- -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Ditat Deus. [God enriches] From rs at sys4.de Sat Dec 29 18:09:42 2012 From: rs at sys4.de (Robert Schetterer) Date: Sat, 29 Dec 2012 17:09:42 +0100 Subject: [Dovecot] lda crash? In-Reply-To: <87623ksx9z.fsf@alfa.kjonca> References: <87623ksx9z.fsf@alfa.kjonca> Message-ID: <50DF15C6.4080600@sys4.de> Am 29.12.2012 16:17, schrieb Kamil Jo?ca: > include: sieve_global_dir is not set; have a look on this Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From kjonca at o2.pl Sat Dec 29 18:23:48 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 17:23:48 +0100 Subject: [Dovecot] lda crash? References: <87623ksx9z.fsf@alfa.kjonca> <50DF15C6.4080600@sys4.de> Message-ID: <87txr4rfmz.fsf@alfa.kjonca> Robert Schetterer writes: > Am 29.12.2012 16:17, schrieb Kamil Jo?ca: >> include: sieve_global_dir is not set; > have a look on this > No change after setting this parameter, lda crashes. KJ -- http://blogdebart.pl/2009/12/22/mamy-chorych-dzieci/ What we do not understand we do not possess. -- Goethe From rs at sys4.de Sat Dec 29 18:26:35 2012 From: rs at sys4.de (Robert Schetterer) Date: Sat, 29 Dec 2012 17:26:35 +0100 Subject: [Dovecot] lda crash? In-Reply-To: <87txr4rfmz.fsf@alfa.kjonca> References: <87623ksx9z.fsf@alfa.kjonca> <50DF15C6.4080600@sys4.de> <87txr4rfmz.fsf@alfa.kjonca> Message-ID: <50DF19BB.5020305@sys4.de> Am 29.12.2012 17:23, schrieb Kamil Jo?ca: > Robert Schetterer writes: > >> Am 29.12.2012 16:17, schrieb Kamil Jo?ca: >>> include: sieve_global_dir is not set; >> have a look on this >> > No change after setting this parameter, lda crashes. yeah, wait for other responses about your debug > > KJ > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From jtl+dovecot at uvm.edu Sat Dec 29 22:18:27 2012 From: jtl+dovecot at uvm.edu (Jim Lawson) Date: Sat, 29 Dec 2012 15:18:27 -0500 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: Message-ID: <50DF5013.8020507@uvm.edu> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Eric, On 12/25/12 9:26 PM, Eric wrote: > Happy holidays! I am experiencing an issue when trying to check my mail > using IMAP. with Dovecot I have tried checking my mail using a full GUI > client (Thunderbird) and telnet. Both times I get disconnected before all > of my messages can be downloaded and I see an error in my mail log. Here > are the details: > > > [root at cust19-1-prod-domain userqa]# dovecot --version > 2.0.9 There have been a lot of fixes since that version; can you confirm that this problem is not in 2.0.19 (or better yet, 2.1.12?) > i enabled core dumps: > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot Does that work? The point is to set "ulimit -c unlimited". I don't know what package you're using, but Dovecot doesn't ship with an init script (at least, 2.0.9 didn't.) The only thing I know of is at http://wiki.dovecot.org/DovecotInit, and that doesn't use /etc/sysconfig at all. > > > Now I see this in /var/log/maillog: > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > service(imap): child 11265 killed with signal 11 (core dumped) > > core dumps are being written here, but they're empty: If you're still getting core dumps with 2.0.19, check your setting of "ulimit -c". It should be "unlimited" for this case. You may need to modify /etc/init.d/dovecot. My guess is that your /etc/sysconfig/dovecot modification is having no effect. Jim -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQIcBAEBAgAGBQJQ31ASAAoJELUeD3oQ5ZpZkfIQAKEoVPO0Cldfec12WC/dGGoZ gdkZ10boxc+OoWP3Yhx4reWgIrvodaHaz7jxAhXGwasILXWRTP4vPxWCd77PjNNB JXGQpimCJZaFtcQ6PKONqqz7jqZ6zj07ZzKJeZXrSSxzmH7zrgAveA0xi3k+OGpr qCv60j4qlHEyw3I2FBDzO1GokpCbWS0Z3FDBUM1Zf5yFgRNSvt3FK9FQXejRwYnO vsNiMINO/Z5x8FLp0CfqbsQDnInAPPFV73UnGPVkFOpnswCytRX6ILNm2e9jIs9s G2qSalVOIATbgxnL1DkjLpex+gslJBrBqQy2lIeUv0GMxn/vMCw7dmxPAW+ankup qd1izm6iKUXEhnz7CKgh3FX3kp/W0ijvBKwDRqwzPCKkOTdLKkjygKzfxtfZE6Ay NFyeN21zorb+EZUmDtoQNxDT7iLKNf9dK0dZDY4xVU7KnyFbheppK0CUVsCUq1F0 oYggVUJXtT2rshVUocPjYFF56y+Hgi8a0rAWfi5j+qmD1eqTjKJcRbIdu9AhUkW+ OD4tqgMNRAW5Ry4HDdWVCaPnyzILL+p2g/ujKN9MV5m82DFOUWy+jiB5F5iXXc/r H2ywrPH/ko0WGnTi7inPQJQ3ecu0seJ+wkwFPYNAmbXSV1Fp0NReJA5Cn6m/PKEC 1OxYVGRIJdLlF99zxDMw =jurE -----END PGP SIGNATURE----- From mattk at kraner.us Sat Dec 29 22:46:56 2012 From: mattk at kraner.us (Matt K) Date: Sat, 29 Dec 2012 15:46:56 -0500 Subject: [Dovecot] question In-Reply-To: References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: <20121229204653.15A111AE87DB@dovecot.org> At 08:40 PM 12/28/2012, Simon Brereton wrote: >On Dec 28, 2012 8:28 PM, wrote: > > > > I just install Dovecot and postfix. When I'm pull dovecot I see in the log > > that its checking for mail. if a put a test message locally on the server > > I can pull the message down to my cell phone and other computers. But when > > I try to a message from gmail or aol it doesn't come in to the server. > > > > > > it always bounces back to the place were I sent it from > >That would indicate a postfix issue since it would seem you are not getting >mail from outside your network/host. > >But either way you'll need config and log files of you'd like real help. > >Simon here is what i was able to find in /var/log/mail.err Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms Dec 29 18:06:06 kraner postfix[27406]: fatal: usage: postfix [-c config_dir] [-Dv] command Dec 29 18:19:38 kraner postfix/smtpd[27511]: fatal: no SASL authentication mechanisms Dec 29 18:22:48 kraner postfix/smtpd[27514]: fatal: no SASL authentication mechanisms Dec 29 20:20:43 kraner postfix/smtpd[27862]: fatal: no SASL authentication mechanisms Dec 29 20:42:03 kraner postfix/smtpd[27969]: fatal: no SASL authentication mechanisms Postfix config file alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = regexp:/etc/postfix/body_checks command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/lib/postfix data_directory = /var/lib/postfix debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 header_checks = regexp:/etc/postfix/header_checks home_mailbox = Maildir/ inet_protocols = ipv4 local_recipient_maps = proxy:unix:passwd.byname $alias_maps mailbox_size_limit = 1073741824 mailq_path = /usr/bin/mailq message_size_limit = 10485760 mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain mydomain = kraner.org myhostname = kraner.org mynetworks = 127.0.0.0/8 myorigin = $mydomain newaliases_path = /usr/bin/newaliases sendmail_path = /usr/sbin/postfix setgid_group = postdrop smtpd_banner = $myhostname ESMTP $mail_name (@@DISTRO@@) smtpd_client_restrictions = permit_mynetworks,reject_unknown_client,permit smtpd_recipient_restrictions = permit_mynetworks,permit_auth_destination,permit_sasl_authenticated,reject smtpd_sasl_auth_enable = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot unknown_local_recipient_reject_code = 550 From h.reindl at thelounge.net Sat Dec 29 22:57:46 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 29 Dec 2012 21:57:46 +0100 Subject: [Dovecot] question In-Reply-To: <20121229204653.15A111AE87DB@dovecot.org> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> <20121229204653.15A111AE87DB@dovecot.org> Message-ID: <50DF594A.3060609@thelounge.net> Am 29.12.2012 21:46, schrieb Matt K: > At 08:40 PM 12/28/2012, Simon Brereton wrote: >> On Dec 28, 2012 8:28 PM, wrote: >> > >> > I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> > that its checking for mail. if a put a test message locally on the server >> > I can pull the message down to my cell phone and other computers. But when >> > I try to a message from gmail or aol it doesn't come in to the server. >> > >> > >> > it always bounces back to the place were I sent it from >> >> That would indicate a postfix issue since it would seem you are not getting >> mail from outside your network/host. >> >> But either way you'll need config and log files of you'd like real help. >> >> Simon > > here is what i was able to find in /var/log/mail.err > Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms > Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms > Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms > Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms > Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms and what is set in your dovecot.conf? does IMAP/POP3 work? auth_mechanisms = CRAM-MD5 DIGEST-MD5 APOP PLAIN LOGIN -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From simon.buongiorno at gmail.com Sat Dec 29 23:02:25 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Sat, 29 Dec 2012 16:02:25 -0500 Subject: [Dovecot] question In-Reply-To: <50df56bc.889c320a.4d8b.6eefSMTPIN_ADDED_MISSING@mx.google.com> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> <50df56bc.889c320a.4d8b.6eefSMTPIN_ADDED_MISSING@mx.google.com> Message-ID: On Dec 29, 2012 3:46 PM, "Matt K" wrote: > > At 08:40 PM 12/28/2012, Simon Brereton wrote: >> >> On Dec 28, 2012 8:28 PM, wrote: >> > >> > I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> > that its checking for mail. if a put a test message locally on the server >> > I can pull the message down to my cell phone and other computers. But when >> > I try to a message from gmail or aol it doesn't come in to the server. >> > >> > >> > it always bounces back to the place were I sent it from >> >> That would indicate a postfix issue since it would seem you are not getting >> mail from outside your network/host. >> >> But either way you'll need config and log files of you'd like real help. >> >> Simon > > > here is what i was able to find in /var/log/mail.err > Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms > Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms > Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms > Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms > Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms > Dec 29 18:06:06 kraner postfix[27406]: fatal: usage: postfix [-c config_dir] [-Dv] command > Dec 29 18:19:38 kraner postfix/smtpd[27511]: fatal: no SASL authentication mechanisms > Dec 29 18:22:48 kraner postfix/smtpd[27514]: fatal: no SASL authentication mechanisms > Dec 29 20:20:43 kraner postfix/smtpd[27862]: fatal: no SASL authentication mechanisms > Dec 29 20:42:03 kraner postfix/smtpd[27969]: fatal: no SASL authentication mechanisms > > Postfix config file > > alias_database = hash:/etc/aliases > alias_maps = hash:/etc/aliases > body_checks = regexp:/etc/postfix/body_checks > command_directory = /usr/sbin > config_directory = /etc/postfix > daemon_directory = /usr/lib/postfix > data_directory = /var/lib/postfix > debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 > header_checks = regexp:/etc/postfix/header_checks > home_mailbox = Maildir/ > inet_protocols = ipv4 > local_recipient_maps = proxy:unix:passwd.byname $alias_maps > mailbox_size_limit = 1073741824 > mailq_path = /usr/bin/mailq > message_size_limit = 10485760 > mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain > mydomain = kraner.org > myhostname = kraner.org > mynetworks = 127.0.0.0/8 > myorigin = $mydomain > newaliases_path = /usr/bin/newaliases > sendmail_path = /usr/sbin/postfix > setgid_group = postdrop > smtpd_banner = $myhostname ESMTP $mail_name (@@DISTRO@@) > smtpd_client_restrictions = permit_mynetworks,reject_unknown_client,permit > smtpd_recipient_restrictions = permit_mynetworks,permit_auth_destination,permit_sasl_authenticated,reject > smtpd_sasl_auth_enable = yes > smtpd_sasl_local_domain = $myhostname > smtpd_sasl_path = private/auth > smtpd_sasl_security_options = noanonymous > smtpd_sasl_type = dovecot > unknown_local_recipient_reject_code = 550 > fatal: no SASL authentication mechanisms is pretty clear. Postfix doesn't allow external hosts to connect & relay mail, which explains what you're seeing. Why you're seeing that is better addressed on the postfix list, although you seem to have told postfix to use Dovecot for sasl auth, so maybe, since this is the Dovecot list you should send your Dovecot conf so we can see why it's not working. Also, if you ask on the postfix list you will be asked for the out-put of postfinger which can diagnose sasl problems. Simon From campee at gmail.com Sun Dec 30 11:15:44 2012 From: campee at gmail.com (Eric) Date: Sun, 30 Dec 2012 01:15:44 -0800 Subject: [Dovecot] dovecot crashing? In-Reply-To: <50DF5013.8020507@uvm.edu> References: <50DF5013.8020507@uvm.edu> Message-ID: Isn't the version I have (2.0.9) newer than 2.0.19? The newest RPM I could find for CentOS was dovecot-2.0.9-2, not all that much newer than what I am using. I am not opposed to upgrading, just not sure if I am seeing much in the way of RPMs for my system that I can use to upgrade to a version that is much newer than what I already have. I had taken the " echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot" command from the Dovecot page on enabling core dumps for Red Hat (http://www.dovecot.org/bugreport.html). I have also added unlimited core dump files to /etc/security/limits.conf and verified that whenever myself or anyone else opens a shell that "ulimit -c" shows an output of "unlimited". I don't see any mention of limits in my Dovecot init file either. The init script came with my RPM package and I have not modified it. Even though I have unlimited core dump files allowed, I am still getting core files that are 0 bytes in size in the mail user's home directory. Any idea why? [root at imapserver ~]# su - dovecot -bash-3.2$ ulimit -c unlimited -bash-3.2$ id uid=97(dovecot) gid=97(dovecot) groups=97(dovecot) [root at imapserver ~]# service dovecot restart Stopping Dovecot Imap: [ OK ] Starting Dovecot Imap: [ OK ] $ telnet imapserver imap Trying 1.1.1.1... Connected to imapserver (1.1.1.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 1 LOGIN imapuser imapuserpassword 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTOR E QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in 2 select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1356130761] UIDs valid * OK [UIDNEXT 8] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 2 OK [READ-WRITE] Select completed. 3 FETCH 1 BODY[] * 1 FETCH (FLAGS (\Seen) BODY[] {39306} ..... some brief message output ..... Connection closed by foreign host. And then I get an empty core file: [root at imapserver]# pwd /mnt/mail/imapuser [root at imapserver]# ls -lh core* -rw------- 1 imapuser imapuser 0 Dec 30 00:56 core.7319 On Sat, Dec 29, 2012 at 12:18 PM, Jim Lawson wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Eric, > > On 12/25/12 9:26 PM, Eric wrote: > > Happy holidays! I am experiencing an issue when trying to check my mail > > using IMAP. with Dovecot I have tried checking my mail using a full GUI > > client (Thunderbird) and telnet. Both times I get disconnected before all > > of my messages can be downloaded and I see an error in my mail log. Here > > are the details: > > > > > > [root at cust19-1-prod-domain userqa]# dovecot --version > > 2.0.9 > > There have been a lot of fixes since that version; can you confirm that > this problem is not in 2.0.19 (or better yet, 2.1.12?) > > > > i enabled core dumps: > > > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot > > Does that work? The point is to set "ulimit -c unlimited". I don't > know what package you're using, but Dovecot doesn't ship with an init > script (at least, 2.0.9 didn't.) The only thing I know of is at > http://wiki.dovecot.org/DovecotInit, and that doesn't use /etc/sysconfig > at all. > > > > > > > > Now I see this in /var/log/maillog: > > > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > > service(imap): child 11265 killed with signal 11 (core dumped) > > > > core dumps are being written here, but they're empty: > > If you're still getting core dumps with 2.0.19, check your setting of > "ulimit -c". It should be "unlimited" for this case. You may need to > modify /etc/init.d/dovecot. My guess is that your > /etc/sysconfig/dovecot modification is having no effect. > > Jim > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.12 (Darwin) > Comment: Using GnuPG with undefined - http://www.enigmail.net/ > > iQIcBAEBAgAGBQJQ31ASAAoJELUeD3oQ5ZpZkfIQAKEoVPO0Cldfec12WC/dGGoZ > gdkZ10boxc+OoWP3Yhx4reWgIrvodaHaz7jxAhXGwasILXWRTP4vPxWCd77PjNNB > JXGQpimCJZaFtcQ6PKONqqz7jqZ6zj07ZzKJeZXrSSxzmH7zrgAveA0xi3k+OGpr > qCv60j4qlHEyw3I2FBDzO1GokpCbWS0Z3FDBUM1Zf5yFgRNSvt3FK9FQXejRwYnO > vsNiMINO/Z5x8FLp0CfqbsQDnInAPPFV73UnGPVkFOpnswCytRX6ILNm2e9jIs9s > G2qSalVOIATbgxnL1DkjLpex+gslJBrBqQy2lIeUv0GMxn/vMCw7dmxPAW+ankup > qd1izm6iKUXEhnz7CKgh3FX3kp/W0ijvBKwDRqwzPCKkOTdLKkjygKzfxtfZE6Ay > NFyeN21zorb+EZUmDtoQNxDT7iLKNf9dK0dZDY4xVU7KnyFbheppK0CUVsCUq1F0 > oYggVUJXtT2rshVUocPjYFF56y+Hgi8a0rAWfi5j+qmD1eqTjKJcRbIdu9AhUkW+ > OD4tqgMNRAW5Ry4HDdWVCaPnyzILL+p2g/ujKN9MV5m82DFOUWy+jiB5F5iXXc/r > H2ywrPH/ko0WGnTi7inPQJQ3ecu0seJ+wkwFPYNAmbXSV1Fp0NReJA5Cn6m/PKEC > 1OxYVGRIJdLlF99zxDMw > =jurE > -----END PGP SIGNATURE----- > > From h.reindl at thelounge.net Sun Dec 30 14:05:26 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 30 Dec 2012 13:05:26 +0100 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: <50DF5013.8020507@uvm.edu> Message-ID: <50E02E06.2060701@thelounge.net> Am 30.12.2012 10:15, schrieb Eric: > Isn't the version I have (2.0.9) newer than 2.0.19? since when is 9 greater than 19? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From jtl+dovecot at uvm.edu Sun Dec 30 16:19:29 2012 From: jtl+dovecot at uvm.edu (Jim Lawson) Date: Sun, 30 Dec 2012 09:19:29 -0500 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: <50DF5013.8020507@uvm.edu> Message-ID: <50E04D71.4070904@uvm.edu> On 12/30/12 4:15 AM, Eric wrote: > Isn't the version I have (2.0.9) newer than 2.0.19? The newest RPM I could find for CentOS was dovecot-2.0.9-2, not all that much newer than what I am using. I am not opposed to upgrading, just not sure if I am seeing much in the way of RPMs for my system that I can use to upgrade to a version that is much newer than what I already have. 2.0.19 is newer than 2.0.9. 2.1.12 is newer than that. You may have to take the spec file and rpmbuild your own RPM, if you want to stick with RPMs. > I had taken the " echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot" command from the Dovecot page on enabling core dumps for Red Hat (http://www.dovecot.org/bugreport.html). I have also added unlimited core dump files to /etc/security/limits.conf and verified that whenever myself or anyone else opens a shell that "ulimit -c" shows an output of "unlimited". > > I don't see any mention of limits in my Dovecot init file either. The init script came with my RPM package and I have not modified it. > > Even though I have unlimited core dump files allowed, I am still getting core files that are 0 bytes in size in the mail user's home directory. Any idea why? Check disk space on the filesystem where Dovecot is trying to dump? Is there some other reason it can't write there (but can create files) ? Jim -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 896 bytes Desc: OpenPGP digital signature URL: From bra at fsn.hu Sun Dec 30 23:32:48 2012 From: bra at fsn.hu (Attila Nagy) Date: Sun, 30 Dec 2012 22:32:48 +0100 Subject: [Dovecot] Non-standard fields? Message-ID: <50E0B300.3010900@fsn.hu> Hi, Non-standard fields are mentioned here: http://wiki2.dovecot.org/MailboxFormat/Maildir and they are stated as currently not used. Questions: - am I right that if they will be used, they will be key=value pairs, like fields in the base filename? Like: 1035478339.27041_118.foo.org,S=1000,W=1030:2,S,X=12,A=something - or are they supposed to be flags, like: 1035478339.27041_118.foo.org,S=1000,W=1030:2,S,ABCD - are there any plans to utilize these? Thanks, From ben at morrow.me.uk Mon Dec 31 02:26:57 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Mon, 31 Dec 2012 00:26:57 +0000 Subject: [Dovecot] Kerberos/GSSAPI auth via .k5login file In-Reply-To: <50DDB480.1070906@global2000.at> References: <50DDB480.1070906@global2000.at> Message-ID: <20121231002656.GA2428@anubis.morrow.me.uk> At 4PM +0100 on 28/12/12 you (J?rg Herzinger) wrote: > Hi, we are currently moving our mailserver to a new server with Dovecot, > virtual users in LDAP, Passwords in Kerberos Setup. Everything works > fine except for GSSAPI which seems to be a bit buggy. > > The thing is, that when using a .k5login [1] file it seems that SASL > does not get passed the home directory specified userdb. In other words, > mails for user1 (see below) are stored in /home/domain.at/user1, while > the home dir defined in LDAP is /afs/domain.at/home/user1 (virtual > users, so only dovecot, not the system does know about this user and > home dir). If I do create a .k5login file in /home/domain.at/user1 with > the content "someotheruser at DOMAIN.AT", then someotheruser should be able > to authenticate himself as user1 via GSSAPI. However, this .k5login file > is completely ignored. So it seems to me that the home is not passed on > to SASL. That is correct. Dovecot's handling of .k5login is currently implemented by calling your system's krb5_kuserok or equivalent with the name of the system user Dovecot will be using. This means it's not possible to use .k5login (or cross-realm auth, I would assume) unless you're using system users. I've been wondering for a while about patching Dovecot to support its own krb5 ACL file under the Dovecot directory, not least because it would be useful to be able to give a principal IMAP access without necessarily giving it shell access, but it's not entirely straightforward since currently Dovecot verifies the Kerberos creds before it even tries to look up the user in the userdb. (Actually I've been thinking along the lines of some sort of 'authdb', parallel to the pass- and userdbs, which would subsume both kuserok and the current master user stuff, but I haven't had a chance yet to try a concrete implementation.) Ben From chchai at acelsys.com Mon Dec 31 04:43:08 2012 From: chchai at acelsys.com (Ch Chai) Date: Mon, 31 Dec 2012 10:43:08 +0800 Subject: [Dovecot] Vacation Notice Not Working Message-ID: To Dovecot, When I try to active Vacation Notice using Egroupware, I can see (xxxx.sieve) generated in mail server. but not working. OS : Fedora 14 Installed Packages: - Postfix - Dovecot (2.0.15) note : come with Fedora 14 - Dovecot-pigeonhole (2.0.15) note: come with Fedora 14 - ispconfig 2 - Egroupware (Email Client) my setting in /etc/dovecot/dovecot.conf protocols = sieve imap pop3 plugin { plugin = sieve sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service managesieve-login { inet_listener managesieve-login { address = * port = 2000 } } protocol lda { #hostname = example.com mail_plugins = sieve quota postmaster_address = postmaster at example.com auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-deliver.log } protocol sieve { managesieve_implementation_string = Cyrus timsieved v2.2.13 managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } From daniel.parthey at informatik.tu-chemnitz.de Mon Dec 31 05:18:46 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 31 Dec 2012 04:18:46 +0100 Subject: [Dovecot] Vacation Notice Not Working In-Reply-To: References: Message-ID: <20121231031845.GA12712@daniel.localdomain> Ch Chai wrote: > When I try to active Vacation Notice using Egroupware, I can see (xxxx.sieve) generated in mail server. but not working. * Which sieve related lines can you see in your dovecot logfiles? * Is .dovecot.sieve correctly symlinked to xxxx.sieve? * Can you post the contents of the xxxx.sieve file? * Do you have the problem with vacation of a current www.tine20.org release? Regards Daniel -- https://plus.google.com/103021802792276734820 From dormitionskete at hotmail.com Mon Dec 31 05:19:31 2012 From: dormitionskete at hotmail.com (DormitionSkete@hotmail.com) Date: Sun, 30 Dec 2012 20:19:31 -0700 Subject: [Dovecot] Dovecot Virtual Users with Sendmail Message-ID: I'm trying to get Dovecot working with Virtual Users and Sendmail on OpenIndiana 151a7. OpenIndiana is the Open Source continuation of OpenSolaris after Oracle tried to kill it off a couple of years ago shortly after acquiring Sun Microsystems. I'm not sure if this is so much a Dovecot problem, as much of a Sendmail problem. I thought this would probably be a better list to start with, though. If not, please let me know. I initially used this Dovecot wiki page to approach this: Simple Virtual User Installation http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall I had to make few minor changes, but I don't think anything significant to the problem I'm having. I can log into SquirrelMail with both virtual users, and with system users. I can send mail to system users from both virtual and system users. I can see the mail that I sent in the Sent Messages folder for both types of users. I just can't send mail to virtual users. When I try to, I get the following message: ERROR: Message not sent. Server replied: Requested action not taken: mailbox unavailable 550 5.1.1 ... User unknown My configuration info is as follows: systemuser at openindiana:~# /usr/local/sbin/dovecot --version 2.1.12 systemuser at openindiana:~# /usr/local/sbin/dovecot -n # 2.1.12: /usr/local/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 101 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_location = mbox:/home/vmail/%u/mail:INBOX=/var/mail/%u passdb { args = /usr/local/etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } ssl = no userdb { args = uid=vmail gid=vmail home=/home/vmail/%u driver = static } protocol lda { postmaster_address = systemuser at localhost } --- My dovecot password file looks something like this, though changed for obvious security reasons: systemuser:{PLAIN} systemuserPASS virtualuser1:{PLAIN}virtualuser1PASS virtualuser2:{PLAIN}virtualuser2PASS --- I read on this page that I needed to put the following in my sendmail dovecot.m4 file: Dovecot LDA with Sendmail http://wiki2.dovecot.org/LDA/Sendmail So this is my dovecot.m4 file, which shows up in my sendmail.cf file after recompiling my sendmail.mc file. ######################*****############## ### DOVECOT Mailer specification ### ##################*****################## Mdovecot, P=/usr/local/libexec/dovecot/dovecot-lda, F=DFMPhnu9, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP/HdrFromSMTP, T=DNS/RFC822/X-Unix, A=/usr/local/libexec/dovecot/dovecot-lda -d $u --- Finally, this is my sendmail.mc file: divert(-1) # # Copyright (c) 1983 Eric P. Allman # Copyright (c) 1988, 1993 # The Regents of the University of California. All rights reserved. # # Copyright 2009 Sun Microsystems, Inc. All rights reserved. # Use is subject to license terms. # # This is a configuration file for SunOS 5.8 (a.k.a. Solaris 8) and later # subsidiary machines. It has support for local and SMTP mail. The # confFALLBACK_SMARTHOST macro is enabled, which means that messages will # be sent to that host (which is set to mailhost.$m [$m is the local domain]) # if MX records are unavailable. A short-cut rule is also defined, which # says if the recipient host is in the local domain, send to it directly # instead of the smart host. # # If you want to customize this further, copy it to a name appropriate # for your environment and do the modifications there. # divert(0)dnl VERSIONID(`sendmail.mc (Sun)') OSTYPE(`solaris8')dnl DOMAIN(`solaris-generic')dnl define(`confFALLBACK_SMARTHOST', `mailhost$?m.$m$.')dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl FEATURE(local_procmail,`',`procmail -t -Y -a $h -d $u')dnl MAILER(`local')dnl MAILER(`smtp')dnl MAILER(`procmail')dnl MAILER(`dovecot')dnl LOCAL_NET_CONFIG R$* < @ $* .$m. > $* $#esmtp $@ $2.$m $: $1 < @ $2.$m. > $3 --- I think it is obvious that it is a problem with Sendmail not recognizing Dovecot's virtual users. But how do I fix it? If anyone could help me with this, I would *greatly* appreciate it. I've been picking away at this for about three weeks now, and I'm pretty much out of ideas of anything else to try. Cordially, Peter, hieromonk ---- Dormition Skete Monastery Website: http://www.DormitionSkete.org Convent Website: http://www.HolyApostlesConvent.org ---- From m at sys4.de Mon Dec 31 05:23:25 2012 From: m at sys4.de (Marc Schiffbauer) Date: Mon, 31 Dec 2012 04:23:25 +0100 Subject: [Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more) Message-ID: <1839842.HpUryo95cv@bart> Hi all, I am having a problem indexing one of my mailboxes using the solr fts backend in dovecot 2.1.12 For many mailboxes it works just fine, but on one mailbox I currently always get a panic. solr setup: Java: icedtea 6.1.11.5 Solr: 3.6.2 running in tomcat 7.0.32 Command to reproduce error: doveadm index -u my at user badmailbox I already noticed that there have been some solr backend fixes just before 2.1.21 release... Is this another bug in the backend? Any idea? IMO relevant logs line parts: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) complete dovecot log: doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198: mismatched tag (near: Apache Tomcat/7.0.32-gentoo - Error report

 

 

With Best Regards,

User Name

______________________= _

s= kype: user

cell phone: +1 224 600 0072

 

From: User Name
Sent: Friday, Dec= ember 21, 2012 6:23 PM
To: 'userqa_2938 at integration.aggregateknow= ledge.com'
Subject: FW:

 

 

With Best Regards,

User Name

_______________________

skype: eg= irik

cell phone: +1 224 600 0072

 

=

From: User Name
Sent: Friday, December 21, = 2012 5:27 PM
To: 'userqa_2938 at integration.company.com'=
Subject: FW:

 

 

With Best Regards,

User Name

_______________________

skype: user<= /o:p>

cell pho= ne: +1 224 600 0072

 

From: User Name
Sent: Friday, December 21, 2012 4:0= 5 PM
To: 'userqa_2938 at integration.company.com'
S= ubject:

&nb= sp;

 

 

With Best Regards,

User Name

______= _________________

skype: user

cell phone: +1 224 600 0072

 

= --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="report_company.xlsx" Content-Description: report_company.xlsx Content-Disposition: attachment; filename="report_company.xlsx"; size=20527; creation-date="Thu, 11 Oct 2012 22:38:14 GMT"; modification-date="Mon, 24 Dec 2012 22:08:22 GMT" Content-Transfer-Encoding: base64 UEsDBBQABgAIAAAAIQDretKTYgEAAJAEAAATANwBW0NvbnRlbnRfVHlwZXNdLnhtbCCi2AEooAAC AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAArFTLTsMwELwj8Q+RryhxywEh1LQHHkeoBHyAsTeNVce2vNvS/j2bhFaASqSq vSSKop2ZnRl7Mts0LltDQht8KcbFSGTgdTDWL0rx/vaU34oMSXmjXPBQii2gmE0vLyZv2wiY8bTH UtRE8U5K1DU0CosQwfOfKqRGEX+mhYxKL9UC5PVodCN18ASecmoxxHTywgKSNZDNVaJn1TCP3DhJ jAb9c1wwnsju+8GWuxQqRme1IlYu1978Yc1DVVkNJuhVw1xFB3bVosh/CZG2DvBkKowJlMEagBpX 9KA75geo1MpR9rhhB3rTEzg8brVvMwue7NbH2kYcYBj2btiTz5CWHyEsz+1K607RKOt3ug+VgNOb pxBRctYnC4DWcgMmjwwJiSzsPTvEzQVsd+9iRNm9Tm/h72rs8Yc8YB1YqwTmlRKfyrPX8yf2kI59 FjokOD6MXWfb6QMJyO4+mX4BAAD//wMAUEsDBBQABgAIAAAAIQC1VTAj9QAAAEwCAAALAM4BX3Jl bHMvLnJlbHMgosoBKKAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADlDAAAeGwv c3R5bGVzLnhtbFBLAQItABQABgAIAAAAIQDppiW4ggYAAFMbAAATAAAAAAAAAAAAAAAAALIUAAB4 bC90aGVtZS90aGVtZTEueG1sUEsBAi0AFAAGAAgAAAAhAOhJXyi8LAAAyx8BABgAAAAAAAAAAAAA AAAAZRsAAHhsL3dvcmtzaGVldHMvc2hlZXQxLnhtbFBLAQItABQABgAIAAAAIQAU45/9UAEAAGMC AAARAAAAAAAAAAAAAAAAAFdIAABkb2NQcm9wcy9jb3JlLnhtbFBLAQItABQABgAIAAAAIQBxujxc hQEAAAMDAAAQAAAAAAAAAAAAAAAAAN5KAABkb2NQcm9wcy9hcHAueG1sUEsFBgAAAAAKAAoAgAIA AJlNAAAAAA== --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- Connection closed by foreign host. From lazy404 at gmail.com Wed Dec 26 22:01:25 2012 From: lazy404 at gmail.com (Lazy) Date: Wed, 26 Dec 2012 21:01:25 +0100 Subject: [Dovecot] 2 node dovecot Message-ID: Hi, We run dovecot 2.1 on 2 nodes with shared nfs storage. Index files are kept on local disk. Second node is usually used only for email snapshots access. If primary node fails it is configured to take place of the primary imap server. Snapshots are additional namespaces with mail from various points in time. We need a way to easly copy multiple messages from snapshots to current mailboxes. It would be best to make current mailbox available as another namespace so one would simply copy messages from one folder to another. Is it safe ? There will be times when given user is writing to the same nfs based Maildir mailbox from 2 nodes both of them having separate index files. What will happen if already present message gets copied back from the snapshot ? Regards, Micha? Grz?dzicki From rgm at htt-consult.com Thu Dec 27 20:28:19 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Thu, 27 Dec 2012 13:28:19 -0500 Subject: [Dovecot] dovecot testinstallation does not tell how to quit Message-ID: <50DC9343.1000903@htt-consult.com> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing Dovecot login, and sure enough I found some at: wiki.dovecot.org/Testinstallation Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the wiki! Oh, I just guessed it: a logout From h.reindl at thelounge.net Thu Dec 27 20:33:31 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 27 Dec 2012 19:33:31 +0100 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DC9343.1000903@htt-consult.com> References: <50DC9343.1000903@htt-consult.com> Message-ID: <50DC947B.1080701@thelounge.net> Am 27.12.2012 19:28, schrieb Robert Moskowitz: > I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing > Dovecot login, and sure enough I found some at: > > wiki.dovecot.org/Testinstallation > > Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about > how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the > wiki! > > Oh, I just guessed it: > > a logout google "imap quit telnet session" leads to http://www.yuki-onna.co.uk/email/imap.html -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From rgm at htt-consult.com Thu Dec 27 21:38:46 2012 From: rgm at htt-consult.com (Robert Moskowitz) Date: Thu, 27 Dec 2012 14:38:46 -0500 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DC947B.1080701@thelounge.net> References: <50DC9343.1000903@htt-consult.com> <50DC947B.1080701@thelounge.net> Message-ID: <50DCA3C6.8080607@htt-consult.com> On 12/27/2012 01:33 PM, Reindl Harald wrote: > > Am 27.12.2012 19:28, schrieb Robert Moskowitz: >> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing >> Dovecot login, and sure enough I found some at: >> >> wiki.dovecot.org/Testinstallation >> >> Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about >> how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the >> wiki! >> >> Oh, I just guessed it: >> >> a logout > google "imap quit telnet session" leads to > http://www.yuki-onna.co.uk/email/imap.html > So there you have c logout and I got a logout to work as well. But I might think that a testing doc can include this little tidbit, rather than do yet another search. Since this is a Dovecot test doc, I also might think it would have POP3 testing instructions! But I was happy to find the IMAP. Now to figure out why RoundCube fails to login with the same user that I logged in via Telnet. Thanks for the pointer. From janfrode at tanso.net Thu Dec 27 23:17:49 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 27 Dec 2012 22:17:49 +0100 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? Message-ID: I'm preparing to set up a new set of directors on dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. Will it be OK to set up a ring of directors with 2x dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? -jf From tss at iki.fi Fri Dec 28 03:02:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 28 Dec 2012 03:02:54 +0200 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? In-Reply-To: References: Message-ID: On 27.12.2012, at 23.17, Jan-Frode Myklebust wrote: > I'm preparing to set up a new set of directors on > dovecot-ee-2.1.10.3-1, but would prefer to do this a bit gradually. > Will it be OK to set up a ring of directors with 2x > dovecot-ee-2.1.10.3-1 and 2x dovecot-2.0.14 ? The new v2.1 director code can handle running with old v2.1 directors (there were some protocol changes that improve things). I think v2.0 director is protocol compatible with the old v2.1 directors, so I think in theory it should work.. But it's definitely not ever been tested in practise, and v2.1 did fix a ton of director bugs. So if you end up testing it, I think you should be ready to quicky upgrade the other director as well if any errors show up in logs. From dave at morsberger.com Fri Dec 28 05:28:21 2012 From: dave at morsberger.com (David Morsberger) Date: Thu, 27 Dec 2012 22:28:21 -0500 Subject: [Dovecot] Missing Emails Message-ID: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again. Help!!!! This is a company email server. They live and die by their emails. Emails show up in inbox and then disappear. Anyone know why our emails are disappearing? I see a reference to it in the dovecot.index.cache file (last item) ^@^@^@Q^@^@^@0^@^@^@^@^@^@^@Message-ID: <1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> ^@^@^@^M^@^@^@7^@^@^@4^@^@^@^@^@^@^@Subject: Funeral program for Eileen Zbignewich ^@^E^@^@^@^@^@^@^@^F^@^@^@Z^@^@^@7^@^@^@^@^@^@^@Content-Type: multipart/mixed; boundary="-1578497492-264297203-1356660917=:93498" ^@^@^G^@^@^@4^@^@^@1^@^@^@^@^@^@^@Date: Thu, 27 Dec 2012 18:15:17 -0800 (PST) ^@^@^@^@^@^@^@^K^@^@^@^@^@^@^@^L^@^@^@^@^@^@^@^N^@^@^@8^@^@^@5^@^@^@^@^@^@^@To: "info at mmpcrofton.com" I searched the filesystem and cannot find them. bash-3.2# find . -exec grep Zbignewich {} \; -print Dec 04 00:30:26 master: Info: Dovecot v2.0.19apple1 starting up (core dumps disabled) I believe I turned on all debug and info messages. Here is what I see in postfix log: Dec 27 21:15:39 mini.mmpcrofton.com postfix/smtpd[20081]: 3CE164F4420: client=pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:39 mini.mmpcrofton.com postfix/cleanup[20086]: 3CE164F4420: message-id=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: from=, size=307659, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20081]: disconnect from pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: connect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: 5168E4F4447: client=localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/cleanup[20086]: 5168E4F4447: message-id=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com> Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: disconnect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: from=, size=308299, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtp[20102]: 3CE164F4420: to=, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.85/0.01/0/0.27, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 5168E4F4447) Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: removed Dec 27 21:15:40 mini.mmpcrofton.com postfix/pipe[20110]: 5168E4F4447: to=, orig_to=, relay=dovecot, delay=0.39, delays=0.03/0.01/0/0.35, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 27 21:15:41 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: removed dovecot_info.log Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: msgid=<1356660917.93498.YahooMailNeo at web163605.mail.gq1.yahoo.com>: saved mail to INBOX Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: push notification enabled Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: notify: graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: data sent: 1680 dovecot_debug.log Dec 27 21:15:40 lda: Debug: Loading modules from directory: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib10_quota_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_fts_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_push_notify_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_zlib_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib21_fts_sk_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib90_sieve_plugin.so Dec 27 21:15:40 lda: Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota=maildir:User quota:noenforcing Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=0 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Effective uid=214, gid=6, home= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args=noenforcing Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: maildir++: root=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, index=, control=, inbox=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: none: root=, index=, control=, inbox=, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts_sk: Disabled with in-memory indexes Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts: No backends enabled by the fts setting Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Destination address: graphicartist at mini.mmpcrofton.com (source: user at hostname) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user's script path /Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve doesn't exist (using global script path in stead) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user has no valid personal script Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: no scripts to execute: reverting to default delivery. Anyone know why our emails are disappearing? From sven at svenhartge.de Fri Dec 28 05:54:19 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 28 Dec 2012 04:54:19 +0100 Subject: [Dovecot] Missing Emails References: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> Message-ID: <09clpmsmvov8@mids.svenhartge.de> David Morsberger wrote: > I reported a problem with disappearing emails on my Apple Mountain > Lion server. Not sure if it ever stopped but I do know it is happening > again. > Help!!!! This is a company email server. They live and die by their > emails. > Emails show up in inbox and then disappear. > Anyone know why our emails are disappearing? You should configure the mail_log plugin to log all actions clients do to your mails: http://wiki2.dovecot.org/Plugins/MailLog I've had to debug similar problems in the past time (on a different IMAP server) and in _all_ cases it was something the user did, like having a client downloading the mails via POP3 (and forgetting about this) and complaining about missing mails from "the Webmailer Website". Or having configured a filter inside Thunderbird (and forgetting about this), instructing the client to delete mails matching a special rule. > I see a reference to it in the dovecot.index.cache file (last item) If there is a reference in this file, the mail must have reached dovecot. So the next step would be to find out, _what exactly_ the client does with it. See mail_log again. Gr??e, Sven. -- Sigmentation fault. Core dumped. From dave at morsberger.com Fri Dec 28 06:40:55 2012 From: dave at morsberger.com (David Morsberger) Date: Thu, 27 Dec 2012 23:40:55 -0500 Subject: [Dovecot] Missing Emails In-Reply-To: <09clpmsmvov8@mids.svenhartge.de> References: <689FAFDC-FD11-4142-9910-E8078E0FF181@morsberger.com> <09clpmsmvov8@mids.svenhartge.de> Message-ID: <99C2001A-B076-4F90-BE4A-C91B6C54F99F@morsberger.com> Sven, Thanks for the response. 1. Nobody should be using pop3. The missing email appears to be random. I believe pop downloads would delete them all. I have now turned off pop3. 2. Would a mail rule place it in the 'Trash'? I did not find the email on the file system. I'm trying a wider search. 3. I followed the instructions on the wiki but it still doesn't appear to be logging everything. conf.d/10-logging.conf # Log file to use for informational messages. Defaults to log_path. #info_log_path = info_log_path = /Library/Logs/Mail/dovecot_info.log # Log file to use for debug messages. Defaults to info_log_path. debug_log_path = /Library/Logs/Mail/dovecot_debug.log mail_plugins = $mail_plugins mail_log notify plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. mail_log_fields = uid box msgid size from subject size flags } I am not seeing messages of the following form in the dovecot_debug.log or dovecot_info.log imap(user): copy -> Trash: uid=908, msgid=<123.foo at bar> imap(user): deleted: uid=908, msgid=<123.foo at bar> imap(user): expunged: uid=908, msgid=<123.foo at bar> On Dec 27, 2012, at 10:54 PM, Sven Hartge wrote: > David Morsberger wrote: > >> I reported a problem with disappearing emails on my Apple Mountain >> Lion server. Not sure if it ever stopped but I do know it is happening >> again. > >> Help!!!! This is a company email server. They live and die by their >> emails. > >> Emails show up in inbox and then disappear. > >> Anyone know why our emails are disappearing? > > You should configure the mail_log plugin to log all actions clients do > to your mails: http://wiki2.dovecot.org/Plugins/MailLog > > I've had to debug similar problems in the past time (on a different IMAP > server) and in _all_ cases it was something the user did, like having a > client downloading the mails via POP3 (and forgetting about this) and > complaining about missing mails from "the Webmailer Website". Or having > configured a filter inside Thunderbird (and forgetting about this), > instructing the client to delete mails matching a special rule. > >> I see a reference to it in the dovecot.index.cache file (last item) > > If there is a reference in this file, the mail must have reached > dovecot. So the next step would be to find out, _what exactly_ the > client does with it. See mail_log again. > > Gr??e, > Sven. > > -- > Sigmentation fault. Core dumped. > From campee at gmail.com Fri Dec 28 07:21:38 2012 From: campee at gmail.com (Eric) Date: Thu, 27 Dec 2012 21:21:38 -0800 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: Message-ID: Can anyone help with this? On Tue, Dec 25, 2012 at 6:26 PM, Eric wrote: > Happy holidays! I am experiencing an issue when trying to check my mail > using IMAP. with Dovecot I have tried checking my mail using a full GUI > client (Thunderbird) and telnet. Both times I get disconnected before all > of my messages can be downloaded and I see an error in my mail log. Here > are the details: > > > [root at cust19-1-prod-domain userqa]# dovecot --version > 2.0.9 > > [root at cust19-1-prod-domain userqa]# dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.18-164.11.1.el5 x86_64 CentOS release 5.4 (Final) > disable_plaintext_auth = no > login_trusted_networks = 172.19.136.0 > mail_location = maildir:~/Maildir > mail_max_userip_connections = 100 > mbox_write_locks = fcntl > mmap_disable = yes > passdb { > args = scheme=plain username_format=%n /etc/dovecot/users > driver = passwd-file > } > protocols = imap > ssl = no > userdb { > args = username_format=%n /etc/dovecot/users > driver = passwd-file > } > [root at cust19-1-prod-domain userqa]# > > i try to check my mail: > > username at ops1-1-domain:~$ telnet cust19-1-prod-domain imap > Trying 172.19.136.223... > Connected to cust19-1-prod-domain.domain.net (172.19.136.223). > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > AUTH=PLAIN] Dovecot ready. > > 1 LOGIN userqa mypassword > 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT > CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC > ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in > > 3 EXAMINE INBOX > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) > * OK [PERMANENTFLAGS ()] Read-only mailbox. > * 1 EXISTS > * 0 RECENT > * OK [UNSEEN 1] First unseen. > * OK [UIDVALIDITY 1356130761] UIDs valid > * OK [UIDNEXT 5] Predicted next UID > * OK [HIGHESTMODSEQ 1] Highest > 3 OK [READ-ONLY] Select completed. > > 4 FETCH 1 BODY[] > > I get some binary output and some mail headers, but then it crashes.. > > Not sure if you guys want to see all of the extremely verbose output, so I > put it at the end of this message. The last messages that it processes is a > message with an Excel spreadsheet attached to it (a .xlsx file) > > i enabled core dumps: > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot > > Now I see this in /var/log/maillog: > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > service(imap): child 11265 killed with signal 11 (core dumped) > > core dumps are being written here, but they're empty: > > [root at cust19-1-prod-domain userqa]# pwd > /mnt/mail/userqa > [root at cust19-1-prod-domain userqa]# ls -lh > total 20K > -rw------- 1 userqa userqa 0 Dec 25 17:52 core.11111 > -rw------- 1 userqa userqa 0 Dec 25 17:53 core.11265 > -rw------- 1 userqa userqa 0 Dec 25 17:58 core.11812 > drwx------ 7 userqa userqa 4.0K Dec 25 17:58 Maildir > [root at cust19-1-prod-domain userqa]# > > What should I try now? Is it possible that Dovecot is having difficulty > processing the attachment file? If I delete this user's mailbox file and > send basic text e-mail to the user I can read/retrieve them just fine.. > there only seems to be an issue when this message with its attachment > arrives. The attachment seems small in size: > > Content-Disposition: attachment; filename="report_amex.xlsx"; size=20527; > > > That means the attachment is 20527 bytes, correct? > > Thank you for any suggestions/help you can offer! > > > Here's the message that it seems to be having issues with: > > Return-Path: > Received: from mxout.mailprovider.com (slb1-prod-domain.domain.net[172.19.136.4]) > by cust19-1-prod-domain.domain.net (8.13.8/8.13.8) with ESMTP id > qBOM8oIE029715 > for ; Mon, 24 Dec 2012 14:08:50 > -0800 > Received: from mxout.mailprovider.com (localhost [127.0.0.1]) > by mxout.mailprovider.com (Postfix) with ESMTP id 017E455325B > for ; Mon, 24 Dec 2012 17:08:51 > -0500 (EST) > X-Virus-Scanned: by SpamTitan at mail.lan > Received: from HUB025.mail.lan (unknown [10.110.2.1]) > by mxout.mailprovider.com (Postfix) with ESMTP id 63DA0553132 > for ; Mon, 24 Dec 2012 17:08:50 > -0500 (EST) > Received: from MAILR001.mail.lan ([10.110.18.28]) by HUB025.mail.lan > ([10.110.17.25]) with mapi; Mon, 24 Dec 2012 17:08:48 -0500 > From: User Name > To: "userqa_2938 at integration.company.com" > > Date: Mon, 24 Dec 2012 17:08:47 -0500 > Subject: > Thread-Index: Ac3fx0lCAoza6rTzQTSh8g52mx84GwAC2GGwAAH1lkAAkiyekA== > Message-ID: <0370E60157CA7E4097D81B9E09728A941CB269A29D at MAILR001.mail.lan> > Accept-Language: en-US > Content-Language: en-US > X-MS-Has-Attach: yes > X-MS-TNEF-Correlator: > acceptlanguage: en-US > Content-Type: multipart/mixed; > > boundary="_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" > MIME-Version: 1.0 > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: multipart/alternative; > > boundary="_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_" > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: text/plain; charset="us-ascii" > Content-Transfer-Encoding: quoted-printable > > From: User Name > Sent: Friday, December 21, 2012 6:23 PM > To: 'userqa_2938 at integration.company.com' > Subject: FW: > > > With Best Regards, > User Name > > From: User Name > Sent: Friday, December 21, 2012 5:27 PM > To: 'userqa_2938 at integration.company.com' > Subject: FW: > > > With Best Regards, > User Name > > From: User Name > Sent: Friday, December 21, 2012 4:05 PM > To: 'userqa_2938 at integration.company.com' > Subject: > > > > With Best Regards, > User Name > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: text/html; charset="us-ascii" > Content-Transfer-Encoding: quoted-printable > > xmlns:o=3D"urn:schemas-micr= > osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" > = > xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" > xmlns=3D"http:= > //www.w3.org/TR/REC-html40"> CONTENT= > =3D"text/html; charset=3Dus-ascii"> content=3D"Micros= > oft Word 12 (filtered medium)"> vli= > nk=3Dpurple>

style=3D'c= > olor:#1F497D'> 

=3D'color:#1F497D'> 

class=3DMsoNormal> pan style=3D'color:#1F497D'>With Best Regards,

clas= > s=3DMsoNormal>User Name p>

style=3D'color:#1F497D'>______________________= > _

style=3D'color:#1F497D'>s= > kype: user

:#1F497D'>cell phone: +1 224 600 0072

=3DMsoNormal> style=3D'color:#1F497D'> 

>
0in= > 0in 0in'>

style=3D'font-size:10.0pt;font-fami= > ly:"Tahoma","sans-serif"'>From: style=3D'font-size:10.0pt;f= > ont-family:"Tahoma","sans-serif"'> User Name
Sent: Friday, Dec= > ember 21, 2012 6:23 PM
To: 'userqa_2938 at integration.aggregateknow > = > ledge.com'
Subject: FW:

clas= > s=3DMsoNormal> 

style=3D'colo= > r:#1F497D'> 

styl= > e=3D'color:#1F497D'>With Best Regards,

class=3DMsoN= > ormal>User Name

ss=3DMsoNormal> style=3D'color:#1F497D'>_______________________ o:p>

skype: > eg= > irik

style=3D'color:#1F497D= > '>cell phone: +1 224 600 0072

class=3DMsoNorm= > al> 

styl= > e=3D'border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in > 0in'>= >

style=3D'font-size:10.0pt;font-family:"Tahoma= > ","sans-serif"'>From: style=3D'font-size:10.0pt;font-family= > :"Tahoma","sans-serif"'> User Name
Sent: Friday, December 21, = > 2012 5:27 PM
To: 'userqa_2938 at integration.company.com'= >
Subject: FW:

class=3DMsoNor= > mal> 

style=3D'color:#1F497D'= > > 

style=3D'color= > :#1F497D'>With Best Regards,

class=3DMsoNormal> n style=3D'color:#1F497D'>User Name

rmal> style=3D'color:#1F497D'>_______________________ >

skype: user<= > /o:p>

cell > pho= > ne: +1 224 600 0072

s= > tyle=3D'color:#1F497D'> 

style=3D'borde= > r:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>

=3DMsoNormal> style=3D'font-size:10.0pt;font-family:"Tahoma","sans-= > serif"'>From: style=3D'font-size:10.0pt;font-family:"Tahoma= > ","sans-serif"'> User Name
Sent: Friday, December 21, 2012 4:0= > 5 PM
To: 'userqa_2938 at integration.company.com'
S= > ubject:

class=3DMsoNormal>&nb= > sp;

 

class=3DMsoNormal= > > 

With Best > Regards, >

User Name

______= > _________________

skype: user p>

cell phone: +1 224 600 0072

cla= > ss=3DMsoNormal> 

= > > --_000_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_ > Content-Type: > application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; > name="report_company.xlsx" > Content-Description: report_company.xlsx > Content-Disposition: attachment; filename="report_company.xlsx"; > size=20527; > creation-date="Thu, 11 Oct 2012 22:38:14 GMT"; > modification-date="Mon, 24 Dec 2012 22:08:22 GMT" > Content-Transfer-Encoding: base64 > > > UEsDBBQABgAIAAAAIQDretKTYgEAAJAEAAATANwBW0NvbnRlbnRfVHlwZXNdLnhtbCCi2AEooAAC > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAArFTLTsMwELwj8Q+RryhxywEh1LQHHkeoBHyAsTeNVce2vNvS/j2bhFaASqSq > > vSSKop2ZnRl7Mts0LltDQht8KcbFSGTgdTDWL0rx/vaU34oMSXmjXPBQii2gmE0vLyZv2wiY8bTH > > UtRE8U5K1DU0CosQwfOfKqRGEX+mhYxKL9UC5PVodCN18ASecmoxxHTywgKSNZDNVaJn1TCP3DhJ > > jAb9c1wwnsju+8GWuxQqRme1IlYu1978Yc1DVVkNJuhVw1xFB3bVosh/CZG2DvBkKowJlMEagBpX > > 9KA75geo1MpR9rhhB3rTEzg8brVvMwue7NbH2kYcYBj2btiTz5CWHyEsz+1K607RKOt3ug+VgNOb > > pxBRctYnC4DWcgMmjwwJiSzsPTvEzQVsd+9iRNm9Tm/h72rs8Yc8YB1YqwTmlRKfyrPX8yf2kI59 > > FjokOD6MXWfb6QMJyO4+mX4BAAD//wMAUEsDBBQABgAIAAAAIQC1VTAj9QAAAEwCAAALAM4BX3Jl > > bHMvLnJlbHMgosoBKKAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA > > AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADlDAAAeGwv > > c3R5bGVzLnhtbFBLAQItABQABgAIAAAAIQDppiW4ggYAAFMbAAATAAAAAAAAAAAAAAAAALIUAAB4 > > bC90aGVtZS90aGVtZTEueG1sUEsBAi0AFAAGAAgAAAAhAOhJXyi8LAAAyx8BABgAAAAAAAAAAAAA > > AAAAZRsAAHhsL3dvcmtzaGVldHMvc2hlZXQxLnhtbFBLAQItABQABgAIAAAAIQAU45/9UAEAAGMC > > AAARAAAAAAAAAAAAAAAAAFdIAABkb2NQcm9wcy9jb3JlLnhtbFBLAQItABQABgAIAAAAIQBxujxc > > hQEAAAMDAAAQAAAAAAAAAAAAAAAAAN5KAABkb2NQcm9wcy9hcHAueG1sUEsFBgAAAAAKAAoAgAIA > AJlNAAAAAA== > > --_004_0370E60157CA7E4097D81B9E09728A941CB269A29DMAILR001maill_-- > Connection closed by foreign host. > > > From kamath at moltingpenguin.com Fri Dec 28 08:11:26 2012 From: kamath at moltingpenguin.com (Sean Kamath) Date: Thu, 27 Dec 2012 22:11:26 -0800 Subject: [Dovecot] dovecot testinstallation does not tell how to quit In-Reply-To: <50DCA3C6.8080607@htt-consult.com> References: <50DC9343.1000903@htt-consult.com> <50DC947B.1080701@thelounge.net> <50DCA3C6.8080607@htt-consult.com> Message-ID: <411FD36C-D6F6-4EBF-9DD4-DB9B56800EC1@moltingpenguin.com> On Dec 27, 2012, at 11:38 AM, Robert Moskowitz wrote: > > On 12/27/2012 01:33 PM, Reindl Harald wrote: >> >> Am 27.12.2012 19:28, schrieb Robert Moskowitz: >>> I am having problems logging in with RoundCube, so thought I should see if there were instructions for testing >>> Dovecot login, and sure enough I found some at: >>> >>> wiki.dovecot.org/Testinstallation >>> >>> Well it works, so the problem is probably all RoundCube's, but this wiki page is missing an important line about >>> how to end the Telnet session without killing Telnet! What is the quit/exit command? And please add this to the >>> wiki! >>> >>> Oh, I just guessed it: >>> >>> a logout >> google "imap quit telnet session" leads to >> http://www.yuki-onna.co.uk/email/imap.html >> > So there you have > > c logout > > and I got > > a logout > > to work as well. Almost any identifier before the 'logout' will work. IMAP protocol uses a tagged command structure, so that commands can be interleaved and replies will respond with the identifier provided. I usually use '1 logout'. Note identifiers can be reused as well ;-) Sean PS At least it's now in the mail archives. :-) > But I might think that a testing doc can include this little tidbit, rather than do yet another search. Since this is a Dovecot test doc, I also might think it would have POP3 testing instructions! But I was happy to find the IMAP. Now to figure out why RoundCube fails to login with the same user that I logged in via Telnet. > > Thanks for the pointer. > > From pj.netfilter at gmail.com Fri Dec 28 09:58:26 2012 From: pj.netfilter at gmail.com (Joy) Date: Fri, 28 Dec 2012 13:28:26 +0530 Subject: [Dovecot] Help Regarding Multiple Base DN Message-ID: Dear Expert, Can i specify multiple Base DN for user lookup in dovecot like :- dc=abc,dc=com dc=abc,dc=net dc=xzy,dc=com dc=xyz,dc=net Thanks From janfrode at tanso.net Fri Dec 28 13:43:00 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 12:43:00 +0100 Subject: [Dovecot] Mixing v2.1 and 2.0 directors ? In-Reply-To: References: Message-ID: On Fri, Dec 28, 2012 at 2:02 AM, Timo Sirainen wrote: > > The new v2.1 director code can handle running with old v2.1 directors (there were some protocol changes that improve things). I think v2.0 director is protocol compatible with the old v2.1 directors, so I think in theory it should work.. But it's definitely not ever been tested in practise, and v2.1 did fix a ton of director bugs. So if you end up testing it, I think you should be ready to quicky upgrade the other director as well if any errors show up in logs. > Ok, I don't think I want to test this -- realistic testing is too hard. I'll rather upgrade the old directors (keeping same ip-addresses), so that I quickly can rollback in case something doesn't work as well as expected. BTW: What's the status of LMTP proxying in v2.1 (or more specifically dovecot-ee-2.1.10.3-1)? Do you know of many users of it, and has it proven itself much better than v2.0.14 ? I intend to upgrade the directors first, and leave the backend servers running v2.0.14 for a while.. that should be OK, right ? -jf From janfrode at tanso.net Fri Dec 28 13:51:14 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 12:51:14 +0100 Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: Don't know if having multiple Base DNs can work, but you can use %variables in it. We use this one to be able to have a simple onelevel scope on all lookups: base = ou=people,o=%d,o=ISP,o=example,c=com scope = onelevel -jf From janfrode at tanso.net Fri Dec 28 14:04:43 2012 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 28 Dec 2012 13:04:43 +0100 Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: Just checked the Variables documentation http://wiki2.dovecot.org/Variables, which says: %D - return "sub.domain.org" as "sub,dc=domain,dc=org" (for LDAP queries) so it seems* you should be able to use "base = %D" [*] assuming the wiki meant to say "dc=sub,dc=domain,dc=org" -jf From tomislav.mihalicek at gmail.com Fri Dec 28 13:41:44 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Fri, 28 Dec 2012 03:41:44 -0800 (PST) Subject: [Dovecot] Help Regarding Multiple Base DN In-Reply-To: References: Message-ID: <1356694904082-39423.post@n4.nabble.com> You can use multiple databases http://wiki2.dovecot.org/Authentication/MultipleDatabases -- View this message in context: http://dovecot.2317879.n4.nabble.com/Help-Regarding-Multiple-Base-DN-tp39422p39423.html Sent from the Dovecot mailing list archive at Nabble.com. From a.miederhoefer at gmx.de Fri Dec 28 14:17:56 2012 From: a.miederhoefer at gmx.de (=?iso-8859-1?Q?=22Antje_Miederh=F6fer=22?=) Date: Fri, 28 Dec 2012 13:17:56 +0100 Subject: [Dovecot] dovecot 2.1.12 panic in mbox-sync.c Message-ID: <20121228121756.22540@gmx.net> Hello! I use dovecot 2.1.12 locally on a 32bit Linux with an ext4 filesystem and after deleting a lot of emails from a mbox folder, I now get the following messages in the log: dovecot: imap(amied): Panic: file mbox-sync.c: line 1351 (mbox_sync_handle_eof_updates): assertion failed: (offset == 0 || offset > 31) dovecot: imap(amied): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4559a) [0x6f68959a] -> /usr/lib/dovecot/libdovecot.so.0(+0x45611) [0x6f689611] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x6f658fa0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x2d707) [0x6f708707] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_sync+0x53) [0x6f7091d3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_storage_sync_init+0x6d) [0x6f70936d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x3b) [0x6f72333b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3f) [0x6f72347f] -> dovecot/imap(cmd_select_full+0x16b) [0x805529b] -> dovecot/imap(cmd_select+0x17) [0x8055c57] -> dovecot/imap(command_exec+0x32) [0x80596f2] -> dovecot/imap() [0x80586fd] -> dovecot/imap() [0x805880d] -> dovecot/imap(client_handle_input+0x125) [0x8058a05] -> dovecot/imap(client_input+0x60) [0x80592f0] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x44) [0x6f6981f4] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xce) [0x6f6991ce] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x6f697cd0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2e) [0x6f680dbe] -> dovecot/imap(main+0x279) [0x804fdd9] -> /lib/libc.so.6(__libc_start_main+0xf5) [0x6f49bad5] -> dovecot/imap() [0x804ff51] The mbox file seems to be unchanged and a .lock file remains even after stopping dovecot. The folder is not accessible any more. A fix would be nice. :-) dovecot config: listen = 127.0.0.1 mail_fsync = never mail_location = maildir:/var/mails/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = no location = mbox:/var/mails/mbox/%u prefix = mbox/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = * driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap ssl_cert = Hi, we are currently moving our mailserver to a new server with Dovecot, virtual users in LDAP, Passwords in Kerberos Setup. Everything works fine except for GSSAPI which seems to be a bit buggy. The thing is, that when using a .k5login [1] file it seems that SASL does not get passed the home directory specified userdb. In other words, mails for user1 (see below) are stored in /home/domain.at/user1, while the home dir defined in LDAP is /afs/domain.at/home/user1 (virtual users, so only dovecot, not the system does know about this user and home dir). If I do create a .k5login file in /home/domain.at/user1 with the content "someotheruser at DOMAIN.AT", then someotheruser should be able to authenticate himself as user1 via GSSAPI. However, this .k5login file is completely ignored. So it seems to me that the home is not passed on to SASL. If I do add ldap to my nsswitch (for testing only) I additionally have real system users. Now if I create a .k5login in their home defined in LDAP which now also the system knows about everything works just fine. It is still the wrong home since its the one in LDAP and not the one defined by dovecot but at least it shows that our setup is working. See also debug log output below, a failed GSSAPI attempt produces no log output at all. Our System is Debian Wheezy on an amd64 (virtualized), dovecot Version 2.1.7, filesystem is ext4. Everything is tested with Firefox 17.0 on an Ubuntu Lucid client. Example LDAP user (not all of it...): ===================== dn: uid=user1,ou=people,dc=domain,dc=at structuralObjectClass: inetOrgPerson objectClass: inetOrgPerson objectClass: posixAccount objectClass: qmailUser uid: username uidNumber: 12345 gidNumber: 100 mail: username at domain.at homeDirectory: /afs/domain.at/home/user1 userPassword: {sasl}user1 at DOMAIN.AT And our dovecot userdb/passdb looks like this: ============================ root at mail201212 /etc/dovecot (git)-[master] # cat conf.d/10-auth.conf auth_gssapi_hostname = "$ALL" auth_krb5_keytab = /etc/dovecot/imap_smtp_mail201212.keytab auth_mechanisms = plain gssapi !include auth-virtual.conf.ext root at mail201212 /etc/dovecot (git)-[master] # cat conf.d/auth-virtual.conf.ext mail_uid = mailowner mail_gid = mailowner userdb { driver = ldap args = /etc/dovecot/ldap-userdb-user_g2.conf.ext } passdb { driver = pam } root at mail201212 /etc/dovecot (git)-[master] # cat /etc/dovecot/ldap-userdb-user_g2.conf.ext #http://www.postfix.org/ldap_table.5.html hosts = ldap1 ldap2 base = ou=people,dc=domain,dc=at user_attrs = uid=home=/home/domain.at/%$ user_filter = (&(objectClass=inetOrgPerson)(|(mail=%u)(mailalternateaddress=%u)(uid=%u))) Debug log output with system users (testing only) and a working GSSAPI auth: ================================================ Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_pgsql.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_sqlite.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 28 14:18:40 mail201212 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Dec 28 14:18:40 mail201212 dovecot: auth: Debug: passwd-file /etc/dovecot/shared_users: Read 1 users in 0 secs Dec 28 14:18:40 mail201212 dovecot: auth: Debug: auth client connected (pid=11875) Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: AUTH#0111#011GSSAPI#011service=imap#011secured#011session=1RaMgOnRZADAqCoq#011lip=192.168.43.100#011rip=192.168.42.42#011lport=993#011rport=55140 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(?,192.168.42.42,<1RaMgOnRZADAqCoq>): Using all keytab entries Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(user1 at domain.at,192.168.42.42,<1RaMgOnRZADAqCoq>): security context state completed. Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011YIGZBgkqhkiG9xIBAgICAG+BiTCBhqADAgEFoQMCAQ+iejB4oAMCARKicQRvMQu0Yxgom2SVOHW25FpxDbqalw/8nuMN1XH78FJUzJ/7CIv9dlQNUrKjFywqS9kNOxQY2sJR 7Ii0hw3i7BGV3VPmoeRJOsbYD5ahBh74NKqxdacN6rLj/cO5vWCee6Oel3rPgLV8kEcOVZOdAt6y Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: gssapi(user1 at domain.at,192.168.42.42,<1RaMgOnRZADAqCoq>): Negotiated security layer Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: CONT#0111#011BQQF/wAMAAAAAAAAC5QPNQH///+qs6lgevrvypjd1l4= Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client in: CONT Dec 28 14:18:41 mail201212 dovecot: auth: Debug: client out: OK#0111#011user=user1 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: master in: REQUEST#0111935278081#01111875#0111#0118d08e90a585981154d7c045ca230b1f9 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: ldap(user1,192.168.42.42,<1RaMgOnRZADAqCoq>): user search: base=ou=people,dc=domain,dc=at scope=subtree filter=(&(objectClass=inetOrgPerson)(|(mail=user1)(mailalternateaddress=user1)(uid=user1))) fields=uid Dec 28 14:18:41 mail201212 dovecot: auth: Debug: ldap(user1,192.168.42.42,<1RaMgOnRZADAqCoq>): result: uid=user1 Dec 28 14:18:41 mail201212 dovecot: auth: Debug: master out: USER#0111935278081#011user1#011home=/home/domain.at/user1 Dec 28 14:18:41 mail201212 dovecot: imap-login: Login: user=, method=GSSAPI, rip=192.168.42.42, lip=192.168.43.100, mpid=11878, TLS, session=<1RaMgOnRZADAqCoq> Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Effective uid=996, gid=997, home=/home/domain.at/user1 Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/maildir Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: maildir++: root=/home/domain.at/user1/maildir, index=, control=, inbox=/home/domain.at/user1/maildir, alt= Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: Namespace : type=public, prefix=PublicLists/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/listcaptor/maildir/ Dec 28 14:18:41 mail201212 dovecot: imap(user1): Debug: maildir++: root=/home/listcaptor/maildir, index=, control=, inbox=, alt= [1] http://web.mit.edu/kerberos/krb5-current/doc/user/user_config/k5login.html -- J?rg Herzinger - EDV Team GLOBAL 2000 - Friends of the Earth Austria Neustiftgasse 36, A-1070 Wien tel +43-699-14200030 Dieses Mail wurde mit Oekostrom und Opensource Software erstellt. From p.heinlein at heinlein-support.de Sat Dec 29 00:27:43 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Fri, 28 Dec 2012 23:27:43 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CC3381.1050608@hardwarefreak.com> References: <50CC2A64.30309@heinlein-support.de> <50CC3381.1050608@hardwarefreak.com> Message-ID: <50DE1CDF.8050902@heinlein-support.de> Am 15.12.2012 09:23, schrieb Stan Hoeppner:> On 12/15/2012 1:44 AM, Peer Heinlein wrote: >> But we're having much more then >> 30 TB of maildata and doing an fsck >> on huge partitions takes too much (down-) time for our mailsystem. > > Peer are you using NFS or a cluster filesystem? Linux on the hosts or > other? I don't understand the reason for the question. Even a NFS is based on a "real" filesystem that needs to be checked. So: Where's the difference?! But to answer your question: No, I'm using local Filesystems (and that's good!) and I'd absolutely avoid NFS or a ClusterFS for setups as big as this. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Sat Dec 29 00:35:53 2012 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Fri, 28 Dec 2012 23:35:53 +0100 Subject: [Dovecot] mdbox: more then one altstorage In-Reply-To: <50CECA38.3070403@um.es> References: <50CC2A64.30309@heinlein-support.de> <50CECA38.3070403@um.es> Message-ID: <50DE1EC9.5070500@heinlein-support.de> Am 17.12.2012 08:31, schrieb Angel L. Mateo: >> But we're having much more then >> 30 TB of maildata and doing an fsck >> on huge partitions takes too much (down-) time for our mailsystem. >> > Wouldn't be easier just to split your users between different > filesystems? I mean having different altstorages, but not as you propose > but one for the half of your users and other for the other half. For sure we DO have users split up into several 5 TB-partitions. This helps a little, but not a lot. And it creates some extra work and some extra sources of errors: You'll need Symlinks on the "real" fs or a user-dependend storage path in LDAP. But anyway, those partitions are tooo big for short filesystem checks (or if you make them smaller, you'd have too many). And, anyway: As I explained I'm interested in zero-downtime-checks, which wouldn't work just with several partitions. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From mattk at kraner.us Sat Dec 29 03:27:08 2012 From: mattk at kraner.us (mattk at kraner.us) Date: Fri, 28 Dec 2012 19:27:08 -0600 Subject: [Dovecot] question Message-ID: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> I just install Dovecot and postfix. When I'm pull dovecot I see in the log that its checking for mail. if a put a test message locally on the server I can pull the message down to my cell phone and other computers. But when I try to a message from gmail or aol it doesn't come in to the server. it always bounces back to the place were I sent it from From simon.buongiorno at gmail.com Sat Dec 29 03:40:24 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Fri, 28 Dec 2012 20:40:24 -0500 Subject: [Dovecot] question In-Reply-To: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: On Dec 28, 2012 8:28 PM, wrote: > > I just install Dovecot and postfix. When I'm pull dovecot I see in the log > that its checking for mail. if a put a test message locally on the server > I can pull the message down to my cell phone and other computers. But when > I try to a message from gmail or aol it doesn't come in to the server. > > > it always bounces back to the place were I sent it from That would indicate a postfix issue since it would seem you are not getting mail from outside your network/host. But either way you'll need config and log files of you'd like real help. Simon From h.reindl at thelounge.net Sat Dec 29 03:44:52 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 29 Dec 2012 02:44:52 +0100 Subject: [Dovecot] question In-Reply-To: References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: <50DE4B14.2040502@thelounge.net> Am 29.12.2012 02:40, schrieb Simon Brereton: > On Dec 28, 2012 8:28 PM, wrote: >> >> I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> that its checking for mail. if a put a test message locally on the server >> I can pull the message down to my cell phone and other computers. But when >> I try to a message from gmail or aol it doesn't come in to the server. >> >> >> it always bounces back to the place were I sent it from > > That would indicate a postfix issue since it would seem you are not getting > mail from outside your network/host. > > But either way you'll need config and log files of you'd like real help without logs it is impossible to say anything at least we ned the content of the bounce since our glassball died what is the destination domain? is the server reachable from the internet? is the MX or at least A-record configured? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From martin.rabl at rablnet.de Sat Dec 29 04:41:15 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 03:41:15 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? Message-ID: <50DE584B.3020207@rablnet.de> Hi, yesterday I did an update from dovecot 1.2 to 2.0.19 (Ubuntu 10.04 -> 12.04). After fixing the configuration dovecot startups as it should, but with one error, I don't understand: the INBOX will not be delivered to the Mailclient and will not be filled by "deliver". Instead, dovecot create the two dirs "new" and "cur" directly in "Maildir". the filesystem looks now like: domain/user1/Maildir/INBOX # official INBOX domain/user1/Maildir/new # new mail domain/user1/Maildir/cur # read mail We have searched for an configuration error, but didn't found anything - or did not see one ;-) Maybe there is someone in the list, which see our error in a moment? We are using only imap/s and managesieve, no pop3. Maildir-Layout is FS. Here a snippet of our configuration: ------------ mail_home = mail_location = maildir:~/Maildir:LAYOUT=fs namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir/:INDEX=%%h/Maildir/shared/%u:LAYOUT=fs prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { list = yes location = maildir:/srv/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } protocol lda { mail_plugins = sieve autocreate } protocol imap { imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags mail_max_userip_connections = 10 mail_plugins = acl autocreate imap_acl } ------------ Hope you can help! Thank you! Martin From tss at iki.fi Sat Dec 29 04:47:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 29 Dec 2012 04:47:02 +0200 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: <50DE584B.3020207@rablnet.de> References: <50DE584B.3020207@rablnet.de> Message-ID: No idea how that worked with your previous configuration (I guess accidentally/unintentionally), but I guess you want this: mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs On 29.12.2012, at 4.41, Martin Rabl wrote: > Hi, > > yesterday I did an update from dovecot 1.2 to 2.0.19 (Ubuntu 10.04 -> 12.04). > After fixing the configuration dovecot startups as it should, but with one error, I don't understand: the INBOX will not be delivered to the Mailclient and will not be filled by "deliver". > Instead, dovecot create the two dirs "new" and "cur" directly in "Maildir". > > the filesystem looks now like: > domain/user1/Maildir/INBOX # official INBOX > domain/user1/Maildir/new # new mail > domain/user1/Maildir/cur # read mail > > We have searched for an configuration error, but didn't found anything - or did not see one ;-) > > Maybe there is someone in the list, which see our error in a moment? > > We are using only imap/s and managesieve, no pop3. Maildir-Layout is FS. > > Here a snippet of our configuration: > > ------------ > > mail_home = > mail_location = maildir:~/Maildir:LAYOUT=fs > > > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > list = yes > location = maildir:%%h/Maildir/:INDEX=%%h/Maildir/shared/%u:LAYOUT=fs > prefix = shared/%%u/ > separator = / > subscriptions = no > type = shared > } > namespace { > list = yes > location = maildir:/srv/vmail/public:LAYOUT=fs > prefix = public/ > separator = / > subscriptions = no > type = public > } > > protocol lda { > mail_plugins = sieve autocreate > } > protocol imap { > imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags > mail_max_userip_connections = 10 > mail_plugins = acl autocreate imap_acl > } > > ------------ > > Hope you can help! > > Thank you! > > Martin > From martin.rabl at rablnet.de Sat Dec 29 04:50:43 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 03:50:43 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: References: <50DE584B.3020207@rablnet.de> Message-ID: <50DE5A83.2050908@rablnet.de> Hi, Am 29.12.12 03:47, schrieb Timo Sirainen: > No idea how that worked with your previous configuration (I guess accidentally/unintentionally), but I guess you want this: that were the "bugfixes" ;-) > mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs Thank you, I give it a try. Greetings, Martin From martin.rabl at rablnet.de Sat Dec 29 05:23:40 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 29 Dec 2012 04:23:40 +0100 Subject: [Dovecot] Update 1.2 -> 2.0 ... INBOX away? In-Reply-To: <50DE5A83.2050908@rablnet.de> References: <50DE584B.3020207@rablnet.de> <50DE5A83.2050908@rablnet.de> Message-ID: <50DE623C.4070603@rablnet.de> Thank you Timo! Runs! It is to late for configuring ... ;-)) Greetings, Martin Am 29.12.12 03:50, schrieb Martin Rabl: > Hi, > > Am 29.12.12 03:47, schrieb Timo Sirainen: >> No idea how that worked with your previous configuration (I guess >> accidentally/unintentionally), but I guess you want this: > that were the "bugfixes" ;-) > >> mail_location = maildir:~/Maildir:INBOX=~/Maildir/INBOX:LAYOUT=fs > Thank you, I give it a try. > > Greetings, > Martin > From kjonca at o2.pl Sat Dec 29 17:17:28 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 16:17:28 +0100 Subject: [Dovecot] lda crash? Message-ID: <87623ksx9z.fsf@alfa.kjonca> When I try to refilter some messages lda crash: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lda-log.txt URL: -------------- next part -------------- doveconf -n output -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot.confn Type: application/octet-stream Size: 1558 bytes Desc: not available URL: -------------- next part -------------- KJ -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Little known fact about Middle Earth: The Hobbits had a very sophisticated computer network! It was a Tolkien Ring... From kjonca at o2.pl Sat Dec 29 17:30:25 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 16:30:25 +0100 Subject: [Dovecot] lda crash? References: <87623ksx9z.fsf@alfa.kjonca> Message-ID: <87y5ggri3y.fsf@alfa.kjonca> kjonca at o2.pl (Kamil Jo?ca) writes: > When I try to refilter some messages lda crash: > KJ Sorry for wrong attachment in previoous post. -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lda-log.txt URL: -------------- next part -------------- -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Ditat Deus. [God enriches] From rs at sys4.de Sat Dec 29 18:09:42 2012 From: rs at sys4.de (Robert Schetterer) Date: Sat, 29 Dec 2012 17:09:42 +0100 Subject: [Dovecot] lda crash? In-Reply-To: <87623ksx9z.fsf@alfa.kjonca> References: <87623ksx9z.fsf@alfa.kjonca> Message-ID: <50DF15C6.4080600@sys4.de> Am 29.12.2012 16:17, schrieb Kamil Jo?ca: > include: sieve_global_dir is not set; have a look on this Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From kjonca at o2.pl Sat Dec 29 18:23:48 2012 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Sat, 29 Dec 2012 17:23:48 +0100 Subject: [Dovecot] lda crash? References: <87623ksx9z.fsf@alfa.kjonca> <50DF15C6.4080600@sys4.de> Message-ID: <87txr4rfmz.fsf@alfa.kjonca> Robert Schetterer writes: > Am 29.12.2012 16:17, schrieb Kamil Jo?ca: >> include: sieve_global_dir is not set; > have a look on this > No change after setting this parameter, lda crashes. KJ -- http://blogdebart.pl/2009/12/22/mamy-chorych-dzieci/ What we do not understand we do not possess. -- Goethe From rs at sys4.de Sat Dec 29 18:26:35 2012 From: rs at sys4.de (Robert Schetterer) Date: Sat, 29 Dec 2012 17:26:35 +0100 Subject: [Dovecot] lda crash? In-Reply-To: <87txr4rfmz.fsf@alfa.kjonca> References: <87623ksx9z.fsf@alfa.kjonca> <50DF15C6.4080600@sys4.de> <87txr4rfmz.fsf@alfa.kjonca> Message-ID: <50DF19BB.5020305@sys4.de> Am 29.12.2012 17:23, schrieb Kamil Jo?ca: > Robert Schetterer writes: > >> Am 29.12.2012 16:17, schrieb Kamil Jo?ca: >>> include: sieve_global_dir is not set; >> have a look on this >> > No change after setting this parameter, lda crashes. yeah, wait for other responses about your debug > > KJ > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From jtl+dovecot at uvm.edu Sat Dec 29 22:18:27 2012 From: jtl+dovecot at uvm.edu (Jim Lawson) Date: Sat, 29 Dec 2012 15:18:27 -0500 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: Message-ID: <50DF5013.8020507@uvm.edu> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Eric, On 12/25/12 9:26 PM, Eric wrote: > Happy holidays! I am experiencing an issue when trying to check my mail > using IMAP. with Dovecot I have tried checking my mail using a full GUI > client (Thunderbird) and telnet. Both times I get disconnected before all > of my messages can be downloaded and I see an error in my mail log. Here > are the details: > > > [root at cust19-1-prod-domain userqa]# dovecot --version > 2.0.9 There have been a lot of fixes since that version; can you confirm that this problem is not in 2.0.19 (or better yet, 2.1.12?) > i enabled core dumps: > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot Does that work? The point is to set "ulimit -c unlimited". I don't know what package you're using, but Dovecot doesn't ship with an init script (at least, 2.0.9 didn't.) The only thing I know of is at http://wiki.dovecot.org/DovecotInit, and that doesn't use /etc/sysconfig at all. > > > Now I see this in /var/log/maillog: > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > service(imap): child 11265 killed with signal 11 (core dumped) > > core dumps are being written here, but they're empty: If you're still getting core dumps with 2.0.19, check your setting of "ulimit -c". It should be "unlimited" for this case. You may need to modify /etc/init.d/dovecot. My guess is that your /etc/sysconfig/dovecot modification is having no effect. Jim -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQIcBAEBAgAGBQJQ31ASAAoJELUeD3oQ5ZpZkfIQAKEoVPO0Cldfec12WC/dGGoZ gdkZ10boxc+OoWP3Yhx4reWgIrvodaHaz7jxAhXGwasILXWRTP4vPxWCd77PjNNB JXGQpimCJZaFtcQ6PKONqqz7jqZ6zj07ZzKJeZXrSSxzmH7zrgAveA0xi3k+OGpr qCv60j4qlHEyw3I2FBDzO1GokpCbWS0Z3FDBUM1Zf5yFgRNSvt3FK9FQXejRwYnO vsNiMINO/Z5x8FLp0CfqbsQDnInAPPFV73UnGPVkFOpnswCytRX6ILNm2e9jIs9s G2qSalVOIATbgxnL1DkjLpex+gslJBrBqQy2lIeUv0GMxn/vMCw7dmxPAW+ankup qd1izm6iKUXEhnz7CKgh3FX3kp/W0ijvBKwDRqwzPCKkOTdLKkjygKzfxtfZE6Ay NFyeN21zorb+EZUmDtoQNxDT7iLKNf9dK0dZDY4xVU7KnyFbheppK0CUVsCUq1F0 oYggVUJXtT2rshVUocPjYFF56y+Hgi8a0rAWfi5j+qmD1eqTjKJcRbIdu9AhUkW+ OD4tqgMNRAW5Ry4HDdWVCaPnyzILL+p2g/ujKN9MV5m82DFOUWy+jiB5F5iXXc/r H2ywrPH/ko0WGnTi7inPQJQ3ecu0seJ+wkwFPYNAmbXSV1Fp0NReJA5Cn6m/PKEC 1OxYVGRIJdLlF99zxDMw =jurE -----END PGP SIGNATURE----- From mattk at kraner.us Sat Dec 29 22:46:56 2012 From: mattk at kraner.us (Matt K) Date: Sat, 29 Dec 2012 15:46:56 -0500 Subject: [Dovecot] question In-Reply-To: References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> Message-ID: <20121229204653.15A111AE87DB@dovecot.org> At 08:40 PM 12/28/2012, Simon Brereton wrote: >On Dec 28, 2012 8:28 PM, wrote: > > > > I just install Dovecot and postfix. When I'm pull dovecot I see in the log > > that its checking for mail. if a put a test message locally on the server > > I can pull the message down to my cell phone and other computers. But when > > I try to a message from gmail or aol it doesn't come in to the server. > > > > > > it always bounces back to the place were I sent it from > >That would indicate a postfix issue since it would seem you are not getting >mail from outside your network/host. > >But either way you'll need config and log files of you'd like real help. > >Simon here is what i was able to find in /var/log/mail.err Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms Dec 29 18:06:06 kraner postfix[27406]: fatal: usage: postfix [-c config_dir] [-Dv] command Dec 29 18:19:38 kraner postfix/smtpd[27511]: fatal: no SASL authentication mechanisms Dec 29 18:22:48 kraner postfix/smtpd[27514]: fatal: no SASL authentication mechanisms Dec 29 20:20:43 kraner postfix/smtpd[27862]: fatal: no SASL authentication mechanisms Dec 29 20:42:03 kraner postfix/smtpd[27969]: fatal: no SASL authentication mechanisms Postfix config file alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = regexp:/etc/postfix/body_checks command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/lib/postfix data_directory = /var/lib/postfix debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 header_checks = regexp:/etc/postfix/header_checks home_mailbox = Maildir/ inet_protocols = ipv4 local_recipient_maps = proxy:unix:passwd.byname $alias_maps mailbox_size_limit = 1073741824 mailq_path = /usr/bin/mailq message_size_limit = 10485760 mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain mydomain = kraner.org myhostname = kraner.org mynetworks = 127.0.0.0/8 myorigin = $mydomain newaliases_path = /usr/bin/newaliases sendmail_path = /usr/sbin/postfix setgid_group = postdrop smtpd_banner = $myhostname ESMTP $mail_name (@@DISTRO@@) smtpd_client_restrictions = permit_mynetworks,reject_unknown_client,permit smtpd_recipient_restrictions = permit_mynetworks,permit_auth_destination,permit_sasl_authenticated,reject smtpd_sasl_auth_enable = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot unknown_local_recipient_reject_code = 550 From h.reindl at thelounge.net Sat Dec 29 22:57:46 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 29 Dec 2012 21:57:46 +0100 Subject: [Dovecot] question In-Reply-To: <20121229204653.15A111AE87DB@dovecot.org> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> <20121229204653.15A111AE87DB@dovecot.org> Message-ID: <50DF594A.3060609@thelounge.net> Am 29.12.2012 21:46, schrieb Matt K: > At 08:40 PM 12/28/2012, Simon Brereton wrote: >> On Dec 28, 2012 8:28 PM, wrote: >> > >> > I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> > that its checking for mail. if a put a test message locally on the server >> > I can pull the message down to my cell phone and other computers. But when >> > I try to a message from gmail or aol it doesn't come in to the server. >> > >> > >> > it always bounces back to the place were I sent it from >> >> That would indicate a postfix issue since it would seem you are not getting >> mail from outside your network/host. >> >> But either way you'll need config and log files of you'd like real help. >> >> Simon > > here is what i was able to find in /var/log/mail.err > Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms > Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms > Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms > Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms > Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms and what is set in your dovecot.conf? does IMAP/POP3 work? auth_mechanisms = CRAM-MD5 DIGEST-MD5 APOP PLAIN LOGIN -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From simon.buongiorno at gmail.com Sat Dec 29 23:02:25 2012 From: simon.buongiorno at gmail.com (Simon Brereton) Date: Sat, 29 Dec 2012 16:02:25 -0500 Subject: [Dovecot] question In-Reply-To: <50df56bc.889c320a.4d8b.6eefSMTPIN_ADDED_MISSING@mx.google.com> References: <7f5abd5e499585366ce69b68e889bb66.squirrel@www.kraner.us> <50df56bc.889c320a.4d8b.6eefSMTPIN_ADDED_MISSING@mx.google.com> Message-ID: On Dec 29, 2012 3:46 PM, "Matt K" wrote: > > At 08:40 PM 12/28/2012, Simon Brereton wrote: >> >> On Dec 28, 2012 8:28 PM, wrote: >> > >> > I just install Dovecot and postfix. When I'm pull dovecot I see in the log >> > that its checking for mail. if a put a test message locally on the server >> > I can pull the message down to my cell phone and other computers. But when >> > I try to a message from gmail or aol it doesn't come in to the server. >> > >> > >> > it always bounces back to the place were I sent it from >> >> That would indicate a postfix issue since it would seem you are not getting >> mail from outside your network/host. >> >> But either way you'll need config and log files of you'd like real help. >> >> Simon > > > here is what i was able to find in /var/log/mail.err > Dec 28 18:02:36 kraner postfix/smtpd[26226]: fatal: no SASL authentication mechanisms > Dec 28 18:09:17 kraner postfix/smtpd[26229]: fatal: no SASL authentication mechanisms > Dec 28 18:29:15 kraner postfix/smtpd[26395]: fatal: no SASL authentication mechanisms > Dec 28 18:43:18 kraner postfix/smtpd[26736]: fatal: no SASL authentication mechanisms > Dec 28 18:48:59 kraner postfix/smtpd[26741]: fatal: no SASL authentication mechanisms > Dec 29 18:06:06 kraner postfix[27406]: fatal: usage: postfix [-c config_dir] [-Dv] command > Dec 29 18:19:38 kraner postfix/smtpd[27511]: fatal: no SASL authentication mechanisms > Dec 29 18:22:48 kraner postfix/smtpd[27514]: fatal: no SASL authentication mechanisms > Dec 29 20:20:43 kraner postfix/smtpd[27862]: fatal: no SASL authentication mechanisms > Dec 29 20:42:03 kraner postfix/smtpd[27969]: fatal: no SASL authentication mechanisms > > Postfix config file > > alias_database = hash:/etc/aliases > alias_maps = hash:/etc/aliases > body_checks = regexp:/etc/postfix/body_checks > command_directory = /usr/sbin > config_directory = /etc/postfix > daemon_directory = /usr/lib/postfix > data_directory = /var/lib/postfix > debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 > header_checks = regexp:/etc/postfix/header_checks > home_mailbox = Maildir/ > inet_protocols = ipv4 > local_recipient_maps = proxy:unix:passwd.byname $alias_maps > mailbox_size_limit = 1073741824 > mailq_path = /usr/bin/mailq > message_size_limit = 10485760 > mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain > mydomain = kraner.org > myhostname = kraner.org > mynetworks = 127.0.0.0/8 > myorigin = $mydomain > newaliases_path = /usr/bin/newaliases > sendmail_path = /usr/sbin/postfix > setgid_group = postdrop > smtpd_banner = $myhostname ESMTP $mail_name (@@DISTRO@@) > smtpd_client_restrictions = permit_mynetworks,reject_unknown_client,permit > smtpd_recipient_restrictions = permit_mynetworks,permit_auth_destination,permit_sasl_authenticated,reject > smtpd_sasl_auth_enable = yes > smtpd_sasl_local_domain = $myhostname > smtpd_sasl_path = private/auth > smtpd_sasl_security_options = noanonymous > smtpd_sasl_type = dovecot > unknown_local_recipient_reject_code = 550 > fatal: no SASL authentication mechanisms is pretty clear. Postfix doesn't allow external hosts to connect & relay mail, which explains what you're seeing. Why you're seeing that is better addressed on the postfix list, although you seem to have told postfix to use Dovecot for sasl auth, so maybe, since this is the Dovecot list you should send your Dovecot conf so we can see why it's not working. Also, if you ask on the postfix list you will be asked for the out-put of postfinger which can diagnose sasl problems. Simon From campee at gmail.com Sun Dec 30 11:15:44 2012 From: campee at gmail.com (Eric) Date: Sun, 30 Dec 2012 01:15:44 -0800 Subject: [Dovecot] dovecot crashing? In-Reply-To: <50DF5013.8020507@uvm.edu> References: <50DF5013.8020507@uvm.edu> Message-ID: Isn't the version I have (2.0.9) newer than 2.0.19? The newest RPM I could find for CentOS was dovecot-2.0.9-2, not all that much newer than what I am using. I am not opposed to upgrading, just not sure if I am seeing much in the way of RPMs for my system that I can use to upgrade to a version that is much newer than what I already have. I had taken the " echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot" command from the Dovecot page on enabling core dumps for Red Hat (http://www.dovecot.org/bugreport.html). I have also added unlimited core dump files to /etc/security/limits.conf and verified that whenever myself or anyone else opens a shell that "ulimit -c" shows an output of "unlimited". I don't see any mention of limits in my Dovecot init file either. The init script came with my RPM package and I have not modified it. Even though I have unlimited core dump files allowed, I am still getting core files that are 0 bytes in size in the mail user's home directory. Any idea why? [root at imapserver ~]# su - dovecot -bash-3.2$ ulimit -c unlimited -bash-3.2$ id uid=97(dovecot) gid=97(dovecot) groups=97(dovecot) [root at imapserver ~]# service dovecot restart Stopping Dovecot Imap: [ OK ] Starting Dovecot Imap: [ OK ] $ telnet imapserver imap Trying 1.1.1.1... Connected to imapserver (1.1.1.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 1 LOGIN imapuser imapuserpassword 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTOR E QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in 2 select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1356130761] UIDs valid * OK [UIDNEXT 8] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 2 OK [READ-WRITE] Select completed. 3 FETCH 1 BODY[] * 1 FETCH (FLAGS (\Seen) BODY[] {39306} ..... some brief message output ..... Connection closed by foreign host. And then I get an empty core file: [root at imapserver]# pwd /mnt/mail/imapuser [root at imapserver]# ls -lh core* -rw------- 1 imapuser imapuser 0 Dec 30 00:56 core.7319 On Sat, Dec 29, 2012 at 12:18 PM, Jim Lawson wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Eric, > > On 12/25/12 9:26 PM, Eric wrote: > > Happy holidays! I am experiencing an issue when trying to check my mail > > using IMAP. with Dovecot I have tried checking my mail using a full GUI > > client (Thunderbird) and telnet. Both times I get disconnected before all > > of my messages can be downloaded and I see an error in my mail log. Here > > are the details: > > > > > > [root at cust19-1-prod-domain userqa]# dovecot --version > > 2.0.9 > > There have been a lot of fixes since that version; can you confirm that > this problem is not in 2.0.19 (or better yet, 2.1.12?) > > > > i enabled core dumps: > > > > echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot > > Does that work? The point is to set "ulimit -c unlimited". I don't > know what package you're using, but Dovecot doesn't ship with an init > script (at least, 2.0.9 didn't.) The only thing I know of is at > http://wiki.dovecot.org/DovecotInit, and that doesn't use /etc/sysconfig > at all. > > > > > > > > Now I see this in /var/log/maillog: > > > > 2012-12-25T17:53:47-08:00 cust19-1-prod-domain dovecot: master: Error: > > service(imap): child 11265 killed with signal 11 (core dumped) > > > > core dumps are being written here, but they're empty: > > If you're still getting core dumps with 2.0.19, check your setting of > "ulimit -c". It should be "unlimited" for this case. You may need to > modify /etc/init.d/dovecot. My guess is that your > /etc/sysconfig/dovecot modification is having no effect. > > Jim > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.12 (Darwin) > Comment: Using GnuPG with undefined - http://www.enigmail.net/ > > iQIcBAEBAgAGBQJQ31ASAAoJELUeD3oQ5ZpZkfIQAKEoVPO0Cldfec12WC/dGGoZ > gdkZ10boxc+OoWP3Yhx4reWgIrvodaHaz7jxAhXGwasILXWRTP4vPxWCd77PjNNB > JXGQpimCJZaFtcQ6PKONqqz7jqZ6zj07ZzKJeZXrSSxzmH7zrgAveA0xi3k+OGpr > qCv60j4qlHEyw3I2FBDzO1GokpCbWS0Z3FDBUM1Zf5yFgRNSvt3FK9FQXejRwYnO > vsNiMINO/Z5x8FLp0CfqbsQDnInAPPFV73UnGPVkFOpnswCytRX6ILNm2e9jIs9s > G2qSalVOIATbgxnL1DkjLpex+gslJBrBqQy2lIeUv0GMxn/vMCw7dmxPAW+ankup > qd1izm6iKUXEhnz7CKgh3FX3kp/W0ijvBKwDRqwzPCKkOTdLKkjygKzfxtfZE6Ay > NFyeN21zorb+EZUmDtoQNxDT7iLKNf9dK0dZDY4xVU7KnyFbheppK0CUVsCUq1F0 > oYggVUJXtT2rshVUocPjYFF56y+Hgi8a0rAWfi5j+qmD1eqTjKJcRbIdu9AhUkW+ > OD4tqgMNRAW5Ry4HDdWVCaPnyzILL+p2g/ujKN9MV5m82DFOUWy+jiB5F5iXXc/r > H2ywrPH/ko0WGnTi7inPQJQ3ecu0seJ+wkwFPYNAmbXSV1Fp0NReJA5Cn6m/PKEC > 1OxYVGRIJdLlF99zxDMw > =jurE > -----END PGP SIGNATURE----- > > From h.reindl at thelounge.net Sun Dec 30 14:05:26 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 30 Dec 2012 13:05:26 +0100 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: <50DF5013.8020507@uvm.edu> Message-ID: <50E02E06.2060701@thelounge.net> Am 30.12.2012 10:15, schrieb Eric: > Isn't the version I have (2.0.9) newer than 2.0.19? since when is 9 greater than 19? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 261 bytes Desc: OpenPGP digital signature URL: From jtl+dovecot at uvm.edu Sun Dec 30 16:19:29 2012 From: jtl+dovecot at uvm.edu (Jim Lawson) Date: Sun, 30 Dec 2012 09:19:29 -0500 Subject: [Dovecot] dovecot crashing? In-Reply-To: References: <50DF5013.8020507@uvm.edu> Message-ID: <50E04D71.4070904@uvm.edu> On 12/30/12 4:15 AM, Eric wrote: > Isn't the version I have (2.0.9) newer than 2.0.19? The newest RPM I could find for CentOS was dovecot-2.0.9-2, not all that much newer than what I am using. I am not opposed to upgrading, just not sure if I am seeing much in the way of RPMs for my system that I can use to upgrade to a version that is much newer than what I already have. 2.0.19 is newer than 2.0.9. 2.1.12 is newer than that. You may have to take the spec file and rpmbuild your own RPM, if you want to stick with RPMs. > I had taken the " echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot" command from the Dovecot page on enabling core dumps for Red Hat (http://www.dovecot.org/bugreport.html). I have also added unlimited core dump files to /etc/security/limits.conf and verified that whenever myself or anyone else opens a shell that "ulimit -c" shows an output of "unlimited". > > I don't see any mention of limits in my Dovecot init file either. The init script came with my RPM package and I have not modified it. > > Even though I have unlimited core dump files allowed, I am still getting core files that are 0 bytes in size in the mail user's home directory. Any idea why? Check disk space on the filesystem where Dovecot is trying to dump? Is there some other reason it can't write there (but can create files) ? Jim -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 896 bytes Desc: OpenPGP digital signature URL: From bra at fsn.hu Sun Dec 30 23:32:48 2012 From: bra at fsn.hu (Attila Nagy) Date: Sun, 30 Dec 2012 22:32:48 +0100 Subject: [Dovecot] Non-standard fields? Message-ID: <50E0B300.3010900@fsn.hu> Hi, Non-standard fields are mentioned here: http://wiki2.dovecot.org/MailboxFormat/Maildir and they are stated as currently not used. Questions: - am I right that if they will be used, they will be key=value pairs, like fields in the base filename? Like: 1035478339.27041_118.foo.org,S=1000,W=1030:2,S,X=12,A=something - or are they supposed to be flags, like: 1035478339.27041_118.foo.org,S=1000,W=1030:2,S,ABCD - are there any plans to utilize these? Thanks, From ben at morrow.me.uk Mon Dec 31 02:26:57 2012 From: ben at morrow.me.uk (Ben Morrow) Date: Mon, 31 Dec 2012 00:26:57 +0000 Subject: [Dovecot] Kerberos/GSSAPI auth via .k5login file In-Reply-To: <50DDB480.1070906@global2000.at> References: <50DDB480.1070906@global2000.at> Message-ID: <20121231002656.GA2428@anubis.morrow.me.uk> At 4PM +0100 on 28/12/12 you (J?rg Herzinger) wrote: > Hi, we are currently moving our mailserver to a new server with Dovecot, > virtual users in LDAP, Passwords in Kerberos Setup. Everything works > fine except for GSSAPI which seems to be a bit buggy. > > The thing is, that when using a .k5login [1] file it seems that SASL > does not get passed the home directory specified userdb. In other words, > mails for user1 (see below) are stored in /home/domain.at/user1, while > the home dir defined in LDAP is /afs/domain.at/home/user1 (virtual > users, so only dovecot, not the system does know about this user and > home dir). If I do create a .k5login file in /home/domain.at/user1 with > the content "someotheruser at DOMAIN.AT", then someotheruser should be able > to authenticate himself as user1 via GSSAPI. However, this .k5login file > is completely ignored. So it seems to me that the home is not passed on > to SASL. That is correct. Dovecot's handling of .k5login is currently implemented by calling your system's krb5_kuserok or equivalent with the name of the system user Dovecot will be using. This means it's not possible to use .k5login (or cross-realm auth, I would assume) unless you're using system users. I've been wondering for a while about patching Dovecot to support its own krb5 ACL file under the Dovecot directory, not least because it would be useful to be able to give a principal IMAP access without necessarily giving it shell access, but it's not entirely straightforward since currently Dovecot verifies the Kerberos creds before it even tries to look up the user in the userdb. (Actually I've been thinking along the lines of some sort of 'authdb', parallel to the pass- and userdbs, which would subsume both kuserok and the current master user stuff, but I haven't had a chance yet to try a concrete implementation.) Ben From chchai at acelsys.com Mon Dec 31 04:43:08 2012 From: chchai at acelsys.com (Ch Chai) Date: Mon, 31 Dec 2012 10:43:08 +0800 Subject: [Dovecot] Vacation Notice Not Working Message-ID: To Dovecot, When I try to active Vacation Notice using Egroupware, I can see (xxxx.sieve) generated in mail server. but not working. OS : Fedora 14 Installed Packages: - Postfix - Dovecot (2.0.15) note : come with Fedora 14 - Dovecot-pigeonhole (2.0.15) note: come with Fedora 14 - ispconfig 2 - Egroupware (Email Client) my setting in /etc/dovecot/dovecot.conf protocols = sieve imap pop3 plugin { plugin = sieve sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service managesieve-login { inet_listener managesieve-login { address = * port = 2000 } } protocol lda { #hostname = example.com mail_plugins = sieve quota postmaster_address = postmaster at example.com auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-deliver.log } protocol sieve { managesieve_implementation_string = Cyrus timsieved v2.2.13 managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } From daniel.parthey at informatik.tu-chemnitz.de Mon Dec 31 05:18:46 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 31 Dec 2012 04:18:46 +0100 Subject: [Dovecot] Vacation Notice Not Working In-Reply-To: References: Message-ID: <20121231031845.GA12712@daniel.localdomain> Ch Chai wrote: > When I try to active Vacation Notice using Egroupware, I can see (xxxx.sieve) generated in mail server. but not working. * Which sieve related lines can you see in your dovecot logfiles? * Is .dovecot.sieve correctly symlinked to xxxx.sieve? * Can you post the contents of the xxxx.sieve file? * Do you have the problem with vacation of a current www.tine20.org release? Regards Daniel -- https://plus.google.com/103021802792276734820 From dormitionskete at hotmail.com Mon Dec 31 05:19:31 2012 From: dormitionskete at hotmail.com (DormitionSkete@hotmail.com) Date: Sun, 30 Dec 2012 20:19:31 -0700 Subject: [Dovecot] Dovecot Virtual Users with Sendmail Message-ID: I'm trying to get Dovecot working with Virtual Users and Sendmail on OpenIndiana 151a7. OpenIndiana is the Open Source continuation of OpenSolaris after Oracle tried to kill it off a couple of years ago shortly after acquiring Sun Microsystems. I'm not sure if this is so much a Dovecot problem, as much of a Sendmail problem. I thought this would probably be a better list to start with, though. If not, please let me know. I initially used this Dovecot wiki page to approach this: Simple Virtual User Installation http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall I had to make few minor changes, but I don't think anything significant to the problem I'm having. I can log into SquirrelMail with both virtual users, and with system users. I can send mail to system users from both virtual and system users. I can see the mail that I sent in the Sent Messages folder for both types of users. I just can't send mail to virtual users. When I try to, I get the following message: ERROR: Message not sent. Server replied: Requested action not taken: mailbox unavailable 550 5.1.1 ... User unknown My configuration info is as follows: systemuser at openindiana:~# /usr/local/sbin/dovecot --version 2.1.12 systemuser at openindiana:~# /usr/local/sbin/dovecot -n # 2.1.12: /usr/local/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 101 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_location = mbox:/home/vmail/%u/mail:INBOX=/var/mail/%u passdb { args = /usr/local/etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } ssl = no userdb { args = uid=vmail gid=vmail home=/home/vmail/%u driver = static } protocol lda { postmaster_address = systemuser at localhost } --- My dovecot password file looks something like this, though changed for obvious security reasons: systemuser:{PLAIN} systemuserPASS virtualuser1:{PLAIN}virtualuser1PASS virtualuser2:{PLAIN}virtualuser2PASS --- I read on this page that I needed to put the following in my sendmail dovecot.m4 file: Dovecot LDA with Sendmail http://wiki2.dovecot.org/LDA/Sendmail So this is my dovecot.m4 file, which shows up in my sendmail.cf file after recompiling my sendmail.mc file. ######################*****############## ### DOVECOT Mailer specification ### ##################*****################## Mdovecot, P=/usr/local/libexec/dovecot/dovecot-lda, F=DFMPhnu9, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP/HdrFromSMTP, T=DNS/RFC822/X-Unix, A=/usr/local/libexec/dovecot/dovecot-lda -d $u --- Finally, this is my sendmail.mc file: divert(-1) # # Copyright (c) 1983 Eric P. Allman # Copyright (c) 1988, 1993 # The Regents of the University of California. All rights reserved. # # Copyright 2009 Sun Microsystems, Inc. All rights reserved. # Use is subject to license terms. # # This is a configuration file for SunOS 5.8 (a.k.a. Solaris 8) and later # subsidiary machines. It has support for local and SMTP mail. The # confFALLBACK_SMARTHOST macro is enabled, which means that messages will # be sent to that host (which is set to mailhost.$m [$m is the local domain]) # if MX records are unavailable. A short-cut rule is also defined, which # says if the recipient host is in the local domain, send to it directly # instead of the smart host. # # If you want to customize this further, copy it to a name appropriate # for your environment and do the modifications there. # divert(0)dnl VERSIONID(`sendmail.mc (Sun)') OSTYPE(`solaris8')dnl DOMAIN(`solaris-generic')dnl define(`confFALLBACK_SMARTHOST', `mailhost$?m.$m$.')dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl FEATURE(local_procmail,`',`procmail -t -Y -a $h -d $u')dnl MAILER(`local')dnl MAILER(`smtp')dnl MAILER(`procmail')dnl MAILER(`dovecot')dnl LOCAL_NET_CONFIG R$* < @ $* .$m. > $* $#esmtp $@ $2.$m $: $1 < @ $2.$m. > $3 --- I think it is obvious that it is a problem with Sendmail not recognizing Dovecot's virtual users. But how do I fix it? If anyone could help me with this, I would *greatly* appreciate it. I've been picking away at this for about three weeks now, and I'm pretty much out of ideas of anything else to try. Cordially, Peter, hieromonk ---- Dormition Skete Monastery Website: http://www.DormitionSkete.org Convent Website: http://www.HolyApostlesConvent.org ---- From m at sys4.de Mon Dec 31 05:23:25 2012 From: m at sys4.de (Marc Schiffbauer) Date: Mon, 31 Dec 2012 04:23:25 +0100 Subject: [Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more) Message-ID: <1839842.HpUryo95cv@bart> Hi all, I am having a problem indexing one of my mailboxes using the solr fts backend in dovecot 2.1.12 For many mailboxes it works just fine, but on one mailbox I currently always get a panic. solr setup: Java: icedtea 6.1.11.5 Solr: 3.6.2 running in tomcat 7.0.32 Command to reproduce error: doveadm index -u my at user badmailbox I already noticed that there have been some solr backend fixes just before 2.1.21 release... Is this another bug in the backend? Any idea? IMO relevant logs line parts: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382) complete dovecot log: doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198: mismatched tag (near: Apache Tomcat/7.0.32-gentoo - Error report