From bertrand.caplet at chunkz.net Wed Apr 1 08:15:08 2015 From: bertrand.caplet at chunkz.net (Bertrand Caplet) Date: Wed, 01 Apr 2015 10:15:08 +0200 Subject: Deleting empty folders In-Reply-To: References: <550D2A58.3040504@gmx.de> <550DBD5D.60104@gmx.de> Message-ID: <726f77d76ee031f119ef8e998f217eca@chunkz.net> Le 2015-04-01 01:16, Samuel Williams a ?crit?: > Hi Hardy, I had over 1600 folders, writing manually doveadm mailbox > delete > would be a real pain. I guess I could script it but that's even more of > a > pain. It would be nice if there was a command to remove empty mailboxes > or > something similar. Hi Samuel, you could do: find -type d -name "* 1" -exec rmdir {} \; instead of rm -r, this will delete only really empty directories (no files, no hidden files). Have a good day, -- CHUNKZ.NET - dodgy DIYer and computer technician Bertrand Caplet, Flers (FR) Feel free to send encrypted/signed messages Key ID: FF395BD9 GPG FP: DE10 73FD 17EB 5544 A491 B385 1EDA 35DC FF39 5BD9 From kremels at kreme.com Wed Apr 1 09:28:45 2015 From: kremels at kreme.com (@lbutlr) Date: Wed, 1 Apr 2015 03:28:45 -0600 Subject: Deleting empty folders In-Reply-To: <726f77d76ee031f119ef8e998f217eca@chunkz.net> References: <550D2A58.3040504@gmx.de> <550DBD5D.60104@gmx.de> <726f77d76ee031f119ef8e998f217eca@chunkz.net> Message-ID: On Apr 1, 2015, at 2:15 AM, Bertrand Caplet wrote: > Le 2015-04-01 01:16, Samuel Williams a ?crit : >> Hi Hardy, I had over 1600 folders, writing manually doveadm mailbox delete >> would be a real pain. I guess I could script it but that's even more of a >> pain. It would be nice if there was a command to remove empty mailboxes or >> something similar. > > Hi Samuel, > > you could do: > find -type d -name "* 1" -exec rmdir {} \; find /path/to/clean -type d -empty -delete -- 'You don't think you've had enough, do you?' he said. I KNOW WHEN I'VE HAD ENOUGH. 'Everyone says that, though. I KNOW WHEN EVERYONE'S HAD ENOUGH. --Moving Pictures From bernd at petrovitsch.priv.at Wed Apr 1 11:04:12 2015 From: bernd at petrovitsch.priv.at (Bernd Petrovitsch) Date: Wed, 01 Apr 2015 13:04:12 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <55141F56.5070708@cs.ucy.ac.cy> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> Message-ID: <1427886253.3244.25.camel@thorin> On Don, 2015-03-26 at 17:01 +0200, Andreas Kasenides wrote: > On 26/03/15 13:05, Bernd Petrovitsch wrote: > > On Mon, 2015-03-23 at 16:08 +0200, Andreas Kasenides wrote: > >> I am usually emotionally (at least) against of open-source projects > >> loosing their independence to large corporations. Possibly due to bad > > OX-AG is a "large corporation"? > > Did I miss something? > > > > Kind regards, > > Bernd > > I have no idea how large is OX-AG. That is not what I said anyway. At Well, at least somewhat implicated IMHO. > least not what I meant. ;-) Fair enough! > I was trying to emphasize large or larger commercial entities trying to > take advantage of the OSS community. > Which happened many times in the past. Yes, there were some not-so-promising "take overs" but there were also others. IMHO the larger the corporation is, the less are the chances for *long-term* benefits of the OSS/free software (mainly because: usually commercial success is driven and defined from marketing to sales[1] sown to the techies which are forced into "features" and "delivery dates" to achieve some "company defined goal" - and that is usually not "bug free", "safe", or the like. Free software/OSS just happens that *at least* half of it should come from the "working level" and that is - at least - much more - ahemm - "inconvenient" for sales people). Bernd [1]: Sorry, but some "pre-sales techies" which are not really involved in the technical realization afterwards are just an excuse for the sales department. -- "I dislike type abstraction if it has no real reason. And saving on typing is not a good reason - if your typing speed is the main issue when you're coding, you're doing something seriously wrong." - Linus Torvalds From h.reindl at thelounge.net Wed Apr 1 11:07:58 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 01 Apr 2015 13:07:58 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <1427886253.3244.25.camel@thorin> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> Message-ID: <551BD18E.9000600@thelounge.net> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: > IMHO the larger the corporation is, the less are the chances for > *long-term* benefits of the OSS/free software (mainly because: usually > commercial success is driven and defined from marketing to sales[1] sown > to the techies which are forced into "features" and "delivery dates" to > achieve some "company defined goal" - and that is usually not "bug > free", "safe", or the like. Free software/OSS just happens that *at > least* half of it should come from the "working level" and that is - at > least - much more - ahemm - "inconvenient" for sales people) that is simple not true - if it would be true linux distributions would not include half baken and aplha quality sofwtare again and again in stable releases because "the market out there" the *possible* long-term benefits are more time to invest because a fixed income -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From bernd at petrovitsch.priv.at Wed Apr 1 12:33:57 2015 From: bernd at petrovitsch.priv.at (Bernd Petrovitsch) Date: Wed, 01 Apr 2015 14:33:57 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551BD18E.9000600@thelounge.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> Message-ID: <1427891638.3244.35.camel@thorin> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: > Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: > > IMHO the larger the corporation is, the less are the chances for > > *long-term* benefits of the OSS/free software (mainly because: usually > > commercial success is driven and defined from marketing to sales[1] sown > > to the techies which are forced into "features" and "delivery dates" to > > achieve some "company defined goal" - and that is usually not "bug > > free", "safe", or the like. Free software/OSS just happens that *at > > least* half of it should come from the "working level" and that is - at > > least - much more - ahemm - "inconvenient" for sales people) FWIW the context were large "old-school" corps (like Novell or Oracle) taking over free software companies. > that is simple not true - if it would be true linux distributions would Define "true Linux distribution". > not include half baken and aplha quality sofwtare again and again in > stable releases because "the market out there" That's everywhere in the commercial world the problem with "delivery vs quality/known problems" and someone's decision to ship or not to ship - based in whatever feels appropriate. BTW typical Linux distributions package some else's software and (almost) everyone knows that (and do not blame the distro for shipping buggy software - is there actually any bug-free software?;-). And it depends on - the package (core package like kernel, gcc, perl, apache-http, ...) vs some exotic application (the n+1.th text editor, MUA, ...). - the bug in question - is that stuff unusable or happens the bug only if you do crazy creative stuff on files with 6+GB size or 1000k lines? And usually distros run bug tracking and (try to) get bugs fixed - in house or upstream. > the *possible* long-term benefits are more time to invest because a > fixed income If the free software is the core business, it is not a problem (and these are not the companies in the discussion). Kind regards, BErnd -- "I dislike type abstraction if it has no real reason. And saving on typing is not a good reason - if your typing speed is the main issue when you're coding, you're doing something seriously wrong." - Linus Torvalds From h.reindl at thelounge.net Wed Apr 1 12:42:11 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 01 Apr 2015 14:42:11 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <1427891638.3244.35.camel@thorin> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> Message-ID: <551BE7A3.4030000@thelounge.net> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: > On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>> IMHO the larger the corporation is, the less are the chances for >>> *long-term* benefits of the OSS/free software (mainly because: usually >>> commercial success is driven and defined from marketing to sales[1] sown >>> to the techies which are forced into "features" and "delivery dates" to >>> achieve some "company defined goal" - and that is usually not "bug >>> free", "safe", or the like. Free software/OSS just happens that *at >>> least* half of it should come from the "working level" and that is - at >>> least - much more - ahemm - "inconvenient" for sales people) > > FWIW the context were large "old-school" corps (like Novell or Oracle) > taking over free software companies. > >> that is simple not true - if it would be true linux distributions would > > Define "true Linux distribution". who the fuck was talking abiut "true Linux distribution"? >> not include half baken and aplha quality sofwtare again and again in >> stable releases because "the market out there" > > That's everywhere in the commercial world the problem with "delivery vs > quality/known problems" and someone's decision to ship or not to ship - > based in whatever feels appropriate. and in the opensource world too - so shwat > BTW typical Linux distributions package some else's software and > (almost) everyone knows that (and do not blame the distro for shipping > buggy software - is there actually any bug-free software?;-). > > And it depends on > - the package (core package like kernel, gcc, perl, apache-http, ...) > vs some exotic application (the n+1.th text editor, MUA, ...). > - the bug in question - is that stuff unusable or happens the bug only > if you do crazy creative stuff on files with 6+GB size or 1000k lines? > And usually distros run bug tracking and (try to) get bugs fixed - in > house or upstream. no it don't - it depends in a braindead race include new software generations in alpha quality state instead wait until it become mature and *because* this happens with pure OSS too your statement above is wrong >> the *possible* long-term benefits are more time to invest because a >> fixed income > > If the free software is the core business, it is not a problem (and > these are not the companies in the discussion) and even if it is *not* the core business it is not a problem as long as you get what you have now maintained for free - if there is a new killer feature and you are a commercial mail hoster and don't want to spent a small amount of money your talking about opensource is hypocrisy because the only thing you care about is get anything for free -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From HFlor at gmx.de Wed Apr 1 13:14:07 2015 From: HFlor at gmx.de (Hardy Flor) Date: Wed, 01 Apr 2015 15:14:07 +0200 Subject: Deleting empty folders In-Reply-To: References: <550D2A58.3040504@gmx.de> <550DBD5D.60104@gmx.de> <726f77d76ee031f119ef8e998f217eca@chunkz.net> Message-ID: <551BEF1F.6070301@gmx.de> An administrator should be able to write a small script from my first post in this thread (to the search of empty mailboxes and the command to delete), in order to not having to access the files. Hardy Am 01.04.2015 um 11:28 schrieb @lbutlr: > find /path/to/clean -type d -empty -delete From bernd at petrovitsch.priv.at Wed Apr 1 13:57:22 2015 From: bernd at petrovitsch.priv.at (Bernd Petrovitsch) Date: Wed, 01 Apr 2015 15:57:22 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551BE7A3.4030000@thelounge.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> Message-ID: <1427896643.3244.45.camel@thorin> On Mit, 2015-04-01 at 14:42 +0200, Reindl Harald wrote: > Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: > > On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: > >> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: > >>> IMHO the larger the corporation is, the less are the chances for > >>> *long-term* benefits of the OSS/free software (mainly because: usually > >>> commercial success is driven and defined from marketing to sales[1] sown > >>> to the techies which are forced into "features" and "delivery dates" to > >>> achieve some "company defined goal" - and that is usually not "bug > >>> free", "safe", or the like. Free software/OSS just happens that *at > >>> least* half of it should come from the "working level" and that is - at > >>> least - much more - ahemm - "inconvenient" for sales people) > > > > FWIW the context were large "old-school" corps (like Novell or Oracle) > > taking over free software companies. > > > >> that is simple not true - if it would be true linux distributions would > > > > Define "true Linux distribution". > > who the fuck was talking abiut "true Linux distribution"? Ooops, sry, misread that ("," could help ....). Actually, the whole area/discussion IMHO too versatile to invalidate (or validate) anything with just one example - not everything is white or black ... One had to look at each situation and the circumstances/conditions/... (and there is no excuse for companies to fix a bugs paid by their customers and "forget" to send them upstream - if only to get a confirmation on the quality). > >> not include half baken and aplha quality sofwtare again and again in > >> stable releases because "the market out there" > > > > That's everywhere in the commercial world the problem with "delivery vs > > quality/known problems" and someone's decision to ship or not to ship - > > based in whatever feels appropriate. > > and in the opensource world too - so shwat Usually a maintainer has no direct pressure on "shipping"/releasing. And sometimes one actually ships known bugs if only to motivate the ones who should fix the bugs and one doesn't want to become hostage of some lazy contributors;-) [...] Kind regards, Bernd -- "I dislike type abstraction if it has no real reason. And saving on typing is not a good reason - if your typing speed is the main issue when you're coding, you're doing something seriously wrong." - Linus Torvalds From jfs.world at gmail.com Wed Apr 1 14:12:56 2015 From: jfs.world at gmail.com (Jeffrey 'jf' Lim) Date: Wed, 1 Apr 2015 22:12:56 +0800 Subject: Dovecot keeps creating info files in mail directory instead of home Message-ID: I've been trying to troubleshoot this for a while now, and I'm really at a loss. My userdb is set up correctly to return home, and mail, and a test with 'doveadm user' verifies this: # doveadm user user at domain field value uid 1000 gid 1000 home /var/domain/user mail maildir:/var/mail/user at domain I've reloaded, restarted, stopped and started dovecot again - and even deleted the info files in the mail directory just to be sure - but each and every time I log in with imap, dovecot recreates the files again (dovecot.index.log, dovecot-uidlist, etc.) in the mail directory instead of home. I've even made sure just in case that the home directory is accessible to all, and chmod 777, but nothing gets created there. And I dont get any errors at all in the logs. I'm on the latest version (2.2.16). -jf -- He who settles on the idea of the intelligent man as a static entity only shows himself to be a fool. Mensan / Full-Stack Technical Polymath / System Administrator 12 years over the entire web stack: Performance, Sysadmin, Ruby and Frontend From delrio at mie.utoronto.ca Wed Apr 1 14:25:57 2015 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Wed, 01 Apr 2015 10:25:57 -0400 Subject: Dovecot keeps creating info files in mail directory instead of home In-Reply-To: References: Message-ID: <551BFFF5.4020102@mie.utoronto.ca> On 04/ 1/15 10:12 AM, Jeffrey 'jf' Lim wrote: > My userdb is set up correctly to return home, and mail, and a test with > 'doveadm user' verifies this: > > # doveadm user user at domain > field value > uid 1000 > gid 1000 > home /var/domain/user > mail maildir:/var/mail/user at domain > > I've reloaded, restarted, stopped and started dovecot again - and even > deleted the info files in the mail directory just to be sure - but each and > every time I log in with imap, dovecot recreates the files again > (dovecot.index.log, dovecot-uidlist, etc.) in the mail directory instead of > home. You forgot to post your config. But the following might help: http://wiki2.dovecot.org/MailLocation/Maildir http://wiki2.dovecot.org/MailLocation#indexfiles From jfs.world at gmail.com Wed Apr 1 14:48:31 2015 From: jfs.world at gmail.com (Jeffrey 'jf' Lim) Date: Wed, 1 Apr 2015 22:48:31 +0800 Subject: Dovecot keeps creating info files in mail directory instead of home In-Reply-To: <551BFFF5.4020102@mie.utoronto.ca> References: <551BFFF5.4020102@mie.utoronto.ca> Message-ID: On Wed, Apr 1, 2015 at 10:25 PM, Oscar del Rio wrote: > On 04/ 1/15 10:12 AM, Jeffrey 'jf' Lim wrote: > >> My userdb is set up correctly to return home, and mail, and a test with >> 'doveadm user' verifies this: >> >> # doveadm user user at domain >> field value >> uid 1000 >> gid 1000 >> home /var/domain/user >> mail maildir:/var/mail/user at domain >> >> I've reloaded, restarted, stopped and started dovecot again - and even >> deleted the info files in the mail directory just to be sure - but each >> and >> every time I log in with imap, dovecot recreates the files again >> (dovecot.index.log, dovecot-uidlist, etc.) in the mail directory instead >> of >> home. >> > > You forgot to post your config. But the following might help: > > http://wiki2.dovecot.org/MailLocation/Maildir > http://wiki2.dovecot.org/MailLocation#indexfiles > Thanks. So I guess I had read http://wiki2.dovecot.org/VirtualUsers/Home wrongly (specifically, the statement about the home directory being the "mail user's private state directory"). I thought that state would include all of these files that I see in the maildir as well. Thanks for the link to http://wiki2.dovecot.org/MailLocation#indexfiles. So that points out that the index files are stored by default in the maildir. I'm having a hard time finding a similar statement for the control files, though (includes dovecot-uidvalidity* ?). http://wiki2.dovecot.org/MailLocation/Maildir#Control_files makes no mention of this. I assume this is also the case? Back to the home directory: so what sort of "state" is stored in the home directory exactly? Are all of the files that I see here in the maildir either control files or index files? -jf From jean-francois.senechal at ac.marche.be Wed Apr 1 15:45:12 2015 From: jean-francois.senechal at ac.marche.be (=?UTF-8?B?SmVhbi1GcmFuw6dvaXMgU8OpbsOpY2hhbA==?=) Date: Wed, 01 Apr 2015 17:45:12 +0200 Subject: Mismatch search user in ldap Message-ID: <551C1288.7060803@ac.marche.be> Hi I do not understand the right configuration I had a loop worries the users received the same message multiple times and testing other users config was not found so what is the right config to the following scheme My ldap scheme : mail: jf at marche.be gosaMailForwardingAddress: jf at citoyen.marche.be gosaMailAlternateAddress: toto at marche.be dovecot-ldap.conf.ext user_filter = (&(objectClass=posixAccount)(uid=%n)) virtual_mailbox_maps = proxy:ldap:/etc/postfix/ldap_virtual_recipients.cf virtual_alias_maps = proxy:ldap:/etc/postfix/ldap_virtual_recipients.cf ldap_virtual_recipients.cf : server_host = localhost search_base = ou=Users,ou=Citoyens,dc=marche,dc=be scope = sub bind = no version = 3 query_filter = (&(|(mail=%s)(gosaMailAlternateAddress=%s)(gosaMailForwardingAddress=%s)(uid=%s))(objectClass=gosaMailAccount)) result_attribute = uid is it correct ? thanks From bertrand.caplet at chunkz.net Wed Apr 1 17:48:16 2015 From: bertrand.caplet at chunkz.net (Bertrand Caplet) Date: Wed, 01 Apr 2015 19:48:16 +0200 Subject: Deleting empty folders In-Reply-To: <551BEF1F.6070301@gmx.de> References: <550D2A58.3040504@gmx.de> <550DBD5D.60104@gmx.de> <726f77d76ee031f119ef8e998f217eca@chunkz.net> <551BEF1F.6070301@gmx.de> Message-ID: <551C2F60.9020905@chunkz.net> > An administrator should be able to write a small script from my first > post in this thread (to the search of empty mailboxes and the command to > delete), in order to not having to access the files. > > Hardy I don't think there's any use of a script if "find /path/to/clean -type d -empty -delete" works fine. Have a nice evening, -- CHUNKZ.NET - dodgy DIYer and computer technician Bertrand Caplet, Flers (FR) Feel free to send encrypted/signed messages Key ID: 37F70C30 GPG FP: 134A 4027 518B 5F4D D409 558D BA9B 7BF0 37F7 0C30 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: OpenPGP digital signature URL: From micah at riseup.net Wed Apr 1 18:59:26 2015 From: micah at riseup.net (micah anderson) Date: Wed, 01 Apr 2015 14:59:26 -0400 Subject: Couldn't set transaction log view (seq 9..13) Message-ID: <87mw2rvfn5.fsf@muck.riseup.net> Hello, I'm using 2.2.13 on Debian stable, and I perform regular dsync backups. Typically if there is an error, dsync can recover from it the next time it is run, but I've been encountering a new error that doesn't seem to self-heal: # /usr/bin/dsync -u gae backup ssh -i /root/.ssh/id_rsa backmaildir at internal.example /usr/bin/dsync -u micah dsync-remote(micah): Error: /srv/maildirbackups/m/micah/daily.1/mailboxes/INBOX/dbox-Mails/dovecot.index: Couldn't set transaction log view (seq 9..13) dsync-remote(micah): Error: Failed to read transaction log for mailbox INBOX Re-running the dsync never fixes the issue. I'm happy to provide any additional information if so required to help track down this problem! micah From soumplis at ekt.gr Wed Apr 1 21:26:39 2015 From: soumplis at ekt.gr (Alexandros Soumplis) Date: Thu, 02 Apr 2015 00:26:39 +0300 Subject: Disk space usage with mdbox Message-ID: <551C628F.6090405@ekt.gr> Hello, I am using dovecot with mdbox+sis and I notice an ever increasing disk space usage since I converted mailboxes from Maildir to mdboxes. I have checked with a user and while it actually uses only 65K, his mdbox files on disk are more than 6G. The backup of his mailbox is just 64K. Any suggestions ? Below are some relevant commands: [root at mail ~]# doveadm quota get -u test Quota name Type Value Limit % User quota STORAGE 10135 31457280 0 User quota MESSAGE 186 - 0 [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ 220 /mdboxes/test/mailboxes 6029348 /mdboxes/test/storage 6029592 /mdboxes/test/ [root at mail ~]# doveadm purge -u test [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ 220 /mdboxes/test/mailboxes 6029348 /mdboxes/test/storage 6029592 /mdboxes/test/ [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ 16 /tmp/MDBOX_TEMP/mailboxes 65540 /tmp/MDBOX_TEMP/storage 65568 /tmp/MDBOX_TEMP/ From Merlin at DesktopMasters.com Wed Apr 1 23:53:15 2015 From: Merlin at DesktopMasters.com (Merlin at Desktop Masters) Date: Wed, 01 Apr 2015 16:53:15 -0700 Subject: Install process breaks its self by design In-Reply-To: <98c316ef03c137cca697d7c61c3c70ce@pettijohn-web.com> References: <55184B5C.4000804@DesktopMasters.com> <98c316ef03c137cca697d7c61c3c70ce@pettijohn-web.com> Message-ID: <551C84EB.6060409@DesktopMasters.com> Correct Correct Correct And when I went to the page it lead me here. Whomever is making the .deb packages needs to be made aware of this. Can you please point me into a direction? ~ Merlin On 4/1/2015 4:33 PM, edgar at pettijohn-web.com wrote: > On 2015-03-29 13:58, Merlin at Desktop Masters wrote: >> Greetings, >> >> I just tried to install Dovecot for the first time. It was on a >> virgin Ubuntu/Debian server (Version: 1:2.2.9-1ubuntu5) and the >> install failed. After a bit of struggling I worked out that the >> install fails BY DESIGN. Spoke about this with a few people and we >> decided it was best to report this issue and request that you redesign >> the packing so it does not fail. The reason it fails is as follows... >> > > This would be on Debian/Ubuntu. > >> When you install it asks you if you want to use self signed >> certificates. I have certificates so I said, "No". At the end of the >> install the script tries to start dovecot. It cannot because the >> service does not have certificates so it fails. This causes the >> script to abort and the other packages not to install and breaks the >> install process. I had to purge dovecot, then install it with the >> self signed certificates. >> >> So we have 2 issues here. 1. Why allow people to not install >> certificates if it is just going to break the install and confuse >> them. > > This would be on Debian/Ubuntu. > > 2. Why are you starting the service right after install when >> dovecot clearly requires manual configuration as part of the setup. > > This would be on Debian/Ubuntu. > >> >> I recommend you resolve this by NOT starting the service as part of >> the install unless it is an upgrade and the service was already >> running. >> > > This would be on Debian/Ubuntu. > >> ~ Merlin > From micah at riseup.net Thu Apr 2 00:40:40 2015 From: micah at riseup.net (micah) Date: Wed, 01 Apr 2015 20:40:40 -0400 Subject: Install process breaks its self by design In-Reply-To: <551C84EB.6060409@DesktopMasters.com> References: <55184B5C.4000804@DesktopMasters.com> <98c316ef03c137cca697d7c61c3c70ce@pettijohn-web.com> <551C84EB.6060409@DesktopMasters.com> Message-ID: <87k2xvuzuf.fsf@muck.riseup.net> Merlin at Desktop Masters writes: > Correct > Correct > Correct > > And when I went to the page it lead me here. Whomever is making the > .deb packages needs to be made aware of this. Can you please point me > into a direction? http://bugs.debian.org Specifically: https://www.debian.org/Bugs/Reporting From gedalya at gedalya.net Thu Apr 2 00:47:10 2015 From: gedalya at gedalya.net (Gedalya) Date: Wed, 01 Apr 2015 20:47:10 -0400 Subject: Install process breaks its self by design In-Reply-To: <551C84EB.6060409@DesktopMasters.com> References: <55184B5C.4000804@DesktopMasters.com> <98c316ef03c137cca697d7c61c3c70ce@pettijohn-web.com> <551C84EB.6060409@DesktopMasters.com> Message-ID: <551C918E.7000307@gedalya.net> On 04/01/2015 07:53 PM, Merlin at Desktop Masters wrote: > Correct > Correct > Correct > > And when I went to the page it lead me here. Whomever is making the > .deb packages needs to be made aware of this. Can you please point me > into a direction? The issue with ssl certificates has been a long, painful and complicated saga, occurring mostly upstream (Debian) and with one change apparently on the Ubuntu side as well. You should review the Debian change log to see the current status of this (there have been changes) and before you make any suggestions, try to familiarize yourself with what has been tried up until now and what the problems were. Read through the Debian change log and see where ssl is mentioned, and look at the cited bug reports by browsing to https://bugs.debian.org/ Have fun! http://changelogs.ubuntu.com/changelogs/pool/main/d/dovecot/dovecot_2.2.9-1ubuntu5/changelog https://tracker.debian.org/media/packages/d/dovecot/changelog-1%3A2.2.13-11 http://anonscm.debian.org/cgit/collab-maint/dovecot.git/log/ http://anonscm.debian.org/cgit/collab-maint/dovecot.git/tree/debian/dovecot-core.README.Debian https://help.ubuntu.com/community/ReportingBugs https://wiki.ubuntu.com/Debian/Bugs You should probably work this out with Debian rather than Ubuntu. > > ~ Merlin > > > On 4/1/2015 4:33 PM, edgar at pettijohn-web.com wrote: >> On 2015-03-29 13:58, Merlin at Desktop Masters wrote: >>> Greetings, >>> >>> I just tried to install Dovecot for the first time. It was on a >>> virgin Ubuntu/Debian server (Version: 1:2.2.9-1ubuntu5) and the >>> install failed. After a bit of struggling I worked out that the >>> install fails BY DESIGN. Spoke about this with a few people and we >>> decided it was best to report this issue and request that you redesign >>> the packing so it does not fail. The reason it fails is as follows... >>> >> >> This would be on Debian/Ubuntu. >> >>> When you install it asks you if you want to use self signed >>> certificates. I have certificates so I said, "No". At the end of the >>> install the script tries to start dovecot. It cannot because the >>> service does not have certificates so it fails. This causes the >>> script to abort and the other packages not to install and breaks the >>> install process. I had to purge dovecot, then install it with the >>> self signed certificates. >>> >>> So we have 2 issues here. 1. Why allow people to not install >>> certificates if it is just going to break the install and confuse >>> them. >> >> This would be on Debian/Ubuntu. >> >> 2. Why are you starting the service right after install when >>> dovecot clearly requires manual configuration as part of the setup. >> >> This would be on Debian/Ubuntu. >> >>> >>> I recommend you resolve this by NOT starting the service as part of >>> the install unless it is an upgrade and the service was already >>> running. >>> >> >> This would be on Debian/Ubuntu. >> >>> ~ Merlin >> From gedalya at gedalya.net Thu Apr 2 00:53:55 2015 From: gedalya at gedalya.net (Gedalya) Date: Wed, 01 Apr 2015 20:53:55 -0400 Subject: Install process breaks its self by design In-Reply-To: <551C918E.7000307@gedalya.net> References: <55184B5C.4000804@DesktopMasters.com> <98c316ef03c137cca697d7c61c3c70ce@pettijohn-web.com> <551C84EB.6060409@DesktopMasters.com> <551C918E.7000307@gedalya.net> Message-ID: <551C9323.3010103@gedalya.net> I think this is what you are looking for, specifically: http://anonscm.debian.org/cgit/collab-maint/dovecot.git/commit/?id=b2f652ff13956972b916e926568dab46a89e2dab From bind at enas.net Thu Apr 2 06:53:20 2015 From: bind at enas.net (Urban Loesch) Date: Thu, 02 Apr 2015 08:53:20 +0200 Subject: Disk space usage with mdbox In-Reply-To: <551C628F.6090405@ekt.gr> References: <551C628F.6090405@ekt.gr> Message-ID: <551CE760.8080508@enas.net> Did you "purged" the deleted mails for this user? On mdbox you must run "doveadm purge -u $USER" to whipe out any as deleted marked mails etc. Details: http://wiki2.dovecot.org/Tools/Doveadm/Purge I use a nightly cronjob wor this. Regards Urban Am 01.04.2015 um 23:26 schrieb Alexandros Soumplis: > Hello, > > I am using dovecot with mdbox+sis and I notice an ever increasing disk space usage since I converted mailboxes from Maildir to mdboxes. I have checked > with a user and while it actually uses only 65K, his mdbox files on disk are more than 6G. The backup of his mailbox is just 64K. Any suggestions ? > > Below are some relevant commands: > > [root at mail ~]# doveadm quota get -u test > Quota name Type Value Limit % > User quota STORAGE 10135 31457280 0 > User quota MESSAGE 186 - 0 > > [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ > 220 /mdboxes/test/mailboxes > 6029348 /mdboxes/test/storage > 6029592 /mdboxes/test/ > > [root at mail ~]# doveadm purge -u test > [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ > 220 /mdboxes/test/mailboxes > 6029348 /mdboxes/test/storage > 6029592 /mdboxes/test/ > > [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ > [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ > 16 /tmp/MDBOX_TEMP/mailboxes > 65540 /tmp/MDBOX_TEMP/storage > 65568 /tmp/MDBOX_TEMP/ > From soumplis at ekt.gr Thu Apr 2 07:09:34 2015 From: soumplis at ekt.gr (Alexandros Soumplis) Date: Thu, 02 Apr 2015 10:09:34 +0300 Subject: Disk space usage with mdbox In-Reply-To: <551CE760.8080508@enas.net> References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> Message-ID: <551CEB2E.6030601@ekt.gr> Yes I have done it, it is the third command I have run, without any change. a. On 02/04/2015 09:53 ??, Urban Loesch wrote: > Did you "purged" the deleted mails for this user? > On mdbox you must run "doveadm purge -u $USER" to whipe out any as deleted marked mails etc. > > Details: http://wiki2.dovecot.org/Tools/Doveadm/Purge > > I use a nightly cronjob wor this. > > Regards > Urban > > Am 01.04.2015 um 23:26 schrieb Alexandros Soumplis: >> Hello, >> >> I am using dovecot with mdbox+sis and I notice an ever increasing disk space usage since I converted mailboxes from Maildir to mdboxes. I have checked >> with a user and while it actually uses only 65K, his mdbox files on disk are more than 6G. The backup of his mailbox is just 64K. Any suggestions ? >> >> Below are some relevant commands: >> >> [root at mail ~]# doveadm quota get -u test >> Quota name Type Value Limit % >> User quota STORAGE 10135 31457280 0 >> User quota MESSAGE 186 - 0 >> >> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >> 220 /mdboxes/test/mailboxes >> 6029348 /mdboxes/test/storage >> 6029592 /mdboxes/test/ >> >> [root at mail ~]# doveadm purge -u test >> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >> 220 /mdboxes/test/mailboxes >> 6029348 /mdboxes/test/storage >> 6029592 /mdboxes/test/ >> >> [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ >> [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ >> 16 /tmp/MDBOX_TEMP/mailboxes >> 65540 /tmp/MDBOX_TEMP/storage >> 65568 /tmp/MDBOX_TEMP/ >> -- Alexandros Soumplis Systems Engineer (M.Sc, RHCE, VCP, SCSA) National Documentation Center / N.H.R.F. Information Systems Department 48, Vas. Constantinou Av. 116 35 Athens, Greece phone: +30 210 7273984 fax: +30 210 7252223 email: soumplis at ekt.gr http://www.ekt.gr From Christian.Schmidt at chemie.uni-hamburg.de Thu Apr 2 11:11:27 2015 From: Christian.Schmidt at chemie.uni-hamburg.de (Christian Schmidt) Date: Thu, 02 Apr 2015 13:11:27 +0200 Subject: Install process breaks its self by design In-Reply-To: <55184B5C.4000804@DesktopMasters.com> References: <55184B5C.4000804@DesktopMasters.com> Message-ID: <551D23DF.4070005@chemie.uni-hamburg.de> On 29.03.2015 20:58, Merlin at Desktop Masters wrote: > When you install it asks you if you want to use self signed > certificates. I have certificates so I said, "No". Why on earth don't you let the system install dovecot with a self-signed certificate first and point dovecot to your own certificate afterwards? Regards, Christian -- No signature available. From rblayzor.bulk at inoc.net Thu Apr 2 12:21:07 2015 From: rblayzor.bulk at inoc.net (Robert Blayzor) Date: Thu, 2 Apr 2015 08:21:07 -0400 Subject: Sieve/ManageSieve documentation on Wiki2 Message-ID: Is it possible the Sieve/ManageSieve documentation on the Wiki can be cleaned up? It's incredibly confusing now. Some of the Sieve configuration information says certain options are deprecated, but then the example on how to configure it uses the deprecated options rather than what they *should* be now. More confusion is the sieve plugin configuration listing those same deprecated options, yet when you pull the document on how to configure ManageSieve, it (again) uses deprecated configuration information? http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Configuration Or am I missing something? -- Robert inoc.net!rblayzor http://inoc.net/ From wdgarc88 at gmail.com Thu Apr 2 12:30:39 2015 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Thu, 2 Apr 2015 22:30:39 +1000 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551BE7A3.4030000@thelounge.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> Message-ID: On 4/1/15, Reindl Harald wrote: > > > Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>> IMHO the larger the corporation is, the less are the chances for >>>> *long-term* benefits of the OSS/free software (mainly because: usually >>>> commercial success is driven and defined from marketing to sales[1] >>>> sown >>>> to the techies which are forced into "features" and "delivery dates" to >>>> achieve some "company defined goal" - and that is usually not "bug >>>> free", "safe", or the like. Free software/OSS just happens that *at >>>> least* half of it should come from the "working level" and that is - at >>>> least - much more - ahemm - "inconvenient" for sales people) >> >> FWIW the context were large "old-school" corps (like Novell or Oracle) >> taking over free software companies. >> >>> that is simple not true - if it would be true linux distributions would >> >> Define "true Linux distribution". > > who the fuck was talking abiut "true Linux distribution"? you were cockhead, not taking your drugs again reindl eh or may be you are taking too much of the illegal ones and none of the ones the doctors prescribed you From h.reindl at thelounge.net Thu Apr 2 15:49:11 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 02 Apr 2015 17:49:11 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> Message-ID: <551D64F7.2050204@thelounge.net> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: > On 4/1/15, Reindl Harald wrote: >> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>> IMHO the larger the corporation is, the less are the chances for >>>>> *long-term* benefits of the OSS/free software (mainly because: usually >>>>> commercial success is driven and defined from marketing to sales[1] >>>>> sown >>>>> to the techies which are forced into "features" and "delivery dates" to >>>>> achieve some "company defined goal" - and that is usually not "bug >>>>> free", "safe", or the like. Free software/OSS just happens that *at >>>>> least* half of it should come from the "working level" and that is - at >>>>> least - much more - ahemm - "inconvenient" for sales people) >>> >>> FWIW the context were large "old-school" corps (like Novell or Oracle) >>> taking over free software companies. >>> >>>> that is simple not true - if it would be true linux distributions would >>> >>> Define "true Linux distribution". >> >> who the fuck was talking abiut "true Linux distribution"? > > you were cockhead no and if someone can't read a simple paragraph beause a missing comma it's not a compliment for him >>>> that is simple not true - if it would be true, >>>> linux distributions would > not taking your drugs again reindl eh or may be you > are taking too much of the illegal ones and none of the ones the > doctors prescribed you go and f** yourself since i didn't ask you to speak -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From jogi at mur.at Thu Apr 2 16:19:18 2015 From: jogi at mur.at (=?UTF-8?B?Sm9naSBIb2Ztw7xsbGVy?=) Date: Thu, 02 Apr 2015 18:19:18 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551D64F7.2050204@thelounge.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> Message-ID: <551D6C06.6070601@mur.at> Am 2015-04-02 um 17:49 schrieb Reindl Harald: > Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >> On 4/1/15, Reindl Harald wrote: >>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>> that is simple not true - if it would be true linux distributions >>>>> would >>>> >>>> Define "true Linux distribution". >>> >>> who the fuck was talking abiut "true Linux distribution"? >> >> you were cockhead > > no and if someone can't read a simple paragraph beause a missing comma > it's not a compliment for him Your sentence was not really entirely precise. What's the harm in saying sorry instead of barking at people? Cheers, -- j.hofm?ller mur.sat -- a space art project http://sat.mur.at/ -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: OpenPGP digital signature URL: From h.reindl at thelounge.net Thu Apr 2 16:24:38 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 02 Apr 2015 18:24:38 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551D6C06.6070601@mur.at> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> Message-ID: <551D6D46.3080905@thelounge.net> Am 02.04.2015 um 18:19 schrieb Jogi Hofm?ller: > Am 2015-04-02 um 17:49 schrieb Reindl Harald: >> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >>> On 4/1/15, Reindl Harald wrote: >>>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>>> that is simple not true - if it would be true linux distributions >>>>>> would >>>>> >>>>> Define "true Linux distribution". >>>> >>>> who the fuck was talking abiut "true Linux distribution"? >>> >>> you were cockhead >> >> no and if someone can't read a simple paragraph beause a missing comma >> it's not a compliment for him > > Your sentence was not really entirely precise. it was in the context > What's the harm in saying sorry instead of barking at people? sorry for what? for not have any understanding that people blame developers trying to make money and feed their family while release the software as free available opensource? and frankly *until* that has changed or at least the is a *single sign* that could change ever people should just shut up instead insinuate bad intentions to the developers all the thread long -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From jogi at mur.at Thu Apr 2 16:53:21 2015 From: jogi at mur.at (=?UTF-8?B?Sm9naSBIb2Ztw7xsbGVy?=) Date: Thu, 02 Apr 2015 18:53:21 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551D6D46.3080905@thelounge.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> Message-ID: <551D7401.5050302@mur.at> Am 2015-04-02 um 18:24 schrieb Reindl Harald: > Am 02.04.2015 um 18:19 schrieb Jogi Hofm?ller: >> Am 2015-04-02 um 17:49 schrieb Reindl Harald: >>> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >>>> On 4/1/15, Reindl Harald wrote: >>>>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>>>> that is simple not true - if it would be true linux distributions >>>>>>> would >>>>>> >>>>>> Define "true Linux distribution". >>>>> >>>>> who the fuck was talking abiut "true Linux distribution"? >>>> >>>> you were cockhead >>> >>> no and if someone can't read a simple paragraph beause a missing comma >>> it's not a compliment for him >> >> Your sentence was not really entirely precise. > > it was in the context > >> What's the harm in saying sorry instead of barking at people? > > sorry for what? For not being precise (enough). If someone doesn't understand you you could try expressing whatever you meant to say in a different/better way. Cheers, -- j.hofm?ller aka Thesix >-<#!&$@@@? http://thesix.mur.at/ -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 213 bytes Desc: OpenPGP digital signature URL: From dovecot.org at veggiechinese.net Thu Apr 2 19:22:44 2015 From: dovecot.org at veggiechinese.net (Will Yardley) Date: Thu, 2 Apr 2015 12:22:44 -0700 Subject: EL6 EE package dependencies Message-ID: <20150402192244.GA87445@aura.veggiechinese.net> I've been trying to upgrade Dovecot-ee package (on EL6/x86_64) from 2.2.15.8-1 to 2.2.16.2-1. It's complaining on these two dependencies: liblz4.so.1 libtextcat.so.0 These would both seem to be related to plugins, and don't seem to be required as package dependencies by the RPM from what I can see from the SRPM. Anyone know what packages I need to satisfy these dependencies? From ebroch at whitehorsetc.com Thu Apr 2 20:53:26 2015 From: ebroch at whitehorsetc.com (Eric Broch) Date: Thu, 02 Apr 2015 14:53:26 -0600 Subject: EL6 EE package dependencies In-Reply-To: <20150402192244.GA87445@aura.veggiechinese.net> References: <20150402192244.GA87445@aura.veggiechinese.net> Message-ID: <551DAC46.9030605@whitehorsetc.com> On 4/2/2015 1:22 PM, Will Yardley wrote: > I've been trying to upgrade Dovecot-ee package (on EL6/x86_64) from > 2.2.15.8-1 to 2.2.16.2-1. It's complaining on these two dependencies: > > liblz4.so.1 > libtextcat.so.0 > > These would both seem to be related to plugins, and don't seem to be > required as package dependencies by the RPM from what I can see from the > SRPM. > > Anyone know what packages I need to satisfy these dependencies? lz4-r127-1.el6.i686 and libtextcat-2.2-10.el6.i686 Eric From dovecot.org at veggiechinese.net Thu Apr 2 20:58:31 2015 From: dovecot.org at veggiechinese.net (Will Yardley) Date: Thu, 2 Apr 2015 13:58:31 -0700 Subject: EL6 EE package dependencies In-Reply-To: <551DAC46.9030605@whitehorsetc.com> References: <20150402192244.GA87445@aura.veggiechinese.net> <551DAC46.9030605@whitehorsetc.com> Message-ID: <20150402205830.GB87445@aura.veggiechinese.net> On Thu, Apr 02, 2015 at 02:53:26PM -0600, Eric Broch wrote: > On 4/2/2015 1:22 PM, Will Yardley wrote: > > I've been trying to upgrade Dovecot-ee package (on EL6/x86_64) from > > 2.2.15.8-1 to 2.2.16.2-1. It's complaining on these two dependencies: > > > > liblz4.so.1 > > libtextcat.so.0 > > > > These would both seem to be related to plugins, and don't seem to be > > required as package dependencies by the RPM from what I can see from the > > SRPM. > > > > Anyone know what packages I need to satisfy these dependencies? > lz4-r127-1.el6.i686 and libtextcat-2.2-10.el6.i686 >From what source? I don't see them in any of the normal RHEL channels or in EPEL. I also don't see them in the Dovecot repo (or, unless I'm missing something, in the specfile's install requires). (BTW, I'm on x86_64 arch, but should be same package names either way). From ebroch at whitehorsetc.com Thu Apr 2 21:03:26 2015 From: ebroch at whitehorsetc.com (Eric Broch) Date: Thu, 02 Apr 2015 15:03:26 -0600 Subject: EL6 EE package dependencies In-Reply-To: <20150402205830.GB87445@aura.veggiechinese.net> References: <20150402192244.GA87445@aura.veggiechinese.net> <551DAC46.9030605@whitehorsetc.com> <20150402205830.GB87445@aura.veggiechinese.net> Message-ID: <551DAE9E.30303@whitehorsetc.com> On 4/2/2015 2:58 PM, Will Yardley wrote: > On Thu, Apr 02, 2015 at 02:53:26PM -0600, Eric Broch wrote: >> On 4/2/2015 1:22 PM, Will Yardley wrote: >>> I've been trying to upgrade Dovecot-ee package (on EL6/x86_64) from >>> 2.2.15.8-1 to 2.2.16.2-1. It's complaining on these two dependencies: >>> >>> liblz4.so.1 >>> libtextcat.so.0 >>> >>> These would both seem to be related to plugins, and don't seem to be >>> required as package dependencies by the RPM from what I can see from the >>> SRPM. >>> >>> Anyone know what packages I need to satisfy these dependencies? >> lz4-r127-1.el6.i686 and libtextcat-2.2-10.el6.i686 > From what source? I don't see them in any of the normal RHEL channels or > in EPEL. I also don't see them in the Dovecot repo (or, unless I'm > missing something, in the specfile's install requires). > > (BTW, I'm on x86_64 arch, but should be same package names either way). Sorry, Will lz4-r127-1.el6.i686 epel (# yum provides liblz4.so.1) libtextcat-2.2-10.el6.i686 base (CentOS) (# yum provides libtextcat.so.0) EricB. From tss at iki.fi Fri Apr 3 00:28:32 2015 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Apr 2015 09:28:32 +0900 Subject: EL6 EE package dependencies In-Reply-To: <20150402192244.GA87445@aura.veggiechinese.net> References: <20150402192244.GA87445@aura.veggiechinese.net> Message-ID: On 03 Apr 2015, at 04:22, Will Yardley wrote: > > I've been trying to upgrade Dovecot-ee package (on EL6/x86_64) from > 2.2.15.8-1 to 2.2.16.2-1. It's complaining on these two dependencies: > > liblz4.so.1 > libtextcat.so.0 > > These would both seem to be related to plugins, and don't seem to be > required as package dependencies by the RPM from what I can see from the > SRPM. > > Anyone know what packages I need to satisfy these dependencies? Those dependencies came a bit unintentionally (maybe I should add some --disable-auto-libs configure option to require explicit --with-* parameters). 2.2.16.2-2 removes these dependencies. From dovecot.org at veggiechinese.net Fri Apr 3 00:54:11 2015 From: dovecot.org at veggiechinese.net (Will Yardley) Date: Thu, 2 Apr 2015 17:54:11 -0700 Subject: EL6 EE package dependencies In-Reply-To: References: <20150402192244.GA87445@aura.veggiechinese.net> Message-ID: <20150403005411.GA85708@aura.veggiechinese.net> On Fri, Apr 03, 2015 at 09:28:32AM +0900, Timo Sirainen wrote: > On 03 Apr 2015, at 04:22, Will Yardley wrote: > > I've been trying to upgrade Dovecot-ee package (on EL6/x86_64) from > > 2.2.15.8-1 to 2.2.16.2-1. It's complaining on these two dependencies: > > > > liblz4.so.1 > > libtextcat.so.0 > > > > Anyone know what packages I need to satisfy these dependencies? > Those dependencies came a bit unintentionally (maybe I should add some > --disable-auto-libs configure option to require explicit --with-* > parameters). 2.2.16.2-2 removes these dependencies. Thanks! I was able to figure out the right packages thanks to Eric's pointers, but this is even better. w From nick.z.edwards at gmail.com Fri Apr 3 03:19:45 2015 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Fri, 3 Apr 2015 13:19:45 +1000 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551D7401.5050302@mur.at> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> <551D7401.5050302@mur.at> Message-ID: On 4/3/15, Jogi Hofm?ller wrote: > > > Am 2015-04-02 um 18:24 schrieb Reindl Harald: >> Am 02.04.2015 um 18:19 schrieb Jogi Hofm?ller: >>> Am 2015-04-02 um 17:49 schrieb Reindl Harald: >>>> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >>>>> On 4/1/15, Reindl Harald wrote: >>>>>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>>>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>>>>> that is simple not true - if it would be true linux distributions >>>>>>>> would >>>>>>> >>>>>>> Define "true Linux distribution". >>>>>> >>>>>> who the fuck was talking abiut "true Linux distribution"? >>>>> >>>>> you were cockhead >>>> >>>> no and if someone can't read a simple paragraph beause a missing comma >>>> it's not a compliment for him >>> >>> Your sentence was not really entirely precise. >> >> it was in the context >> >>> What's the harm in saying sorry instead of barking at people? >> >> sorry for what? > > For not being precise (enough). If someone doesn't understand you you > could try expressing whatever you meant to say in a different/better way. > > Cheers, > -- > j.hofm?ller aka Thesix >-<#!&$@@@? http://thesix.mur.at/ > > You must be new. The only way he expresses himself is via vile vitriol, its all the knob jockey knows, most people just ignore it. From nick.z.edwards at gmail.com Fri Apr 3 03:21:18 2015 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Fri, 3 Apr 2015 13:21:18 +1000 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> Message-ID: On 4/2/15, Edwardo Garcia wrote: > On 4/1/15, Reindl Harald wrote: >> >> >> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>> IMHO the larger the corporation is, the less are the chances for >>>>> *long-term* benefits of the OSS/free software (mainly because: usually >>>>> commercial success is driven and defined from marketing to sales[1] >>>>> sown >>>>> to the techies which are forced into "features" and "delivery dates" >>>>> to >>>>> achieve some "company defined goal" - and that is usually not "bug >>>>> free", "safe", or the like. Free software/OSS just happens that *at >>>>> least* half of it should come from the "working level" and that is - >>>>> at >>>>> least - much more - ahemm - "inconvenient" for sales people) >>> >>> FWIW the context were large "old-school" corps (like Novell or Oracle) >>> taking over free software companies. >>> >>>> that is simple not true - if it would be true linux distributions would >>> >>> Define "true Linux distribution". >> >> who the fuck was talking abiut "true Linux distribution"? > > you were cockhead, not taking your drugs again reindl eh or may be you > are taking too much of the illegal ones and none of the ones the > doctors prescribed you > hahahahahahahahahaha right on brother! Oh I must remember to use that more often when calling him out for the troll he is - thats just GOLD! From nick.z.edwards at gmail.com Fri Apr 3 03:28:28 2015 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Fri, 3 Apr 2015 13:28:28 +1000 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551D6D46.3080905@thelounge.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> Message-ID: you wouldnt know, your not a developer, shit processor maybe, but not a developer On 4/3/15, Reindl Harald wrote: > > > Am 02.04.2015 um 18:19 schrieb Jogi Hofm?ller: >> Am 2015-04-02 um 17:49 schrieb Reindl Harald: >>> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >>>> On 4/1/15, Reindl Harald wrote: >>>>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>>>> that is simple not true - if it would be true linux distributions >>>>>>> would >>>>>> >>>>>> Define "true Linux distribution". >>>>> >>>>> who the fuck was talking abiut "true Linux distribution"? >>>> >>>> you were cockhead >>> >>> no and if someone can't read a simple paragraph beause a missing comma >>> it's not a compliment for him >> >> Your sentence was not really entirely precise. > > it was in the context > >> What's the harm in saying sorry instead of barking at people? > > sorry for what? > > for not have any understanding that people blame developers trying to > make money and feed their family while release the software as free > available opensource? > > and frankly *until* that has changed or at least the is a *single sign* > that could change ever people should just shut up instead insinuate bad > intentions to the developers all the thread long > > From h.reindl at thelounge.net Fri Apr 3 09:13:40 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Apr 2015 11:13:40 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> Message-ID: <551E59C4.7020307@thelounge.net> Am 03.04.2015 um 05:28 schrieb Nick Edwards: > you wouldnt know, your not a developer, shit processor maybe, but not > a developer you are just an idiot and nothing else http://www.gossamer-threads.com/lists/spamassassin/users/189665 https://www.mail-archive.com/users at spamassassin.apache.org/msg91823.html > On 4/3/15, Reindl Harald wrote: >> >> >> Am 02.04.2015 um 18:19 schrieb Jogi Hofm?ller: >>> Am 2015-04-02 um 17:49 schrieb Reindl Harald: >>>> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >>>>> On 4/1/15, Reindl Harald wrote: >>>>>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>>>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>>>>> that is simple not true - if it would be true linux distributions >>>>>>>> would >>>>>>> >>>>>>> Define "true Linux distribution". >>>>>> >>>>>> who the fuck was talking abiut "true Linux distribution"? >>>>> >>>>> you were cockhead >>>> >>>> no and if someone can't read a simple paragraph beause a missing comma >>>> it's not a compliment for him >>> >>> Your sentence was not really entirely precise. >> >> it was in the context >> >>> What's the harm in saying sorry instead of barking at people? >> >> sorry for what? >> >> for not have any understanding that people blame developers trying to >> make money and feed their family while release the software as free >> available opensource? >> >> and frankly *until* that has changed or at least the is a *single sign* >> that could change ever people should just shut up instead insinuate bad >> intentions to the developers all the thread long -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From kepa at oceanvoyages.com Fri Apr 3 09:59:39 2015 From: kepa at oceanvoyages.com (kepa) Date: Fri, 03 Apr 2015 11:59:39 +0200 Subject: ACL syntax for setting specified folders within Maildir/ read-only for owner Message-ID: <551E648B.6050304@oceanvoyages.com> Hi, I have dovecot (2.2.16, see dovecot -n at end) installed to /opt on CentOS 6 for access on a local network. I would like to create an archival mail account which will reduce the primary account file size and still make older emails easily accessible. How can I set specified folders in this Maildir read-only with ACL? For example, I included this in the dovecot-acl file to specify protected folders in the archives@ Maildir but it did not work: "Email 2013/*" user=archives lrs "Email 2014/*" user=archives lrs Also tried this on folders without spaces with no success (the folders were still delete-able by the user via the Thunderbird client). Each "Email..." folder has several child folders that should also be read-only. BTW, what is the maximum size for a Maildir that Dovecot can comfortably handle? Thanks! Kepa dovecot -n: # 2.2.16: /opt/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) mail_location = maildir:~/Maildir mail_plugins = acl namespace inbox { inbox = yes location = [mailbox info ...] plugin { acl = vfile:/opt/dovecot/etc/dovecot/dovecot-acl } protocols = imap service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl_cert = Hi all! The set-up I have is a classic one: 1. one or more Dovecot relay/directors Postfix SMTP servers in DMZ 2. one or more backend IMAP/SMTP servers on the inside network 3. There may or may not be separate incoming or outgoing designated SMTP servers. Now the desired functionality is (of course): 1. relay machines receive messages from outside AND inside 2. relays check for all the bad things (spam, viruses etc). 3. for incoming messages relays check for valid local users and reject messages for invalid users 4. after all checks are done incoming messages are transferred to the backend systems where they are accessed via the Dovecot directors While all the above works nicely, the problem I have is how to train my spamassassin (used by amavisd) on the front ends when all messages are on the back ends. Of course transferring the spam detection procedures internally is not such a great option.Am I missing something? I tried googling for info but nothing substantial turned up. Thanks. -- Andreas Kasenides Senior IT Officer Dept. of Computer Science, University of Cyprus Tel: 22892714, Fax: 22892701 (5B4ANK) From CMarcus at Media-Brokers.com Fri Apr 3 12:42:42 2015 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Apr 2015 08:42:42 -0400 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> Message-ID: <551E8AC2.5040308@Media-Brokers.com> People, PLEASE do not engage Reindl on the list, it always results in this kind of garbage that the adults on the list could do without. If you feel compelled to 'call him out', then by all means do so, but do it PRIVATELY. Thanks. On 4/2/2015 11:28 PM, Nick Edwards wrote: > you wouldnt know, your not a developer, shit processor maybe, but not > a developer > > > > > On 4/3/15, Reindl Harald wrote: >> >> Am 02.04.2015 um 18:19 schrieb Jogi Hofm?ller: >>> Am 2015-04-02 um 17:49 schrieb Reindl Harald: >>>> Am 02.04.2015 um 14:30 schrieb Edwardo Garcia: >>>>> On 4/1/15, Reindl Harald wrote: >>>>>> Am 01.04.2015 um 14:33 schrieb Bernd Petrovitsch: >>>>>>> On Mit, 2015-04-01 at 13:07 +0200, Reindl Harald wrote: >>>>>>>> Am 01.04.2015 um 13:04 schrieb Bernd Petrovitsch: >>>>>>>> that is simple not true - if it would be true linux distributions >>>>>>>> would >>>>>>> Define "true Linux distribution". >>>>>> who the fuck was talking abiut "true Linux distribution"? >>>>> you were cockhead >>>> no and if someone can't read a simple paragraph beause a missing comma >>>> it's not a compliment for him >>> Your sentence was not really entirely precise. >> it was in the context >> >>> What's the harm in saying sorry instead of barking at people? >> sorry for what? >> >> for not have any understanding that people blame developers trying to >> make money and feed their family while release the software as free >> available opensource? >> >> and frankly *until* that has changed or at least the is a *single sign* >> that could change ever people should just shut up instead insinuate bad >> intentions to the developers all the thread long >> >> From jerry at seibercom.net Fri Apr 3 13:09:29 2015 From: jerry at seibercom.net (Jerry) Date: Fri, 3 Apr 2015 09:09:29 -0400 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551E8AC2.5040308@Media-Brokers.com> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> <551E8AC2.5040308@Media-Brokers.com> Message-ID: <20150403090929.79177f82@seibercom.net> On Fri, 03 Apr 2015 08:42:42 -0400, Charles Marcus stated: >People, PLEASE do not engage Reindl on the list, it always results in >this kind of garbage that the adults on the list could do without. > >If you feel compelled to 'call him out', then by all means do so, but do >it PRIVATELY. It is not just Reindl. People like Nick who feel compelled to continue this persiflage are as bad as the originator. I have just created a sieve rule to send Reindl, Nick and a few other individuals who feel the need to try and show their immaturity to "/dev/null". I read this forum to learn about Dovecot, not to listen to the rantings of a few Testosterone poisoned, immature posters. -- Jerry From gedalya at gedalya.net Fri Apr 3 13:27:12 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 03 Apr 2015 09:27:12 -0400 Subject: sa-learn with remote Dovecot folders In-Reply-To: <551E67DD.70107@cs.ucy.ac.cy> References: <551E67DD.70107@cs.ucy.ac.cy> Message-ID: <551E9530.7080809@gedalya.net> On 04/03/2015 06:13 AM, Andreas Kasenides wrote: > Hi all! > > The set-up I have is a classic one: > 1. one or more Dovecot relay/directors Postfix SMTP servers in DMZ > 2. one or more backend IMAP/SMTP servers on the inside network > 3. There may or may not be separate incoming or outgoing designated > SMTP servers. > Now the desired functionality is (of course): > 1. relay machines receive messages from outside AND inside > 2. relays check for all the bad things (spam, viruses etc). > 3. for incoming messages relays check for valid local users and reject > messages for invalid users > 4. after all checks are done incoming messages are transferred to the > backend systems where they are accessed via the Dovecot directors > > While all the above works nicely, the problem I have is how to train > my spamassassin (used by amavisd) on the front ends when all messages > are on the back ends. Of course transferring the spam detection > procedures internally is not such a great option.Am I missing > something? I tried googling for info but nothing substantial turned up. > > Thanks. > I use ssh. The exact details depend on your setup, of course. Do you use system users of virtual users? What triggers the training? Is it the antispam plugin? From andreas.kasenides at cs.ucy.ac.cy Fri Apr 3 13:53:28 2015 From: andreas.kasenides at cs.ucy.ac.cy (Andreas Kasenides) Date: Fri, 03 Apr 2015 16:53:28 +0300 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <20150403090929.79177f82@seibercom.net> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> <551E8AC2.5040308@Media-Brokers.com> <20150403090929.79177f82@seibercom.net> Message-ID: <551E9B58.6070003@cs.ucy.ac.cy> On 03/04/15 16:09, Jerry wrote: > On Fri, 03 Apr 2015 08:42:42 -0400, Charles Marcus stated: > >> People, PLEASE do not engage Reindl on the list, it always results in >> this kind of garbage that the adults on the list could do without. >> >> If you feel compelled to 'call him out', then by all means do so, but do >> it PRIVATELY. > It is not just Reindl. People like Nick who feel compelled to continue this > persiflage are as bad as the originator. > > I have just created a sieve rule to send Reindl, Nick and a few other > individuals who feel the need to try and show their immaturity to > "/dev/null". I read this forum to learn about Dovecot, not to listen to the > rantings of a few Testosterone poisoned, immature posters. > Please share. I know its easy to do, but share anyway! -- Andreas Kasenides Senior IT Officer Dept. of Computer Science, University of Cyprus Tel: 22892714, Fax: 22892701 (5B4ANK) From h.reindl at thelounge.net Fri Apr 3 13:57:45 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Apr 2015 15:57:45 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551E9B58.6070003@cs.ucy.ac.cy> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> <551E8AC2.5040308@Media-Brokers.com> <20150403090929.79177f82@seibercom.net> <551E9B58.6070003@cs.ucy.ac.cy> Message-ID: <551E9C59.8050509@thelounge.net> Am 03.04.2015 um 15:53 schrieb Andreas Kasenides: > On 03/04/15 16:09, Jerry wrote: >> On Fri, 03 Apr 2015 08:42:42 -0400, Charles Marcus stated: >> >>> People, PLEASE do not engage Reindl on the list, it always results in >>> this kind of garbage that the adults on the list could do without. >>> >>> If you feel compelled to 'call him out', then by all means do so, but do >>> it PRIVATELY. >> It is not just Reindl. People like Nick who feel compelled to continue >> this >> persiflage are as bad as the originator. >> >> I have just created a sieve rule to send Reindl, Nick and a few other >> individuals who feel the need to try and show their immaturity to >> "/dev/null". I read this forum to learn about Dovecot, not to listen >> to the >> rantings of a few Testosterone poisoned, immature posters. > > Please share. I know its easy to do, but share anyway! if address :is ["From", "Sender"] ["address1", "address2"] { discard; } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From jerry at seibercom.net Fri Apr 3 14:19:32 2015 From: jerry at seibercom.net (Jerry) Date: Fri, 3 Apr 2015 10:19:32 -0400 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551E9B58.6070003@cs.ucy.ac.cy> References: <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi> <55101E65.6080508@cs.ucy.ac.cy> <1427367947.3163.10.camel@thorin> <55141F56.5070708@cs.ucy.ac.cy> <1427886253.3244.25.camel@thorin> <551BD18E.9000600@thelounge.net> <1427891638.3244.35.camel@thorin> <551BE7A3.4030000@thelounge.net> <551D64F7.2050204@thelounge.net> <551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net> <551E8AC2.5040308@Media-Brokers.com> <20150403090929.79177f82@seibercom.net> <551E9B58.6070003@cs.ucy.ac.cy> Message-ID: <20150403101932.27a47313@seibercom.net> On Fri, 03 Apr 2015 16:53:28 +0300, Andreas Kasenides stated: >On 03/04/15 16:09, Jerry wrote: >> On Fri, 03 Apr 2015 08:42:42 -0400, Charles Marcus stated: >> >>> People, PLEASE do not engage Reindl on the list, it always results in >>> this kind of garbage that the adults on the list could do without. >>> >>> If you feel compelled to 'call him out', then by all means do so, but do >>> it PRIVATELY. >> It is not just Reindl. People like Nick who feel compelled to continue this >> persiflage are as bad as the originator. >> >> I have just created a sieve rule to send Reindl, Nick and a few other >> individuals who feel the need to try and show their immaturity to >> "/dev/null". I read this forum to learn about Dovecot, not to listen to the >> rantings of a few Testosterone poisoned, immature posters. >> > >Please share. I know its easy to do, but share anyway! This works for me: if address :matches "From" [ "Sender" ] {discard; stop;} -- Jerry From uothrawn at yahoo.com Fri Apr 3 17:58:36 2015 From: uothrawn at yahoo.com (G H) Date: Fri, 3 Apr 2015 17:58:36 +0000 (UTC) Subject: IMAP logging / rawlog Message-ID: <139403147.5340093.1428083916837.JavaMail.yahoo@mail.yahoo.com> I am trying to monitor with Nagios that my phones are consistently checking into dovecot via IMAP. I used to be able to parse syslog for imap-login messages. I have since updated my phones, the phoness email client (k9-mail) and dovecot. Now the imap-login messages are few and far between. However, I can clearly see via tcpdump that some traffic is happening when I click refresh on k9. I enabled "rawlog" support in dovecot, but it doesn't seem to write to disc frequently enough. 1) Does anyone have a better suggestion for how to monitor that my phone is checking in regularly? 2) Is there a flush-to-disk capability for rawlog in dovecot? 3) Also, when you have imap_zlib plugin enabled, the rawlog logs the raw compressed data instead of the decompressed IMAP commands. Is this an oversight? (FYI: k9 is calling SELECT "INBOX" on refresh) Thanks, G H From me at junc.eu Fri Apr 3 19:14:07 2015 From: me at junc.eu (Benny Pedersen) Date: Fri, 03 Apr 2015 21:14:07 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551E9B58.6070003@cs.ucy.ac.cy> References: " <8250CA2C-936F-468D-B5C6-88954DC6FB2F@iki.fi>" <55101E65.6080508@cs.ucy.ac.cy> " <1427367947.3163.10.camel@thorin>" <55141F56.5070708@cs.ucy.ac.cy> " <1427886253.3244.25.camel@thorin>" <551BD18E.9000600@thelounge.net> "\"\\\"<1427891638.3244.35.camel@thorin>" <551BE7A3.4030000@thelounge.net>" "\" <551D64F7.2050204@thelounge.net> \"\\\"<551D6C06.6070601@mur.at> <551D6D46.3080905@thelounge.net>\"" " <551E8AC2.5040308@Media-Brokers.com> <20150403090929.79177f82@seibercom.net> <551E9B58.6070003@cs.ucy.ac.cy> Message-ID: <55d34abde55dffda9e74e5e44a8a5c2b@junc.eu> Andreas Kasenides skrev den 2015-04-03 15:53: > Please share. I know its easy to do, but share anyway! require ["imap4flags"]; # rule:[h.reindl at thelounge.net] if header :contains "From" "h.reindl at thelounge.net" { addflag "\\Seen"; } this dont break threads add this as the very first rule, before any fileinto, note no stop in the above rule possible he have more sender addresses From h.reindl at thelounge.net Fri Apr 3 19:58:42 2015 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Apr 2015 21:58:42 +0200 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <55d34abde55dffda9e74e5e44a8a5c2b@junc.eu> References: <55101E65.6080508@cs.ucy.ac.cy> <55141F56.5070708@cs.ucy.ac.cy> <551BD18E.9000600@thelounge.net> <551BE7A3.4030000@thelounge.net> <55d34abde55dffda9e74e5e44a8a5c2b@junc.eu> Message-ID: <551EF0F2.5030400@thelounge.net> Am 03.04.2015 um 21:14 schrieb Benny Pedersen: > Andreas Kasenides skrev den 2015-04-03 15:53: > >> Please share. I know its easy to do, but share anyway! > > require ["imap4flags"]; > # rule:[h.reindl at thelounge.net] > if header :contains "From" "h.reindl at thelounge.net" > { > addflag "\\Seen"; > } > > this dont break threads > > add this as the very first rule, before any fileinto, note no stop in > the above rule > > possible he have more sender addresses Benny, our master-troll - i already posted a working rule (yours is bullshit when somebody asks for blow mails to /dev/null) and i don't give a damn about people acting like stupid childs "booh the bad man said something not nice mama help me" if address :is ["From", "Sender"] ["h.reindl at thelounge.net", "nick.z.edwards at gmail.com"] { discard; } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From gedalya at gedalya.net Fri Apr 3 20:01:59 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 03 Apr 2015 16:01:59 -0400 Subject: Dovecot Oy merger with Open-Xchange AG In-Reply-To: <551EF0F2.5030400@thelounge.net> References: <55101E65.6080508@cs.ucy.ac.cy> <55141F56.5070708@cs.ucy.ac.cy> <551BD18E.9000600@thelounge.net> <551BE7A3.4030000@thelounge.net> <55d34abde55dffda9e74e5e44a8a5c2b@junc.eu> <551EF0F2.5030400@thelounge.net> Message-ID: <551EF1B7.5080105@gedalya.net> This entire sub-thread is of no relation to dovecot, is of no interest to the public, has no value of any kind, and is highly irritating. It would be very kind if you all to do this in private. From now on and into the future. Please. From soumplis at ekt.gr Fri Apr 3 20:04:02 2015 From: soumplis at ekt.gr (Alexandros Soumplis) Date: Fri, 03 Apr 2015 23:04:02 +0300 Subject: Disk space usage with mdbox In-Reply-To: <551CEB2E.6030601@ekt.gr> References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> Message-ID: <551EF232.5080104@ekt.gr> Nobody any suggestions ? On 02/04/15 10:09, Alexandros Soumplis wrote: > Yes I have done it, it is the third command I have run, without any > change. > > a. > > > On 02/04/2015 09:53 ??, Urban Loesch wrote: >> Did you "purged" the deleted mails for this user? >> On mdbox you must run "doveadm purge -u $USER" to whipe out any as >> deleted marked mails etc. >> >> Details: http://wiki2.dovecot.org/Tools/Doveadm/Purge >> >> I use a nightly cronjob wor this. >> >> Regards >> Urban >> >> Am 01.04.2015 um 23:26 schrieb Alexandros Soumplis: >>> Hello, >>> >>> I am using dovecot with mdbox+sis and I notice an ever increasing >>> disk space usage since I converted mailboxes from Maildir to >>> mdboxes. I have checked >>> with a user and while it actually uses only 65K, his mdbox files on >>> disk are more than 6G. The backup of his mailbox is just 64K. Any >>> suggestions ? >>> >>> Below are some relevant commands: >>> >>> [root at mail ~]# doveadm quota get -u test >>> Quota name Type Value Limit % >>> User quota STORAGE 10135 31457280 0 >>> User quota MESSAGE 186 >>> - 0 >>> >>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>> 220 /mdboxes/test/mailboxes >>> 6029348 /mdboxes/test/storage >>> 6029592 /mdboxes/test/ >>> >>> [root at mail ~]# doveadm purge -u test >>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>> 220 /mdboxes/test/mailboxes >>> 6029348 /mdboxes/test/storage >>> 6029592 /mdboxes/test/ >>> >>> [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ >>> [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ >>> 16 /tmp/MDBOX_TEMP/mailboxes >>> 65540 /tmp/MDBOX_TEMP/storage >>> 65568 /tmp/MDBOX_TEMP/ >>> > > From dmiller at amfes.com Fri Apr 3 23:40:30 2015 From: dmiller at amfes.com (Daniel Miller) Date: Fri, 03 Apr 2015 16:40:30 -0700 Subject: Disk space usage with mdbox In-Reply-To: <551EF232.5080104@ekt.gr> References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> <551EF232.5080104@ekt.gr> Message-ID: Shot in the dark here...haven't tried it myself so no promises. There's probably a much better way to do this but sometimes a little "brute force" helps. Theoretical steps: 1. Stop all mail processes - both SMTP and IMAP. 2. Use "doveadm sync" to backup the user mailbox, e.g., doveadm backup -u user mdbox:/tmp/usermail 3. Verify /tmp/usermail looks reasonable 4. Move the user's mail store somewhere else, e.g. /tmp/useroldmail 5. Move /tmp/usermail to the user's mailstore 6. Verify file permissions are set correctly in the mailstore 7. Start the mail processes...and test. -- Daniel On 4/3/2015 1:04 PM, Alexandros Soumplis wrote: > Nobody any suggestions ? > > > On 02/04/15 10:09, Alexandros Soumplis wrote: >> Yes I have done it, it is the third command I have run, without any >> change. >> >> a. >> >> >> On 02/04/2015 09:53 ??, Urban Loesch wrote: >>> Did you "purged" the deleted mails for this user? >>> On mdbox you must run "doveadm purge -u $USER" to whipe out any as >>> deleted marked mails etc. >>> >>> Details: http://wiki2.dovecot.org/Tools/Doveadm/Purge >>> >>> I use a nightly cronjob wor this. >>> >>> Regards >>> Urban >>> >>> Am 01.04.2015 um 23:26 schrieb Alexandros Soumplis: >>>> Hello, >>>> >>>> I am using dovecot with mdbox+sis and I notice an ever increasing >>>> disk space usage since I converted mailboxes from Maildir to >>>> mdboxes. I have checked >>>> with a user and while it actually uses only 65K, his mdbox files on >>>> disk are more than 6G. The backup of his mailbox is just 64K. Any >>>> suggestions ? >>>> >>>> Below are some relevant commands: >>>> >>>> [root at mail ~]# doveadm quota get -u test >>>> Quota name Type Value Limit % >>>> User quota STORAGE 10135 31457280 0 >>>> User quota MESSAGE 186 >>>> - 0 >>>> >>>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>>> 220 /mdboxes/test/mailboxes >>>> 6029348 /mdboxes/test/storage >>>> 6029592 /mdboxes/test/ >>>> >>>> [root at mail ~]# doveadm purge -u test >>>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>>> 220 /mdboxes/test/mailboxes >>>> 6029348 /mdboxes/test/storage >>>> 6029592 /mdboxes/test/ >>>> >>>> [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ >>>> [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ >>>> 16 /tmp/MDBOX_TEMP/mailboxes >>>> 65540 /tmp/MDBOX_TEMP/storage >>>> 65568 /tmp/MDBOX_TEMP/ >>>> >> >> From help at pdscc.com Sat Apr 4 08:02:44 2015 From: help at pdscc.com (Harondel J. Sibble) Date: Sat, 04 Apr 2015 01:02:44 -0700 Subject: speaking of sieve scripts... how to selectively not send vacation autoreply Message-ID: <20150404080248.4658C1453@sinclaire.sibble.net> Don't need to block anyone like in the "Re: Dovecot Oy merger with Open-Xchange AG" thread, but when I have my vacation recipie active, I'd like it to NOT reply to certain addresses. I tried the following, you can see the section with if header :contains "addressIdontwant at repliedtoo.tld" is commented out, once I'd added that section, no Vacation messages went out at all.? Googling and reading the wiki and recipie suggestions doesn't make it clear how to exempt a list of addresses from ever receiving a vacation response.? Suggestions on additional reading or solutions? require ["fileinto", "vacation"]; if header :comparator "i;ascii-casemap" :contains "Subject" "**SPAM**"? { ??????? fileinto "Trash"; ??????? stop; } #if header :contains "addressIdontwant at repliedtoo.tld" { #?????? stop; #} vacation ? # Reply at most once a day to a same sender ? :days 1 ? :subject "Changes to email addresses effective Jan 01/15" ? # List of recipient addresses which are included in the auto replying. ? # If a mail's recipient is not on this list, no vacation reply is sent for it. ? :addresses ["user at repliedtoo.tld"] This is on a Dovecot 1.x system that is slated for an upgrade soon. -- Harondel J. Sibble Sibble Computer Consulting Ltd. Creating Solutions for the small and medium business computer user. harondel at pdscc.com (use pgp keyid 0x3CC3CFCE not 0x3AD5C11D) http://www.pdscc.com Blog: http://www.pdscc.com/blog (604) 739-3709 (voice) From bourek at thinline.cz Sat Apr 4 10:18:34 2015 From: bourek at thinline.cz (Jiri Bourek) Date: Sat, 04 Apr 2015 12:18:34 +0200 Subject: speaking of sieve scripts... how to selectively not send vacation autoreply In-Reply-To: <20150404080248.4658C1453@sinclaire.sibble.net> References: <20150404080248.4658C1453@sinclaire.sibble.net> Message-ID: <551FBA7A.9080305@thinline.cz> On 4.4.2015 10:02, Harondel J. Sibble wrote: > Don't need to block anyone like in the "Re: Dovecot Oy merger with > Open-Xchange AG" thread, but when I have my vacation recipie active, I'd like > it to NOT reply to certain addresses. The commented out condition in the rule you posted seems syntactically wrong to me (not sure, never used Dovecot 1.x so can't rule out the possibility it's valid there.) Also I think you can find answer to your question in one of RH's posts in the thread you mentioned. From stephan at rename-it.nl Sat Apr 4 10:19:39 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 04 Apr 2015 12:19:39 +0200 Subject: speaking of sieve scripts... how to selectively not send vacation autoreply In-Reply-To: <20150404080248.4658C1453@sinclaire.sibble.net> References: <20150404080248.4658C1453@sinclaire.sibble.net> Message-ID: <551FBABB.4000101@rename-it.nl> On 4/4/2015 10:02 AM, Harondel J. Sibble wrote: > Don't need to block anyone like in the "Re: Dovecot Oy merger with > Open-Xchange AG" thread, but when I have my vacation recipie active, I'd like > it to NOT reply to certain addresses. > > I tried the following, you can see the section with > > if header :contains "addressIdontwant at repliedtoo.tld" > > is commented out, once I'd added that section, no Vacation messages went out > at all. Googling and reading the wiki and recipie suggestions doesn't make > it clear how to exempt a list of addresses from ever receiving a vacation > response. Suggestions on additional reading or solutions? > > require ["fileinto", "vacation"]; > if header :comparator "i;ascii-casemap" :contains "Subject" "**SPAM**" { > fileinto "Trash"; > stop; > } > > #if header :contains "addressIdontwant at repliedtoo.tld" { > # stop; > #} > > vacation > # Reply at most once a day to a same sender > :days 1 > :subject "Changes to email addresses effective Jan 01/15" > # List of recipient addresses which are included in the auto replying. > # If a mail's recipient is not on this list, no vacation reply is sent for > it. > :addresses ["user at repliedtoo.tld"] > > This is on a Dovecot 1.x system that is slated for an upgrade soon. You should really inspect your log files or test the scripts with the sieve-test command line tool. There is a syntax error in the part you commented out: error: the header test requires 2 positional argument(s), but 1 is/are specified. At delivery, this means that the script is not executed at all and the message is just filed into INBOX. Regards, Stephan. From help at pdscc.com Sat Apr 4 16:44:08 2015 From: help at pdscc.com (Harondel J. Sibble) Date: Sat, 04 Apr 2015 09:44:08 -0700 Subject: speaking of sieve scripts... how to selectively not send vacation autoreply In-Reply-To: <551FBABB.4000101@rename-it.nl> References: <20150404080248.4658C1453@sinclaire.sibble.net>, <551FBABB.4000101@rename-it.nl> Message-ID: <20150404164411.EE15414FD@sinclaire.sibble.net> On 4 Apr 2015 at 12:19, Stephan Bosch wrote: > > #if header :contains "addressIdontwant at repliedtoo.tld" { > > # stop; > > #} > > > > vacation > > # Reply at most once a day to a same sender > > You should really inspect your log files or test the scripts with the > sieve-test command line tool. There is a syntax error in the part you > commented out: > > error: the header test requires 2 positional argument(s), but 1 is/are > specified. > > At delivery, this means that the script is not executed at all and the > message is just filed into INBOX. > > Regards, > > Stephan. I wasn't even aware of the sieve-test command, that'll really come in handy, thanks for that tip I believe I based my entry on the if header :contains "X-Spam-Level" "**********" { discard; stop; } here and until you mentioned it, I did not realize the *'s were a second argument, I'd assumed it as part and parcel of the same argument. wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Spam.2BAC8-Virus_rules I'll try the recipie RH posted if address :is ["From", "Sender"] ["h.reindl at thelounge.net", "nick.z.edwards at gmail.com"] { discard; } modified as below if address :is ["From", "Sender"] ["addressIdontwant at repliedtoo.tld", "otheraddressIdontwant at repliedtoo.tld"] { stop; } -- Harondel J. Sibble Sibble Computer Consulting Ltd. Creating Solutions for the small and medium business computer user. harondel at pdscc.com (use pgp keyid 0x3CC3CFCE not 0x3AD5C11D) http://www.pdscc.com Blog: http://www.pdscc.com/blog (604) 739-3709 (voice) From papa at ramoncasares.com Sun Apr 5 17:12:48 2015 From: papa at ramoncasares.com (=?UTF-8?B?UmFtw7Nu?= Casares) Date: Sun, 5 Apr 2015 19:12:48 +0200 Subject: Using dovecot to serve an email archive Message-ID: <20150405191248.4f87856bda61600630699050@ramoncasares.com> I have a collection of old email messages, archived as follows: 1) One file per message. 2) Messages (=files) distributed in a hierarchy of dirs under mailarch. 3) Each file (=message) uses the name .R.mail Here is the date of the message, expressed as the number of seconds from 1-1-1970 00:00 in 10 digits, and is the SHA-1 hash of the message contents, expressed in hexadecimal, [0-9a-f]. The advantages of this file naming scheme are: 1) All important metadata are in the file name. 2) You can verify the integrity of each message using only its own data and metadata. 3) Each file name is unique. 4) It is compatible with maildir (qmail) unique names (uniq). 5) If a dir is sorted alphabetically, then it is ordered chronologically. 6) The extension .mail can be used to call an appropriate message reader. >From time to time I add new messages and dirs to the archive, but some dirs are closed forever, so it would be nice to tar.gz'ip them. Now I am looking for an IMAP server that can serve this collection in a read-only (ro) manner. That is, the server should not write the mailarch dir at all. I am exploring two possibilities: 1) using hard links. 2) using FUSE to set a rw layer on top of the ro archive layer. But I am new to dovecot, so perhaps there is an easier way to achieve what I want, and therefore I would appreciate very much your advice. From soumplis at ekt.gr Sun Apr 5 20:14:46 2015 From: soumplis at ekt.gr (Alexandros Soumplis) Date: Sun, 05 Apr 2015 23:14:46 +0300 Subject: Disk space usage with mdbox In-Reply-To: References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> <551EF232.5080104@ekt.gr> Message-ID: <552197B6.20308@ekt.gr> Daniel thank you for the advice, I have done this exact procedure to clean up some space and I reduced the used space by more than 60% (huge gain!). Yet it is still a mystery why this happened first place and more important if it will occur again, time will tell. I have kept one mailbox out of this procedure (the "live" size is 8,8G, the backup size is less than 1GB) to do some testing or debugging if possible. Another question I am not able to answer is if this procedure cleans up potentialy orphaned attachments as I store them seperately for SiS to work. a. On 04/04/15 02:40, Daniel Miller wrote: > Shot in the dark here...haven't tried it myself so no promises. > There's probably a much better way to do this but sometimes a little > "brute force" helps. > > Theoretical steps: > 1. Stop all mail processes - both SMTP and IMAP. > 2. Use "doveadm sync" to backup the user mailbox, e.g., > doveadm backup -u user mdbox:/tmp/usermail > 3. Verify /tmp/usermail looks reasonable > 4. Move the user's mail store somewhere else, e.g. /tmp/useroldmail > 5. Move /tmp/usermail to the user's mailstore > 6. Verify file permissions are set correctly in the mailstore > 7. Start the mail processes...and test. > > -- > Daniel > > On 4/3/2015 1:04 PM, Alexandros Soumplis wrote: >> Nobody any suggestions ? >> >> >> On 02/04/15 10:09, Alexandros Soumplis wrote: >>> Yes I have done it, it is the third command I have run, without any >>> change. >>> >>> a. >>> >>> >>> On 02/04/2015 09:53 ??, Urban Loesch wrote: >>>> Did you "purged" the deleted mails for this user? >>>> On mdbox you must run "doveadm purge -u $USER" to whipe out any as >>>> deleted marked mails etc. >>>> >>>> Details: http://wiki2.dovecot.org/Tools/Doveadm/Purge >>>> >>>> I use a nightly cronjob wor this. >>>> >>>> Regards >>>> Urban >>>> >>>> Am 01.04.2015 um 23:26 schrieb Alexandros Soumplis: >>>>> Hello, >>>>> >>>>> I am using dovecot with mdbox+sis and I notice an ever increasing >>>>> disk space usage since I converted mailboxes from Maildir to >>>>> mdboxes. I have checked >>>>> with a user and while it actually uses only 65K, his mdbox files >>>>> on disk are more than 6G. The backup of his mailbox is just 64K. >>>>> Any suggestions ? >>>>> >>>>> Below are some relevant commands: >>>>> >>>>> [root at mail ~]# doveadm quota get -u test >>>>> Quota name Type Value Limit % >>>>> User quota STORAGE 10135 31457280 0 >>>>> User quota MESSAGE 186 - 0 >>>>> >>>>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>>>> 220 /mdboxes/test/mailboxes >>>>> 6029348 /mdboxes/test/storage >>>>> 6029592 /mdboxes/test/ >>>>> >>>>> [root at mail ~]# doveadm purge -u test >>>>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>>>> 220 /mdboxes/test/mailboxes >>>>> 6029348 /mdboxes/test/storage >>>>> 6029592 /mdboxes/test/ >>>>> >>>>> [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ >>>>> [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ >>>>> 16 /tmp/MDBOX_TEMP/mailboxes >>>>> 65540 /tmp/MDBOX_TEMP/storage >>>>> 65568 /tmp/MDBOX_TEMP/ >>>>> >>> >>> From pch at myzel.net Sun Apr 5 22:42:00 2015 From: pch at myzel.net (Peter Chiochetti) Date: Mon, 06 Apr 2015 00:42:00 +0200 Subject: Using dovecot to serve an email archive In-Reply-To: <20150405191248.4f87856bda61600630699050@ramoncasares.com> References: <20150405191248.4f87856bda61600630699050@ramoncasares.com> Message-ID: <5521BA38.6020709@myzel.net> Am 2015-04-05 um 19:12 schrieb Ram?n Casares: > Now I am looking for an IMAP server > that can serve this collection > in a read-only (ro) manner. That is, > the server should not write > the mailarch dir at all. Dovecot ACL might be what you want? http://wiki2.dovecot.org/ACL Probably still writes indices? -- peter From ajs at crankycanuck.ca Mon Apr 6 00:21:18 2015 From: ajs at crankycanuck.ca (Andrew Sullivan) Date: Sun, 5 Apr 2015 20:21:18 -0400 Subject: What to read about interactions Message-ID: <20150406002117.GC20132@crankycanuck.ca> Hi, TL;DR: I am having a hard time synthesizing the information I need out of the website/wiki documentation, and google isn't turning up what I need, so I'm looking for advice on what I should read next to understand the way aliases, dovecot's lmtp, and pigeonhole work together. Details below. I've been using dovecot happily for some years, but in a recent migration of my mail server I set up something that I think will be slightly easier to maintain. I now have a single (in my case postgres) database backing all user names and so on, with postfix relying on dovecot auth for user validation and delivery. I have the usual anti-spam machinery in there, and have started using the (for me new) pigeonhole implementation of sieve. (My old mail system was built around the earlier dovecot implementation, and while I've patched it over time it's really pretty creaky.) On the whole, this all seems very nice, but I'm having a hard time understanding the details of what interacts with what other bits when. In particular, my mail system is known by several different names, and I thought it'd be much handier to have everything land in one real mailbox, since I could sort the inbound mail into different mailboxes without a lot of trouble using seive. This has turned out to be slightly trickier than I thought it ought to be (procmail is in some ways easier), and I've come to the conclusion that I don't have a strong foundation in exactly how this is supposed to work. Apart from reading the code (which would probably at this point be hard enough for me so as to make it impossible), are there things I ought to read to understand this better? I've read the seive RFCs, but while that gives me a clue about what ought to happen protocol-wise, it isn't helping me at all to understand the interaction among the different subsystems so that I can see clearly how different parts of the delivery chain are interacting. I'm sure there's some crucial bit of, "Everyone knows that," that I've overlooked, and I thought it would be better to ask for the FM than just to read randomly until I stumbled on it. Thanks, A -- Andrew Sullivan ajs at crankycanuck.ca From ulrichkenneth at gmail.com Mon Apr 6 00:41:48 2015 From: ulrichkenneth at gmail.com (Kenneth Ulrich) Date: Sun, 5 Apr 2015 19:41:48 -0500 Subject: Question About Dovadm syntax Message-ID: Hello All, I just have a quick question about doveadm commands. 1. Is there a command that we can use to count emails for a particular end user? 2. If an end user needed to copy/move emails from one account to another, is there a command? Also, I've searched Google results, numerous Ubuntu, CentOS, Fedora forums, Doveadm forums, and read the DoveCot/DoveADM man pages numerous times and either I am over looking, or I am not understanding. Thus why I am asking here. From tss at iki.fi Mon Apr 6 02:22:33 2015 From: tss at iki.fi (Timo Sirainen) Date: Mon, 6 Apr 2015 11:22:33 +0900 Subject: Question About Dovadm syntax In-Reply-To: References: Message-ID: On 06 Apr 2015, at 09:41, Kenneth Ulrich wrote: > > Hello All, > > I just have a quick question about doveadm commands. > > 1. Is there a command that we can use to count emails for a particular end > user? doveadm mailbox status -t messages '*' doveadm quota get > 2. If an end user needed to copy/move emails from one account to another, > is there a command? doveadm copy -u sourceuser at example.com user destuser at example.com doveadm move -u sourceuser at example.com user destuser at example.com (Requires v2.1.10 or newer) From tss at iki.fi Mon Apr 6 02:25:41 2015 From: tss at iki.fi (Timo Sirainen) Date: Mon, 6 Apr 2015 11:25:41 +0900 Subject: Deleting empty folders In-Reply-To: References: Message-ID: <392C9B55-6E86-4DC2-9C6D-6618FDE960EA@iki.fi> On 21 Mar 2015, at 05:18, Samuel Williams wrote: > > So, along with the problem of lots of folders ending in 1 1 1 1, I'd like > to have a strategy to delete these. > > I was trying to understand if it is possible to use > http://linux.die.net/man/1/doveadm-expunge to delete empty folders, but > without also deleting messages? Is this possible and if so what is the > syntax? -d Delete the mailbox if it is empty after expunging. So create an expunge query that matches no messages: doveadm expunge -d mailbox '*' not all From tss at iki.fi Mon Apr 6 02:44:28 2015 From: tss at iki.fi (Timo Sirainen) Date: Mon, 6 Apr 2015 11:44:28 +0900 Subject: IMAP logging / rawlog In-Reply-To: <139403147.5340093.1428083916837.JavaMail.yahoo@mail.yahoo.com> References: <139403147.5340093.1428083916837.JavaMail.yahoo@mail.yahoo.com> Message-ID: <5C88A869-FB62-4CB7-BF7F-0CED88C802A5@iki.fi> On 04 Apr 2015, at 02:58, G H wrote: > > I am trying to monitor with Nagios that my phones are consistently checking into dovecot via IMAP. I used to be able to parse syslog for imap-login messages. I have since updated my phones, the phoness email client (k9-mail) and dovecot. Now the imap-login messages are few and far between. However, I can clearly see via tcpdump that some traffic is happening when I click refresh on k9. I enabled "rawlog" support in dovecot, but it doesn't seem to write to disc frequently enough. > > > 1) Does anyone have a better suggestion for how to monitor that my phone is checking in regularly? Writing a plugin would be the cleanest way to do this.. > 2) Is there a flush-to-disk capability for rawlog in dovecot? It was behaving like that before v2.2.14 started optimizing the rawlog writes by buffering them. I added now code to flush the rawlog every second: http://hg.dovecot.org/dovecot-2.2/rev/ee001c131952 > 3) Also, when you have imap_zlib plugin enabled, the rawlog logs the raw compressed data instead of the decompressed IMAP commands. Is this an oversight? The way it's currently implemented it can't work otherwise. That's why there is "doveadm dump -t imapzlib raw.log" command to decode it. It would be possible to implement rawlog differently also by having the imap processes write them directly, but this would require more development. This is actually how imap-login -R parameter also does rawlogging. (I think it only does pre-login rawlogging, but you could see if it happens to be writing post-login rawlog as well.) From tss at iki.fi Mon Apr 6 03:19:50 2015 From: tss at iki.fi (Timo Sirainen) Date: Mon, 6 Apr 2015 12:19:50 +0900 Subject: Couldn't set transaction log view (seq 9..13) In-Reply-To: <87mw2rvfn5.fsf@muck.riseup.net> References: <87mw2rvfn5.fsf@muck.riseup.net> Message-ID: <527818E0-2CB2-4B51-BA1A-14A823B21BD3@iki.fi> On 02 Apr 2015, at 03:59, micah anderson wrote: > > > Hello, > > I'm using 2.2.13 on Debian stable, and I perform regular dsync > backups. Typically if there is an error, dsync can recover from it the > next time it is run, but I've been encountering a new error that doesn't > seem to self-heal: > > # /usr/bin/dsync -u gae backup ssh -i /root/.ssh/id_rsa backmaildir at internal.example /usr/bin/dsync -u micah > dsync-remote(micah): Error: /srv/maildirbackups/m/micah/daily.1/mailboxes/INBOX/dbox-Mails/dovecot.index: Couldn't set transaction log view (seq 9..13) > dsync-remote(micah): Error: Failed to read transaction log for mailbox INBOX > > Re-running the dsync never fixes the issue. > > I'm happy to provide any additional information if so required to help > track down this problem! Can you create a tarball of such mailbox directories that reproduces the problem? Probably this would work: - copy source and destination dboxes to /tmp/test/1 and /tmp/test/2 - delete all the mailboxes except INBOX - delete all the u.* files from the INBOXes. This probably doesn't affect the dsync run - if it does run the mails instead through http://dovecot.org/tools/dbox-anonymize.pl - delete dovecot.index.cache files - make sure you can still reproduce this error by running: doveadm -o mail=sdbox:/tmp/test/1 sync sdbox:/tmp/test/2 - tar czf test.tar.gz /tmp/test Then send the tarball to me and I can fix the bug. Oh, also it would be a good idea to test with a newer Dovecot version since there are some indexing fixes since v2.2.13.. Also I added some code that should give a better-debuggable error message if this happens: http://hg.dovecot.org/dovecot-2.2/rev/8146fdc0de34 From HFlor at gmx.de Mon Apr 6 07:36:56 2015 From: HFlor at gmx.de (Hardy Flor) Date: Mon, 06 Apr 2015 09:36:56 +0200 Subject: doveadm save ... Message-ID: <55223798.2050403@gmx.de> Hello, when I have with "doveadm save ..." store a message, how do I get the guid or uid of this message for the setthe flags? Hardy From stephan at rename-it.nl Mon Apr 6 15:05:12 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 06 Apr 2015 17:05:12 +0200 Subject: Sieve/ManageSieve documentation on Wiki2 In-Reply-To: References: Message-ID: <5522A0A8.5080902@rename-it.nl> On 4/2/2015 2:21 PM, Robert Blayzor wrote: > Is it possible the Sieve/ManageSieve documentation on the Wiki can be cleaned up? It's incredibly confusing now. Some of the Sieve configuration information says certain options are deprecated, but then the example on how to configure it uses the deprecated options rather than what they *should* be now. > > More confusion is the sieve plugin configuration listing those same deprecated options, yet when you pull the document on how to configure ManageSieve, it (again) uses deprecated configuration information? > > http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Configuration > > > Or am I missing something? Oh right. I fixed those now, also in the tarball documentation. Regards, Stephan. From papa at ramoncasares.com Mon Apr 6 16:41:26 2015 From: papa at ramoncasares.com (=?UTF-8?B?UmFtw7Nu?= Casares) Date: Mon, 6 Apr 2015 18:41:26 +0200 Subject: Using dovecot to serve an email archive In-Reply-To: <5521BA38.6020709@myzel.net> References: <20150405191248.4f87856bda61600630699050@ramoncasares.com> <5521BA38.6020709@myzel.net> Message-ID: <20150406184126.601991d6a7c89bd96b9c417c@ramoncasares.com> On Mon, 06 Apr 2015 00:42:00 +0200 Peter Chiochetti wrote: > Am 2015-04-05 um 19:12 schrieb Ram?n Casares: > > Now I am looking for an IMAP server > > that can serve this collection > > in a read-only (ro) manner. That is, > > the server should not write > > the mailarch dir at all. > > Dovecot ACL might be what you want? > > http://wiki2.dovecot.org/ACL > > Probably still writes indices? > > -- > peter I was reading about dovecot ACL. It is a means to control what users can do, but the server itself seems to be free to write indices, move files from new to cur, etc. The other problem is to force dovecot to accept the file naming scheme .R.mail Nevertheless, thank you Ram?n Casares From micah at riseup.net Mon Apr 6 20:28:19 2015 From: micah at riseup.net (Micah Anderson) Date: Mon, 06 Apr 2015 16:28:19 -0400 Subject: setting service_count results in Permission denied Message-ID: <876199t318.fsf@muck.riseup.net> The load on our machines has gotten too high, so I started to see log messages that directed me to look at this page for config changes: https://pad.riseup.net/redirect#http%3A//wiki2.dovecot.org/SocketUnavailable One of the things I wanted to do on that page was to set the: service imap { service_count = 100 } but when I added that to the service imap block, and restarted dovecot, I see this in the logs: Error: net_connect_unix(/run/dovecot/imap-postlogin) failed: Permission denied I dont understand how this impacts permissions. Its clearly this setting, because when I remove it, things work again. I found nothing else in the logs indicating a configuration problem. This is what the config block looked like: service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = 256M # Max. number of IMAP processes (connections) process_limit = 4096 service_count = 100 executable = imap imap-postlogin } service imap-postlogin { # the script process runs as the user specified here (v2.0.14+): #user = $default_internal_user executable = script-login /usr/local/sbin/postlogin_imap # this UNIX socket listener must use the same name as given to imap executable unix_listener imap-postlogin { } } This is with dovecot 2.2.13, thanks for any help you can provide! micah From oflameo2 at gmail.com Tue Apr 7 03:59:52 2015 From: oflameo2 at gmail.com (John Lewis) Date: Mon, 06 Apr 2015 23:59:52 -0400 Subject: Users can't use Dovecot IMAP Message-ID: <55235638.4090004@gmail.com> Every time a user logs into Dovcot's IMAP service PAM closes the session immediately after it opens. I would like a user to have a session open long enough to read some emails. dictator at drakeclasher:~$ sudo dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.14-0.bpo.1-amd64 x86_64 Debian 7.8 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = failure_show_msg=yes %s driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp" ssl_cert = INBOX 1 1 1 1 1 Message-ID: <008101d07111$35d7eb30$a187c190$@hemmler.net> Hi all! I?ve got a problem with some (not all) of my mailboxes. If you see, some folders got strange names. 41943652 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:42 INBOX 1 42205306 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:46 INBOX 1 1 42336882 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:48 INBOX 1 1 1 42337295 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:49 INBOX 1 1 1 1 42598861 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:51 INBOX 1 1 1 1 1 42730114 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:54 INBOX 1 1 1 1 1 1 42730261 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:57 INBOX 1 1 1 1 1 1 1 42730276 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:57 INBOX 1 1 1 1 1 1 1 1 42730291 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:58 INBOX 1 1 1 1 1 1 1 1 1 42730306 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 10:59 INBOX 1 1 1 1 1 1 1 1 1 1 42730321 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 11:00 INBOX 1 1 1 1 1 1 1 1 1 1 1 42730336 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 11:01 INBOX 1 1 1 1 1 1 1 1 1 1 1 1 42730351 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 11:02 INBOX 1 1 1 1 1 1 1 1 1 1 1 1 1 42730366 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 11:03 INBOX 1 1 1 1 1 1 1 1 1 1 1 1 1 1 42730381 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 11:04 INBOX 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 42730400 4.0K drwx------ 3 vmail vmail 4.0K Mar 25 11:05 INBOX 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 and so on..... Any ideas what I?m doing wrong? Thanks in advance. Best regards, Thorben -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dovecot-n.txt URL: From skdovecot at smail.inf.fh-brs.de Tue Apr 7 09:22:30 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Apr 2015 11:22:30 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: <551B2FBE.2030504@cajuntechie.org> References: <551B2FBE.2030504@cajuntechie.org> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 31 Mar 2015, Anthony Papillion wrote: > Date: Tue, 31 Mar 2015 18:37:34 -0500 > From: Anthony Papillion > To: dovecot at dovecot.org > Subject: Need a bit of help with the antispam plugin > > Hello Everyone, > > I'm running the antispam plugin on Dovecot 2.0.19 on Ubuntu Server 14.04 > and I can't seem to get it to work. In the IMAP section of dovecot.conf > I have the following lines: > > protocol imap { > mail_plugins = $mail_plugins imap_quota imap_acl antispam > # mail_plugins = $mail_plugins imap_quota imap_acl > imap_client_workarounds = tb-extra-mailbox-sep > > # Maximum number of IMAP connections allowed for a user from each IP > address. > # NOTE: The username is compared case-sensitively. > # Default is 10. > # Increase it to avoid issue like below: > # "Maximum number of concurrent IMAP connections exceeded" > mail_max_userip_connections = 20 > > plugin { > antispam_debug_target = syslog > antispam_verbose_debug = 1 > > antispam_backend = pipe > antispam_trash = Trash > antispam_spam = Junk > antispam_pipe_program_spam_arg = --spam > antispam_pipe_program_notspam_arg = --ham > antispam_pipe_program = /usr/bin/sa-learn > antispam_pipe_program_args = --username=%Lu > } > } replace the value of antispam_pipe_program with a script: ====== #/bin/bash ( set -x id -a date /usr/bin/sa-learn "$@" rc=$? echo rc=$rc exit $rc ) >/tmp/antispam.$$.log 2>&1 ==== Then check on the command line, what happens if you invoke the command line as the user displayed by the id command. > For some reason, when I try to move something to Junk, I get the > following in my syslog: > > Mar 31 18:27:16 anonymail imap: antispam: plugin initialising (2.0-notgit) > Mar 31 18:27:16 anonymail imap: antispam: verbose debug enabled > Mar 31 18:27:16 anonymail imap: antispam: "Junk" is exact match spam folder > Mar 31 18:27:16 anonymail imap: antispam: no unsure folders > Mar 31 18:27:16 anonymail imap: antispam: "Trash" is exact match trash > folder > Mar 31 18:27:16 anonymail imap: antispam: pipe backend spam argument = > --spam > Mar 31 18:27:16 anonymail imap: antispam: pipe backend not-spam argument > = --ham > Mar 31 18:27:16 anonymail imap: antispam: pipe backend program = > /usr/bin/sa-learn > Mar 31 18:27:16 anonymail imap: antispam: pipe backend program arg[0] = > --username=anthony at cajuntechie.org > Mar 31 18:27:16 anonymail imap: antispam: pipe backend tmpdir /tmp > Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(Junk): 0 > Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(INBOX): 0 > Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(Junk): 0 > Mar 31 18:27:19 anonymail imap: antispam: mail copy: from trash: 0, to > trash: 0 > Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(INBOX): 0 > Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(Junk): 1 > Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(INBOX): 0 > Mar 31 18:27:19 anonymail imap: antispam: mail copy: src spam: 0, dst > spam: 1, src unsure: 0 > Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend > program /usr/bin/sa-learn > Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend > program /usr/bin/sa-learn > Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend > program parameter 1 --username=anthony at cajuntechie.org > Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend > program parameter 2 --spam > Mar 31 18:27:21 anonymail imap: antispam: run program failed with exit > code -1 > > This is probably a permissions issue but I'm not able to debug it. Can > anyone offer me any clues as to what I might be doing wrong or how I > might fix it? > > Thanks, > Anthony > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSOh1nz1H7kL/d9rAQJpQQf/ZJzphWeULzGdh9OssSdAk6WTfjQU+ITr G3YcACkVo9ZWjxeDtF1epXRv8ZibUk+o8Sfj7lQ7YREkC/Xws2MibJh2iIKoAZY8 ZPxGGO14fOiAqOaMDCtyPVoKY97TdhNoNXXbOReQqyEMgVdAF2mrKN4xwphjGWKB Q5C165UwzphwtnSkWVtMKQvy5o8cQJHltuZa7hyRohsNUwYUu9Qc63qfJf4bxsQH 3O125rfgRX8k6icMb8nmny/g0rWAWhuqVIIgrlS8FE85DuQSlZCcRkSvxn0kHoPy yP3GVdTQcIN8pxTkyHFyFtzwuF60sEOdZcuYHKSdCb4DjWN0Ph3KSw== =IPFw -----END PGP SIGNATURE----- From david.myers.24j74 at gmail.com Tue Apr 7 11:55:31 2015 From: david.myers.24j74 at gmail.com (Dave Myers) Date: Tue, 07 Apr 2015 13:55:31 +0200 Subject: Users can't use Dovecot IMAP In-Reply-To: <55235638.4090004@gmail.com> References: <55235638.4090004@gmail.com> Message-ID: <5523C5B3.2070105@gmail.com> On 07/04/2015 05:59, John Lewis wrote: > Every time a user logs into Dovcot's IMAP service PAM closes the session immediately after it opens. I would like a user to have a session open long enough to read some emails. I don't know if it is still the case for no super user login to imap servers ? > Apr 6 21:57:29 drakeclasher su[2346]: pam_unix(su:session): session > opened for user mailtest by dictator(uid=0) But according to this old thread it would seem that dovecot is hard coded to not allow login as root (uid=0) to the imap server. http://www.dovecot.org/list/dovecot/2011-September/078467.html Can't say for the current version, as the wiki2 doesn't currently have the config files . I would be suprised if it had changed though... The doc page : http://wiki.dovecot.org/MainConfig Search for : first_valid_uid -- Tel: + 33 6 50 14 39 34 email: david.myers.24j74 at gmail.com Addres: 22 Rue de L'Eglise 77700 Coupvray. 77700 France From skdovecot at smail.inf.fh-brs.de Tue Apr 7 12:28:59 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Apr 2015 14:28:59 +0200 (CEST) Subject: setting service_count results in Permission denied In-Reply-To: <876199t318.fsf@muck.riseup.net> References: <876199t318.fsf@muck.riseup.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 6 Apr 2015, Micah Anderson wrote: > service imap { service_count = 100 } where do you put this config line? > but when I added that to the service imap block, and restarted dovecot, > I see this in the logs: Error: > net_connect_unix(/run/dovecot/imap-postlogin) failed: Permission denied > I dont understand how this impacts permissions. Its clearly this > setting, because when I remove it, things work again. I found nothing > else in the logs indicating a configuration problem. > > This is what the config block looked like: > > service imap { > # Most of the memory goes to mmap()ing files. You may need to increase this > # limit if you have huge mailboxes. > #vsz_limit = 256M > # Max. number of IMAP processes (connections) > process_limit = 4096 > service_count = 100 > executable = imap imap-postlogin > } please run: doveconf -a >without_service_count add service_count doveconf -a >with_service_count Then compare the section "service imap" and "imap-postlogin" for changes. > service imap-postlogin { > # the script process runs as the user specified here (v2.0.14+): > #user = $default_internal_user > > executable = script-login /usr/local/sbin/postlogin_imap > > # this UNIX socket listener must use the same name as given to imap executable > unix_listener imap-postlogin { > } > } > > This is with dovecot 2.2.13, thanks for any help you can provide! > > micah > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSPNi3z1H7kL/d9rAQKCxgf+Ln7JJDI6dznH8kDPpEmDm9MNTxj/7X7T k7+6pi40xrvIWHRR+gTgh4ntzQ7ur8U8AceSEJgGb7zCQ6PvI9dFRJ1U6HMThA57 vE/W74CHGLQCNYkGEw7h7CJULu5AiJk2uj6iYt0nUKZCgLryTONFMMsgBAUewcRE OcGgHZwyOhL+CSvj9kaZ5gTDbtMxCx6b78JtWZ864ltcDeikfoN5Evlal4BRsMmA DXC5auovPJ/4zRQRiWwDCeS2LEBVESnDgRH5GMx1kQg33PtTeo7nsyTgKX7Y1twd DVTFKCTjpghFSwDmHonCOGSKw/mm+KklWicWVv6C7tujcd6ev7vjrg== =DLl+ -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Apr 7 12:39:30 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Apr 2015 14:39:30 +0200 (CEST) Subject: What to read about interactions In-Reply-To: <20150406002117.GC20132@crankycanuck.ca> References: <20150406002117.GC20132@crankycanuck.ca> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 5 Apr 2015, Andrew Sullivan wrote: > I've been using dovecot happily for some years, but in a recent > migration of my mail server I set up something that I think will be > slightly easier to maintain. I now have a single (in my case > postgres) database backing all user names and so on, with postfix > relying on dovecot auth for user validation and delivery. I have the > usual anti-spam machinery in there, and have started using the (for me > new) pigeonhole implementation of sieve. (My old mail system was > built around the earlier dovecot implementation, and while I've > patched it over time it's really pretty creaky.) > > On the whole, this all seems very nice, but I'm having a hard time > understanding the details of what interacts with what other bits when. > In particular, my mail system is known by several different names, and > I thought it'd be much handier to have everything land in one real > mailbox, since I could sort the inbound mail into different mailboxes > without a lot of trouble using seive. This has turned out to be > slightly trickier than I thought it ought to be (procmail is in some > ways easier), and I've come to the conclusion that I don't have a > strong foundation in exactly how this is supposed to work. procmail is easier ;-) Think of "Sieve" taking over procmail. If you want to know how to write Sieve scripts, check out http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples or any other Sieve site. If you want to filter by mail domain, you need envelope tests, see http://wiki2.dovecot.org/Pigeonhole/Sieve, too. e.g. if envelope :is "to" "owner-cipe-l at inka.de" { fileinto "lists.cipe"; stop; } > Apart from reading the code (which would probably at this point be > hard enough for me so as to make it impossible), are there things I > ought to read to understand this better? I've read the seive RFCs, > but while that gives me a clue about what ought to happen > protocol-wise, it isn't helping me at all to understand the > interaction among the different subsystems so that I can see clearly There are no "subsystems", as far as I understand the term. There is information about the current message, which can be tested and acted on. > how different parts of the delivery chain are interacting. I'm sure > there's some crucial bit of, "Everyone knows that," that I've > overlooked, and I thought it would be better to ask for the FM than > just to read randomly until I stumbled on it. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSPQAnz1H7kL/d9rAQKwzggAgmpsAzrm0FE3/TVMQVq3tnjqxoFwX6ur JhO1gb1558bEhv95rwtcmsPcEPP8fqstcMoZv9rKnPjgorAzx+t9/hxNhvzer49U q2NcRRLBrWKt/GdJK3f06Ifs+tUjuog1kotiyR5E193xf/cvEd98H4EyVR35kak3 3tDHsW7ylhU7bg3N6FU9fu6px8EsVKQFG/H3mClltpgsgsq5AJ1jMM6giZH2BJ9d IwzpnP8WmvXOpTt6YvJOLySiAjWY+8e0c/LjNt/8dmOL/rdqKGY70RNopOOnGarC JBh0xxDaKnqv3mwbhFKEVLtr+qhKTGbDjlF1G49CebpNpIsTTIXZIA== =0pPx -----END PGP SIGNATURE----- From perry at jpunix.net Tue Apr 7 12:44:29 2015 From: perry at jpunix.net (John Perry) Date: Tue, 07 Apr 2015 07:44:29 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> Message-ID: On 2015/04/07 04:22, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 31 Mar 2015, Anthony Papillion wrote: > >> Date: Tue, 31 Mar 2015 18:37:34 -0500 >> From: Anthony Papillion >> To: dovecot at dovecot.org >> Subject: Need a bit of help with the antispam plugin >> >> Hello Everyone, >> >> I'm running the antispam plugin on Dovecot 2.0.19 on Ubuntu Server >> 14.04 >> and I can't seem to get it to work. In the IMAP section of >> dovecot.conf >> I have the following lines: >> >> protocol imap { >> mail_plugins = $mail_plugins imap_quota imap_acl antispam >> # mail_plugins = $mail_plugins imap_quota imap_acl >> imap_client_workarounds = tb-extra-mailbox-sep >> >> # Maximum number of IMAP connections allowed for a user from each >> IP >> address. >> # NOTE: The username is compared case-sensitively. >> # Default is 10. >> # Increase it to avoid issue like below: >> # "Maximum number of concurrent IMAP connections exceeded" >> mail_max_userip_connections = 20 >> >> plugin { >> antispam_debug_target = syslog >> antispam_verbose_debug = 1 >> >> antispam_backend = pipe >> antispam_trash = Trash >> antispam_spam = Junk >> antispam_pipe_program_spam_arg = --spam >> antispam_pipe_program_notspam_arg = --ham >> antispam_pipe_program = /usr/bin/sa-learn >> antispam_pipe_program_args = --username=%Lu >> } >> } > > replace the value of antispam_pipe_program with a script: > > ====== > #/bin/bash > > ( > set -x > id -a > date > /usr/bin/sa-learn "$@" > rc=$? > echo rc=$rc > exit $rc > ) >/tmp/antispam.$$.log 2>&1 > ==== > > Then check on the command line, what happens if you invoke the command > line as the user displayed by the id command. > >> For some reason, when I try to move something to Junk, I get the >> following in my syslog: >> >> Mar 31 18:27:16 anonymail imap: antispam: plugin initialising >> (2.0-notgit) >> Mar 31 18:27:16 anonymail imap: antispam: verbose debug enabled >> Mar 31 18:27:16 anonymail imap: antispam: "Junk" is exact match spam >> folder >> Mar 31 18:27:16 anonymail imap: antispam: no unsure folders >> Mar 31 18:27:16 anonymail imap: antispam: "Trash" is exact match trash >> folder >> Mar 31 18:27:16 anonymail imap: antispam: pipe backend spam argument = >> --spam >> Mar 31 18:27:16 anonymail imap: antispam: pipe backend not-spam >> argument >> = --ham >> Mar 31 18:27:16 anonymail imap: antispam: pipe backend program = >> /usr/bin/sa-learn >> Mar 31 18:27:16 anonymail imap: antispam: pipe backend program arg[0] >> = >> --username=anthony at cajuntechie.org >> Mar 31 18:27:16 anonymail imap: antispam: pipe backend tmpdir /tmp >> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(Junk): 0 >> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(INBOX): 0 >> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(Junk): 0 >> Mar 31 18:27:19 anonymail imap: antispam: mail copy: from trash: 0, to >> trash: 0 >> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(INBOX): 0 >> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(Junk): 1 >> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(INBOX): 0 >> Mar 31 18:27:19 anonymail imap: antispam: mail copy: src spam: 0, dst >> spam: 1, src unsure: 0 >> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >> program /usr/bin/sa-learn >> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >> program /usr/bin/sa-learn >> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >> program parameter 1 --username=anthony at cajuntechie.org >> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >> program parameter 2 --spam >> Mar 31 18:27:21 anonymail imap: antispam: run program failed with exit >> code -1 >> >> This is probably a permissions issue but I'm not able to debug it. Can >> anyone offer me any clues as to what I might be doing wrong or how I >> might fix it? >> >> Thanks, >> Anthony I'm having the exact same issue. I applied the change you recommended to Anthony (I.E. create the script and call that rather than sa-learn directly) and I see that the resultant log file in /tmp is never created. Any additional suggestions would be greatly appreciated! -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 From skdovecot at smail.inf.fh-brs.de Tue Apr 7 12:58:00 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Apr 2015 14:58:00 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Apr 2015, John Perry wrote: > On 2015/04/07 04:22, Steffen Kaiser wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Tue, 31 Mar 2015, Anthony Papillion wrote: >> >>> Date: Tue, 31 Mar 2015 18:37:34 -0500 >>> From: Anthony Papillion >>> To: dovecot at dovecot.org >>> Subject: Need a bit of help with the antispam plugin >>> >>> Hello Everyone, >>> >>> I'm running the antispam plugin on Dovecot 2.0.19 on Ubuntu Server 14.04 >>> and I can't seem to get it to work. In the IMAP section of dovecot.conf >>> I have the following lines: >>> >>> protocol imap { >>> mail_plugins = $mail_plugins imap_quota imap_acl antispam >>> # mail_plugins = $mail_plugins imap_quota imap_acl >>> imap_client_workarounds = tb-extra-mailbox-sep >>> >>> # Maximum number of IMAP connections allowed for a user from each IP >>> address. >>> # NOTE: The username is compared case-sensitively. >>> # Default is 10. >>> # Increase it to avoid issue like below: >>> # "Maximum number of concurrent IMAP connections exceeded" >>> mail_max_userip_connections = 20 >>> >>> plugin { >>> antispam_debug_target = syslog >>> antispam_verbose_debug = 1 >>> >>> antispam_backend = pipe >>> antispam_trash = Trash >>> antispam_spam = Junk >>> antispam_pipe_program_spam_arg = --spam >>> antispam_pipe_program_notspam_arg = --ham >>> antispam_pipe_program = /usr/bin/sa-learn >>> antispam_pipe_program_args = --username=%Lu >>> } >>> } >> >> replace the value of antispam_pipe_program with a script: >> >> ====== >> #/bin/bash >> >> ( >> set -x >> id -a >> date >> /usr/bin/sa-learn "$@" >> rc=$? >> echo rc=$rc >> exit $rc >> ) >/tmp/antispam.$$.log 2>&1 >> ==== >> >> Then check on the command line, what happens if you invoke the command >> line as the user displayed by the id command. >> >>> For some reason, when I try to move something to Junk, I get the >>> following in my syslog: >>> >>> Mar 31 18:27:16 anonymail imap: antispam: plugin initialising (2.0-notgit) >>> Mar 31 18:27:16 anonymail imap: antispam: verbose debug enabled >>> Mar 31 18:27:16 anonymail imap: antispam: "Junk" is exact match spam >>> folder >>> Mar 31 18:27:16 anonymail imap: antispam: no unsure folders >>> Mar 31 18:27:16 anonymail imap: antispam: "Trash" is exact match trash >>> folder >>> Mar 31 18:27:16 anonymail imap: antispam: pipe backend spam argument = >>> --spam >>> Mar 31 18:27:16 anonymail imap: antispam: pipe backend not-spam argument >>> = --ham >>> Mar 31 18:27:16 anonymail imap: antispam: pipe backend program = >>> /usr/bin/sa-learn >>> Mar 31 18:27:16 anonymail imap: antispam: pipe backend program arg[0] = >>> --username=anthony at cajuntechie.org >>> Mar 31 18:27:16 anonymail imap: antispam: pipe backend tmpdir /tmp >>> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(Junk): 0 >>> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(INBOX): 0 >>> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(Junk): 0 >>> Mar 31 18:27:19 anonymail imap: antispam: mail copy: from trash: 0, to >>> trash: 0 >>> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(INBOX): 0 >>> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(Junk): 1 >>> Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(INBOX): 0 >>> Mar 31 18:27:19 anonymail imap: antispam: mail copy: src spam: 0, dst >>> spam: 1, src unsure: 0 >>> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >>> program /usr/bin/sa-learn >>> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >>> program /usr/bin/sa-learn >>> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >>> program parameter 1 --username=anthony at cajuntechie.org >>> Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend >>> program parameter 2 --spam >>> Mar 31 18:27:21 anonymail imap: antispam: run program failed with exit >>> code -1 >>> >>> This is probably a permissions issue but I'm not able to debug it. Can >>> anyone offer me any clues as to what I might be doing wrong or how I >>> might fix it? >>> >>> Thanks, >>> Anthony > > I'm having the exact same issue. I applied the change you recommended to > Anthony (I.E. create the script and call that rather than sa-learn directly) > and I see that the resultant log file in /tmp is never created. Any > additional suggestions would be greatly appreciated! Is this script executable for all, e.g.: chmod a+x /path/to/script Is the script located in a directory everybody are allowed to execute, e.g. /usr/local/bin or /usr/bin . Can you run, e.g.: sudo -u nobody /path/to/script and something is happening? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSPUWHz1H7kL/d9rAQLtzgf5AUXDxhhQg7EsO5qEaDKgvKBgNt7dWF2Y ui7h1uW47c0bja4E4d89X7oHsZ1HQXvvuobbBlDxIzdhweoK8bISDL7DYSLCLW1s wzf5z4FqFbr6H1bj5oX8/ZgQ3+4ONL9aAmMhHT6JUxPZ98JtPUlm/yzNu2eYfQbG p5Q62RHr/tsNG0jg9AHGEsrbSDpIkrmk3n2qgddwA8dCWcNMjHzDJThgGpKoEEq2 ohvjr6V3TUJcL6BZ/GR0B+2VKaQSdR6FlhhuItZrpbClOeoe1MyOos/p5TLnL+Lp XFm5DAATbQYEEmnaC+1G2dQoFuix+mMXxPq4L1LH/+O8ztGLh8QTdQ== =pLIX -----END PGP SIGNATURE----- From perry at jpunix.net Tue Apr 7 13:14:38 2015 From: perry at jpunix.net (John Perry) Date: Tue, 07 Apr 2015 08:14:38 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> Message-ID: <147befea03280ae91d16573ba2aad147@jpunix.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2015/04/07 07:58, Steffen Kaiser wrote: > > Is this script executable for all, e.g.: > > chmod a+x /path/to/script yes. That was the first thing I did. > > Is the script located in a directory everybody are allowed to execute, > e.g. /usr/local/bin or /usr/bin . Yes. It is in /usr/bin named antispam.sh > > Can you run, e.g.: > > sudo -u nobody /path/to/script > > and something is happening? yes. I can execute it as "nobody" and a resultant log file is created. Since it was run with no parameters the log file basically says I need to pass arguments to sa-learn. Also I'm running iRedMail-0.9.0 and trying to set up the spam filter based on the intructions found on the webpage http://www.iredmail.org/forum/topic8169-iredmail-support-antispam-via-dovecot-and-spamassassin.html. I DO see that the MySQL database is being updated when a new message comes in. - -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJVI9frAAoJEIn5ENyiI2/NsW8P/1izBZ+32eIF34TgJZUKReca LzDC6hXya5Gc4PQ/jAN1LyP26/nd6WGqljtK3wj2qRoclp9+7iVNOsxi3zvFIMME orl1u5vAqQPcR9//BLoYxYy5HS0aEZS1YzuH2Mvxs9Dt+Bh+aJjpn5nsRiO32bRG CLviuVddxHwf6DkLbhIp2ybnZCCyTtWZ22NwsAAwRwocGBKi/vpQ83lUB398Ojn9 aVHEnkzd+QbilPcaU5k4SY/evACDnll4a1m9eBZm5VIvGWnDjmVXUSx+iHODol9X obSSFcXPJRMpq7JBdzpnlyP2EJBMjZun52T7oBA+SpoCKamtZaUzW2r9Q3aAgrYr F88K8EAGrRZgMI8cBwfFAntkygu6SCaWVULMqlmTv+XqyMlKWt+HAfc0EiFSJdos lzryDnU64regk3Y3GknOIxVDT7KzrXGP7MwUPHSqbgYxcKGbas70P8Py4aGYexlJ oNEUTBCb+pS4pzmPpu6QCCt7B0hoU7ZNWs8tlOEVZyFN3I+iAElZf939ciF/2o7E d/gLgmKbt0kRz5LPmKFts8Aw0lZshkk1FEoW+/DvGNCzpf4IpYQjvBl2h4rQmtuo jqoycFCHGCw0bXvohe2g4ZoRZmF0EUqWa7hfHbYxNZRpLa/ygEgYnA9CZPps5WXZ UtX9CydP8CwHHQ8JOjOI =rSXU -----END PGP SIGNATURE----- From micah at riseup.net Tue Apr 7 14:47:53 2015 From: micah at riseup.net (micah) Date: Tue, 07 Apr 2015 10:47:53 -0400 Subject: setting service_count results in Permission denied In-Reply-To: References: <876199t318.fsf@muck.riseup.net> Message-ID: <87k2xoouzq.fsf@muck.riseup.net> Steffen Kaiser writes: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Mon, 6 Apr 2015, Micah Anderson wrote: > >> service imap { service_count = 100 } > > where do you put this config line? I put it as I indicated in the config block below: >> service imap { >> # Most of the memory goes to mmap()ing files. You may need to increase this >> # limit if you have huge mailboxes. >> #vsz_limit = 256M >> # Max. number of IMAP processes (connections) >> process_limit = 4096 >> service_count = 100 ^^^ here >> executable = imap imap-postlogin >> } > please run: > > doveconf -a >without_service_count > add service_count > doveconf -a >with_service_count > > Then compare the section "service imap" and "imap-postlogin" for > changes. Thanks for the idea. I just did this (I dont need to restart dovecot, am I right?)... but the only thing that changes is 'service imap', changing service_count = 1 to service_count = 100 From space.ship.traveller at gmail.com Tue Apr 7 15:09:53 2015 From: space.ship.traveller at gmail.com (Samuel Williams) Date: Wed, 8 Apr 2015 03:09:53 +1200 Subject: Deleting empty folders In-Reply-To: <392C9B55-6E86-4DC2-9C6D-6618FDE960EA@iki.fi> References: <392C9B55-6E86-4DC2-9C6D-6618FDE960EA@iki.fi> Message-ID: Ah, Timo, that is what I was thinking of. > > doveadm expunge -d mailbox '*' not all > From ajs at crankycanuck.ca Tue Apr 7 20:48:21 2015 From: ajs at crankycanuck.ca (Andrew Sullivan) Date: Tue, 7 Apr 2015 16:48:21 -0400 Subject: Sieve, multiple addresses, and variables Message-ID: <20150407204821.GA29777@crankycanuck.ca> Hi, I have another sieve question, this time about setting variables. I join a lot of mailing lists at ietf.org. I thought it'd be handy to filter these all into a common folder and then into individual folders, without having to configure each mailing list independently. So wrote this (this is just a part, obviously): require ["envelope", "variables", "date", "fileinto", "mailbox" ]; if address :is :domain "to" "ietf.org" { if address :matches :localpart "to" "*" {set "lopart" "${1}";} } elsif address :is :domain "cc" "ietf.org" { if address :matches :localpart "cc" "*" {set "lopart" "${1}";} } else {set "lopart" "generic-list-box";} fileinto :create "ietf.${lopart}-in"; stop; } Now, this works, unless someone sends a To: line like this: To: ajs at crankycanuck.ca, listname at ietf.org The problem in that case is that you _do_ get a match, but the bit "if address :matches :localpart "to" "*" {set "lopart" "${1}";}" ends up putting this in a mailbox ietf.ajs-in, when what is the mailbox ietf.listname-in. I thought that allof(if address :matches :localpart "to" "*", address :matches :localpart "to" "*") {set "lopart" "${1}";}, would solve this, but it doesn't seem to. The localpart matching catches the ajs at crankycanuck.ca address anyway, which surprised me. Am I dim, am I not understanding something about how to do this, or is this really impossible? Thanks, A -- Andrew Sullivan ajs at crankycanuck.ca From anthony at cajuntechie.org Tue Apr 7 21:27:37 2015 From: anthony at cajuntechie.org (Anthony Papillion) Date: Tue, 07 Apr 2015 16:27:37 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: <147befea03280ae91d16573ba2aad147@jpunix.net> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> Message-ID: <55244BC9.4080903@cajuntechie.org> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 04/07/2015 08:14 AM, John Perry wrote: > On 2015/04/07 07:58, Steffen Kaiser wrote: > > >> Is this script executable for all, e.g.: > >> chmod a+x /path/to/script > > yes. That was the first thing I did. > > >> Is the script located in a directory everybody are allowed to >> execute, e.g. /usr/local/bin or /usr/bin . > > Yes. It is in /usr/bin named antispam.sh > > >> Can you run, e.g.: > >> sudo -u nobody /path/to/script > >> and something is happening? > > yes. I can execute it as "nobody" and a resultant log file is > created. Since it was run with no parameters the log file basically > says I need to pass arguments to sa-learn. I can confirm that I'm having the exact same issue. If I run the script manually, I get the 'help file' for sa-learn dumped into the log file. But the file is never created when mail comes in or is processed. Anthony -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJVJEvJAAoJEAKK33RTsEsVaX8P/Alj3RNVQst53zcOxkuBHW0I Ibd399Wxt7DBZYabbPhtR75Rffqa84ROaAfmx+ExibDms8VLxmG3HmrJHL2tUCbI /E4pDS9MyC08akweSRphQHFxhvu9LvKsVsnvGKP2gJ/Z4LDlqJ7KiB4+BPhohXL9 yoZ1zynQ43Ubh5cC/IG+k8zuXfsiUBmLo/8GLDcjs8Pqrx+C6mdpdXj3HWBm26ma 251ZIMAoKk301xSJhy3eZB7uzYPEJm+Lf74jGDrDUTmg+eC2DG/XRITcCSqoo33h NZzL7iyquUPUHG6mEdfOooK15o+j9roV2pQ1bWgKdMNc6+6roWPPZLALighutpBn Wjo72CcK7gL1dRdjDz0Ar2MqIPOoDwygpxOEIlB+//PxNvnOsIsiujMU0U1imTCf R+zHLYwIMTO1UYWbC4OtT+j8drV/mSNS2PCnBi4T8VNoUW/3oOa1TeWfom+VwlBC RfWYvE04cqMbOB1cUJVGx5/o1LFwZde29I56SAYOpHqE+H5BWPRvbLM9W39L01B+ ZgDteFg5VNH2DJF3nJFjj1mX5Llif2ZUoneiELu1bmI+A0Za7dEDje+Xhekf8NEn 4dkH57DhiALynw5dx3GrMhNMUXI2nQYGP/1DFRCvPujsS/H6neT/HtnAyZpflNnI r2WyS7tfbctyEHxaBYXH =yHyk -----END PGP SIGNATURE----- From bobber at kc0dxf.net Tue Apr 7 22:13:05 2015 From: bobber at kc0dxf.net (Bobber) Date: Tue, 07 Apr 2015 17:13:05 -0500 Subject: Search Public Folder Message-ID: <55245671.70003@kc0dxf.net> I'm trying to use doveadm fetch to search a folder that is public for all users. The command runs but the output is empty. There are no error messages. Is there anything different to do in order to search public folders? -- *Bob Wooldridge* From stephan at rename-it.nl Wed Apr 8 00:43:51 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 08 Apr 2015 02:43:51 +0200 Subject: Sieve, multiple addresses, and variables In-Reply-To: <20150407204821.GA29777@crankycanuck.ca> References: <20150407204821.GA29777@crankycanuck.ca> Message-ID: <552479C7.6020506@rename-it.nl> On 4/7/2015 10:48 PM, Andrew Sullivan wrote: > Hi, > > I have another sieve question, this time about setting variables. > > I join a lot of mailing lists at ietf.org. I thought it'd be handy to > filter these all into a common folder and then into individual > folders, without having to configure each mailing list independently. > > So wrote this (this is just a part, obviously): > > require ["envelope", "variables", "date", "fileinto", "mailbox" ]; > if address :is :domain "to" "ietf.org" { > if address :matches :localpart "to" "*" {set "lopart" "${1}";} > } > elsif address :is :domain "cc" "ietf.org" { > if address :matches :localpart "cc" "*" {set "lopart" "${1}";} > } > else {set "lopart" "generic-list-box";} > fileinto :create "ietf.${lopart}-in"; > stop; > } This script doesn't compile, due to mismatching '}', but I get the idea. > Now, this works, unless someone sends a To: line like this: > > To: ajs at crankycanuck.ca, listname at ietf.org > > The problem in that case is that you _do_ get a match, but the bit "if > address :matches :localpart "to" "*" {set "lopart" "${1}";}" ends up > putting this in a mailbox ietf.ajs-in, when what is the mailbox > ietf.listname-in. > > I thought that > > allof(if address :matches :localpart "to" "*", > address :matches :localpart "to" "*") > {set "lopart" "${1}";}, > > would solve this, but it doesn't seem to. The localpart matching > catches the ajs at crankycanuck.ca address anyway, which surprised me. This is a bit of a limitation of Sieve. These tests always yield the first matching address (part) and there is no way to link the tests based on which address matched previously (logic connectives have no effect on that either). In the spirit of your original script, the following would work: require ["envelope", "variables", "date", "fileinto", "mailbox"]; if address :matches ["to","cc"] "*@ietf.org" { set "lopart" "${1}"; } else { set "lopart" "generic-list-box"; } fileinto :create "ietf.${lopart}-in"; However, since this concerns mailing lists, there is a better, more reliable way using the List-Id header that the IETF also uses for its mailing lists: require ["envelope", "variables", "date", "fileinto", "mailbox"]; if header :matches "list-id" "*<*.ietf.org>*" { set "listbox" "ietf.${2}-in"; } else { set "listbox" "generic-list-box"; } fileinto :create "${listbox}"; Regards, Stephan. From justin at redfish.com.au Wed Apr 8 03:27:48 2015 From: justin at redfish.com.au (Justin Clacherty) Date: Wed, 8 Apr 2015 03:27:48 +0000 Subject: Authentication with Samba using Kerberos fails Message-ID: Hi, I've been having some problems getting GSSAPI authentication going against a samba (4.2) server and am hoping someone can point me in the right direction. I've searched through Google and haven't managed to find a solution yet. I followed the config instructions at http://wiki2.dovecot.org/Authentication/Kerberos and run through the testing. Testing from the server with telnet does as expected i.e. I get the "+" after I try "a authenticate GSSAPI". However, when I go to test from Thunderbird on while logged in on a Windows PC joined to the domain authentication fails and I see the following in mail.log (I'm running Ubuntu 14.04.2 LTS). Apr 8 11:49:18 server dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 8 11:49:18 server dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 8 11:49:18 server dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Apr 8 11:49:18 server dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Apr 8 11:49:18 server dovecot: auth: Debug: auth client connected (pid=17667) Apr 8 11:49:18 server dovecot: auth: Debug: client in: AUTH#0111#011GSSAPI#011service=imap#011secured#011session=e8xMvSwTQgDAqCpl#011lip=192.168.1.1#011rip=192.168.1.101#011lport=143#011rport=49986 Apr 8 11:49:18 server dovecot: auth: Debug: gssapi(?,192.168.42.101,): Obtaining credentials for imap at server.corp.mydomain.com Apr 8 11:49:18 server dovecot: auth: Debug: client passdb out: CONT#0111#011 Apr 8 11:49:18 server dovecot: auth: Debug: client in: CONT Apr 8 11:49:18 server dovecot: auth: Debug: gssapi(me at corp.mydomain.com,192.168.1.101,): security context state completed. Apr 8 11:49:18 server dovecot: auth: Debug: client passdb out: CONT#0111#011YIGVBgkqhkiG9xIBAgICAG+BhTCBgqADAgEFoQMCAQ+idjB0oAMCAReibQRrkGiOLsky4fbzWGzpxgW4mjmpjvNsiCqH8MnsUKviP9v1oVLPXSVkqFzFUiCLAd130ldnf742o/inz9Dx6e0aETwDKnnZu9OUD2nCGg/f5zA20IXGWR1zXVJi3hEB8nmrLgaENhyX0JMiE6g= Apr 8 11:49:18 server dovecot: auth: Debug: client in: CONT Apr 8 11:49:18 server dovecot: auth: Debug: gssapi(me at corp.mydomain.com,192.168.1.101,): Negotiated security layer Apr 8 11:49:18 server dovecot: auth: Debug: client passdb out: CONT#0111#011BQQF/wAMAAAAAAAAIvajggH////ubQhCZGfeuWGZQ7w= Apr 8 11:49:18 server dovecot: auth: Debug: client in: CONT Apr 8 11:49:18 server dovecot: auth: Panic: file auth-request.c: line 716 (auth_request_is_disabled_master_user): assertion failed: (request->requested_login_user != NULL) Apr 8 11:49:18 server dovecot: auth: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7f524a7da271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7f524a7da34e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f524a795a9e] -> dovecot/auth(+0x15162) [0x7f524ac7e162] -> dovecot/auth(auth_request_lookup_credentials+0x22) [0x7f524ac7f8d2] -> /usr/lib/dovecot/modules/auth/libmech_gssapi.so(+0x20d4) [0x7f52499450d4] -> dovecot/auth(auth_request_handler_auth_continue+0xd1) [0x7f524ac81391] -> dovecot/auth(+0x1052a) [0x7f524ac7952a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f524a7ea247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f524a7eafd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f524a7e9de8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f524a79ac93] -> dovecot/auth(main+0x38c) [0x7f524ac7750c] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f5249d8dec5] -> dovecot/auth(+0xe6d9) [0x7f524ac776d9] Apr 8 11:49:18 server dovecot: auth: Fatal: master: service(auth): child 17668 killed with signal 6 (core dumps disabled) Apr 8 11:49:18 server dovecot: imap-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=17667, EOF) Apr 8 11:49:19 server dovecot: imap-login: Disconnected (auth process communication failure): user=<>, method=GSSAPI, rip=192.168.1.101, lip=192.168.1.1, TLS, session= Relevant parts of my config: auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = yes auth_debug_passwords = no auth_default_realm = CORP.MYDOMAIN.COM auth_failure_delay = 2 secs auth_gssapi_hostname = server.corp.mydomain.com auth_krb5_keytab = /etc/dovecot/krb5.keytab auth_master_user_separator = auth_mechanisms = gssapi auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_username_translation = auth_verbose = yes auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 userdb { args = uid=dovecot gid=dovecot home=/var/vmail/%u default_fields = driver = static override_fields = } Any help greatly appreciated. Cheers, Justin. From HFlor at gmx.de Wed Apr 8 06:13:46 2015 From: HFlor at gmx.de (Hardy Flor) Date: Wed, 08 Apr 2015 08:13:46 +0200 Subject: doveadm save ... In-Reply-To: <55223798.2050403@gmx.de> References: <55223798.2050403@gmx.de> Message-ID: <5524C71A.5050409@gmx.de> No one has a suggestion? Am 06.04.2015 um 09:36 schrieb Hardy Flor: > Hello, > > when I have with "doveadm save ..." store a message, how do I get the > guid or uid of this message for the setthe flags? > > Hardy From skdovecot at smail.inf.fh-brs.de Wed Apr 8 09:18:35 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 11:18:35 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: <147befea03280ae91d16573ba2aad147@jpunix.net> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Apr 2015, John Perry wrote: > On 2015/04/07 07:58, Steffen Kaiser wrote: >> >> Is this script executable for all, e.g.: >> >> chmod a+x /path/to/script > > yes. That was the first thing I did. > >> Is the script located in a directory everybody are allowed to execute, >> e.g. /usr/local/bin or /usr/bin . > > Yes. It is in /usr/bin named antispam.sh > >> Can you run, e.g.: >> >> sudo -u nobody /path/to/script >> >> and something is happening? > > yes. I can execute it as "nobody" and a resultant log file is created. Since > it was run with no parameters the log file basically says I need to pass > arguments to sa-learn. > > Also I'm running iRedMail-0.9.0 and trying to set up the spam filter based on > the intructions found on the webpage > http://www.iredmail.org/forum/topic8169-iredmail-support-antispam-via-dovecot-and-spamassassin.html. > I DO see that the MySQL database is being updated when a new message comes > in. Do you have SELinux active? See almost at the end of http://wiki2.dovecot.org/WhyDoesItNotWork?highlight=%28selinux%29 - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSTya3z1H7kL/d9rAQKLDgf/QePW7F6Hy1pZR67SE33LykLPnL3fA4m0 u76fLz0hauGQOHCrdBIjtAtlYO7zxkZdW4Lv8zvnEmhrhZW6subluPliAMIHHutB 06YVU6Hp5aVLoQRY2+LYxU9yjiMFjBFhN3JkOy5mih1H8i3kp4/t91sfEDHzO+3f PJl61eNmhnxKg9AX3sQTAQt7AmdSLsCr4mGarISIcmi4P11wV7i+oWhxLEkW3/KX PM+q8aM7h1VMt+aCFKJ0eTDAtMypIrzauqjb63+T/urJutPHEhi5njxUQ0aKiM01 3j7SeEmwLQWj8YFYQ7MXmfEc9Ye5zVhFOOe0ohiTd3I+ZK59X49ecw== =TO57 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Wed Apr 8 09:24:49 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 11:24:49 +0200 (CEST) Subject: Dovecot keeps creating info files in mail directory instead of home In-Reply-To: References: <551BFFF5.4020102@mie.utoronto.ca> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 1 Apr 2015, Jeffrey 'jf' Lim wrote: > On Wed, Apr 1, 2015 at 10:25 PM, Oscar del Rio > wrote: >> On 04/ 1/15 10:12 AM, Jeffrey 'jf' Lim wrote: > > Back to the home directory: so what sort of "state" is stored in the home > directory exactly? Are all of the files that I see here in the maildir > either control files or index files? http://wiki2.dovecot.org/VirtualUsers/Home - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSTz4Xz1H7kL/d9rAQJwWAgAmtzYCxZ8nZGpWnTx0UnSDY8jneHBkjW+ cxon6uQ43Htb8Z5q6BEmourWs9hicGkI2U95h0ntktsJd3ZbxDAu+YRfYCJMF3E0 yxppgjIOGV6JTiz4G+GwsxSDb9GuuojB7CffW8rXgbEIXvKMiqMVCSC677GEadzN uJuFZJwjsJk2DPJbBt6FWQDvqbuhTXbp+lfHZszQVeXYDdABfDN3EP6VfPdCeA6X z5GFVwdlEm84atw5z4wjtXu+I5RP67iBBVT8rxCXRlR6bsitHbQ8UTivQ1DX0Zjt pn5INHuPoOO70bDQ3DOqCtwolRecNoU+ia435elVYaEPfo5wNFNX5g== =q0u8 -----END PGP SIGNATURE----- From perry at jpunix.net Wed Apr 8 09:24:05 2015 From: perry at jpunix.net (John Perry) Date: Wed, 08 Apr 2015 04:24:05 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> Message-ID: <5524F3B5.3060502@jpunix.net> Steffen Kaiser: > On Tue, 7 Apr 2015, John Perry wrote: >> On 2015/04/07 07:58, Steffen Kaiser wrote: >>> >>> Is this script executable for all, e.g.: >>> >>> chmod a+x /path/to/script > >> yes. That was the first thing I did. > >>> Is the script located in a directory everybody are allowed to execute, >>> e.g. /usr/local/bin or /usr/bin . > >> Yes. It is in /usr/bin named antispam.sh > >>> Can you run, e.g.: >>> >>> sudo -u nobody /path/to/script >>> >>> and something is happening? > >> yes. I can execute it as "nobody" and a resultant log file is created. >> Since it was run with no parameters the log file basically says I need >> to pass arguments to sa-learn. > >> Also I'm running iRedMail-0.9.0 and trying to set up the spam filter >> based on the intructions found on the webpage >> http://www.iredmail.org/forum/topic8169-iredmail-support-antispam-via-dovecot-and-spamassassin.html. >> I DO see that the MySQL database is being updated when a new message >> comes in. > > Do you have SELinux active? > See almost at the end of > http://wiki2.dovecot.org/WhyDoesItNotWork?highlight=%28selinux%29 > > -- Steffen Kaiser After checking I've determined that SELinux is NOT active. -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 From oflameo2 at gmail.com Wed Apr 8 11:30:44 2015 From: oflameo2 at gmail.com (John Lewis) Date: Wed, 08 Apr 2015 07:30:44 -0400 Subject: Users can't use Dovecot IMAP SOLVED In-Reply-To: <55235638.4090004@gmail.com> References: <55235638.4090004@gmail.com> Message-ID: <55251164.6050409@gmail.com> dictator at drakeclasher:~$ sudo dovecot -n [9/39] # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.14-0.bpo.1-amd64 x86_64 Debian 7.8 first_valid_gid = 0 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = failure_show_msg=yes %s driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp" ssl_cert = Every time a user logs into Dovcot's IMAP service PAM closes the session immediately after it opens. I would like a user to have a session open long enough to read some emails. > > dictator at drakeclasher:~$ sudo dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 3.14-0.bpo.1-amd64 x86_64 Debian 7.8 > mail_location = maildir:~/Maildir > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > passdb { > args = failure_show_msg=yes %s > driver = pam > } > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = " imap lmtp" > ssl_cert = ssl_key = userdb { > driver = passwd > } > userdb { > args = mail > driver = pam > } > > Apr 6 21:57:29 drakeclasher su[2346]: pam_unix(su:session): session > opened for user mailtest by dictator(uid=0) > Apr 6 21:59:55 drakeclasher su[2346]: pam_unix(su:session): session > closed for user mailtest > > dictator at drakeclasher:~$ groups mailtest > mailtest : Domain Users mail users > > > From skdovecot at smail.inf.fh-brs.de Wed Apr 8 11:25:50 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 13:25:50 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: <5524F3B5.3060502@jpunix.net> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Apr 2015, John Perry wrote: > Steffen Kaiser: >> On Tue, 7 Apr 2015, John Perry wrote: >>> On 2015/04/07 07:58, Steffen Kaiser wrote: >>>> >>>> Is this script executable for all, e.g.: >>>> >>>> chmod a+x /path/to/script >> >>> yes. That was the first thing I did. >> >>>> Is the script located in a directory everybody are allowed to execute, >>>> e.g. /usr/local/bin or /usr/bin . >> >>> Yes. It is in /usr/bin named antispam.sh >> >>>> Can you run, e.g.: >>>> >>>> sudo -u nobody /path/to/script >>>> >>>> and something is happening? >> >>> yes. I can execute it as "nobody" and a resultant log file is created. >>> Since it was run with no parameters the log file basically says I need >>> to pass arguments to sa-learn. >> >>> Also I'm running iRedMail-0.9.0 and trying to set up the spam filter >>> based on the intructions found on the webpage >>> http://www.iredmail.org/forum/topic8169-iredmail-support-antispam-via-dovecot-and-spamassassin.html. >>> I DO see that the MySQL database is being updated when a new message >>> comes in. >> >> Do you have SELinux active? >> See almost at the end of >> http://wiki2.dovecot.org/WhyDoesItNotWork?highlight=%28selinux%29 >> >> -- Steffen Kaiser > > After checking I've determined that SELinux is NOT active. Do you run Dovecot in a chroot? ==== OK, "run program failed with exit code" is nowhere in the sources I have for Dovecot v2.2, neither in Dovecot itself, Sieve, nor Antispam. Error -1 is a fairly generic one. Is it possible that for any other reason, Dovecot does not find the specified pipe program? Can you grab the source of the plugin? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSUQPnz1H7kL/d9rAQKjtAf+Nz7nTY7dvU5vi6WNzpufSGgvtUdmw0Ib EtSMRz1uiMzM9GNc2/q1U8Ti27wBPfv6EadkEDA2IaZeJaFB6ATnb/sa/WpObafT ZVfHvfomkc+VN8NOJgpegZDM/4fChgPGIlzveIiqo9oMQIFEdTcRubl7zynVHSMK zXK1EufFntXnxhceI14K32u5Yv2ohYK+gkpvQjZbSyGGq/a71vOs/3Uehs+iN3eJ lOjlbtGz/rWNbaO7rQLUznWkwWpQTuSGOe6zjxPVrqR23P3eIzBnAq0FMGqCQ23H 5VJ+lsCbAsQtecgxfV1OOPayTJ61j8skWWSVsp9Y55JYinPR1X5Vog== =XE8z -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Wed Apr 8 11:37:40 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 13:37:40 +0200 (CEST) Subject: ACL syntax for setting specified folders within Maildir/ read-only for owner In-Reply-To: <551E648B.6050304@oceanvoyages.com> References: <551E648B.6050304@oceanvoyages.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 3 Apr 2015, kepa wrote: > I have dovecot (2.2.16, see dovecot -n at end) installed to /opt on CentOS 6 > for access on a local network. I would like to create an archival mail > account which will reduce the primary account file size and still make older > emails easily accessible. How can I set specified folders in this Maildir > read-only with ACL? For example, I included this in the dovecot-acl file to see: http://wiki2.dovecot.org/ACL There is the "owner" identifier. But, IMHO, the owner always has the permission to change the ACLs. > specify protected folders in the archives@ Maildir but it did not work: > > "Email 2013/*" user=archives lrs > "Email 2014/*" user=archives lrs The user is named "archives"? > Also tried this on folders without spaces with no success (the folders were > still delete-able by the user via the Thunderbird client). Each "Email..." > folder has several child folders that should also be read-only. Better use doveadm acl add command to change ACLs. For whatever reason, I found the ACLs may not get effective immediately otherwise. If you really want to have readonly-Submailboxes, you need to do it via filesystem permissions. > BTW, what is the maximum size for a Maildir that Dovecot can comfortably > handle? I haven't found a mail client, that could cope with Dovecot's limits, so I cannot say. Or to phrase this sentence differently, if there was trouble, the client couldn't cope with the number of messages. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSUTBHz1H7kL/d9rAQK/CQgAlvSfmUyULh2seLQlfHlloSQ5IoVhVAPV +1VtKuAMcUQ6eUmK5fDXg9ogsmlI8miZIJfz2uSZ2tMcvdxLrd4Yy2KKue0x6LFr +BEb1kWtXZfV8NuCIIveLrizvA+baImU4MybPma1oQ2CNVkfO1RRYmZw+ZkLAxq8 CodUvYp71DGBQBheEBU+zdsguvfRFSxYFCdDYeNCthKTerIoAzxgDf/27JZY1Cph 46TtkvP5eydnrQr2RFlZykUXt6pRQ2PYRyOFgEX2+gK4RMNAsAJNFhQ94p6TAfZe aojQ5M/NEqto4F90FVmdSqCmzO1hO8Je2DdqguIZFkQlrXMPVJpQng== =XuPB -----END PGP SIGNATURE----- From perry at jpunix.net Wed Apr 8 12:10:27 2015 From: perry at jpunix.net (John Perry) Date: Wed, 08 Apr 2015 07:10:27 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> Message-ID: <55251AB3.40403@jpunix.net> Steffen Kaiser: > Can you grab the source of the plugin? > > -- Steffen Kaiser Do you mean the source for anti-spam? -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 From skdovecot at smail.inf.fh-brs.de Wed Apr 8 12:16:09 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 14:16:09 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: <55251AB3.40403@jpunix.net> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Apr 2015, John Perry wrote: > Steffen Kaiser: > >> Can you grab the source of the plugin? > > Do you mean the source for anti-spam? Yes. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSUcCXz1H7kL/d9rAQJFLAf9EmGwsO5nO/1rVEbtlnRMgbvij4+PE45g nRJT/KfG3PCdQFsY4yefYCocJZi6rwuA2r76pzn9E61X0g8dVma6k1W+RGs0UImW qsBTRTojjPkHYB0z/loIAcLWDYjE/EuPP3PO7IoAoDXvuUeM6wENCGScEm4Wznn8 HmxYnHmrG5SoDLsIZZ6WlkhLFh0dj5emITrFYEMYwtqHZTTxuySIbdWyHTeERz1D Pa2dx0iRpRsn40yWPuQjkNpwABTp6mZAoq+QEJaqSdvveXipO2EcUF89mcGI9Xkx vlNd8Kq7o/idCm3E+XjT/FPy0SWHqJTFGctZsfDfaWu0sfOq1bPt5A== =fDGf -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Wed Apr 8 12:16:40 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 14:16:40 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: <55251AB3.40403@jpunix.net> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Apr 2015, John Perry wrote: > Steffen Kaiser: > >> Can you grab the source of the plugin? > > Do you mean the source for anti-spam? Or sent a link into some repository. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSUcKHz1H7kL/d9rAQI6TwgAnlx9NmZlGjS3RytxsismdzcRIjzUHFwt K29nuGzxv9gh0WMbZGyhvoZFPw4VuGnTTDK4iFV4GEM3R/0q1eA0PIpC2VT3Yx7i i9YLRPHrRD1Jwu5wA7Tb2ULbw6zILoQKOaose51RpqVU2gBwnJasP4uCOYh42PL8 /LaADmgpD93RqOGRh6EcA5M3xFo5OQWMVfW1KMAZ2oJJXnyqnnYJzHap4AvOlF5p Yx3QNSt36nf4ke+S+pOu1pyd7eKPFstyyctaiPeAt3kk7nQfMgx7iD1s5grF5iJd FhNLhXBGh0vxt8gflWiWfT1+Fp0kqo4aUab6mGSceQ/LRSWZ+zHl4g== =aHr7 -----END PGP SIGNATURE----- From perry at jpunix.net Wed Apr 8 12:16:29 2015 From: perry at jpunix.net (John Perry) Date: Wed, 08 Apr 2015 07:16:29 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> Message-ID: <55251C1D.3090703@jpunix.net> Steffen Kaiser: > On Wed, 8 Apr 2015, John Perry wrote: >> Steffen Kaiser: > >>> Can you grab the source of the plugin? > >> Do you mean the source for anti-spam? > > Yes. > > -- Steffen Kaiser I'll see what I can do... I'm not sure the source is available. It may be tomorrow before I can act on it. -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 From perry at jpunix.net Wed Apr 8 12:18:13 2015 From: perry at jpunix.net (John Perry) Date: Wed, 08 Apr 2015 07:18:13 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: <55251C1D.3090703@jpunix.net> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> <55251C1D.3090703@jpunix.net> Message-ID: <55251C85.3050304@jpunix.net> John Perry: > Steffen Kaiser: >> On Wed, 8 Apr 2015, John Perry wrote: >>> Steffen Kaiser: >> >>>> Can you grab the source of the plugin? >> >>> Do you mean the source for anti-spam? >> >> Yes. >> >> -- Steffen Kaiser > > I'll see what I can do... I'm not sure the source is available. It may > be tomorrow before I can act on it. > I found the developer's page: http://johannes.sipsolutions.net/Projects/dovecot-antispam -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 From luke.bigum at lmax.com Wed Apr 8 12:45:39 2015 From: luke.bigum at lmax.com (luke.bigum at lmax.com) Date: Wed, 8 Apr 2015 12:45:39 +0000 (UTC) Subject: can't create folders under shared mailbox's INBOX Message-ID: <20150408124544.2253923002CE@mail.lmax.com> Hello, I have a namespace / ACL problem with shared mailboxes that I can't figure out. I have a local user tam at crm.yb.lmax that shares it's INBOX and all other folders with on LDAP group. Members of that group can't create a folder under the shared local user's INBOX: [08-Apr-2015 11:43:05 +0000]: [9501] S: * MYRIGHTS tam at crm.yb.lmax lrwstipekxcd [08-Apr-2015 11:43:05 +0000]: [9501] S: A0004 OK Myrights completed. [08-Apr-2015 11:43:05 +0000]: [9501] C: A0005 CREATE tam at crm.yb.lmax/Templates [08-Apr-2015 11:43:05 +0000]: [9501] S: A0005 NO [NOPERM] Permission denied I *can* create a folder underneath another folder of the same shared user that already exists: [08-Apr-2015 11:43:47 +0000]: [99CE] S: * MYRIGHTS tam at crm.yb.lmax/Drafts lrwstipekxcd [08-Apr-2015 11:43:47 +0000]: [99CE] S: A0004 OK Myrights completed. [08-Apr-2015 11:43:47 +0000]: [99CE] C: A0005 CREATE tam at crm.yb.lmax/Drafts/Test [08-Apr-2015 11:43:47 +0000]: [99CE] S: A0005 OK Create completed. Creating the subfolder as the local user itself works fine: [08-Apr-2015 11:35:35 +0000]: [4E9C] C: A0005 CREATE INBOX/Templates [08-Apr-2015 11:35:35 +0000]: [4E9C] S: A0005 OK Create completed. However the local user creates INBOX/Templates, whereas the ldap user is creating under tam at crm.yb.lmax/Templates. Is this an artifact of how we've set up namespaces below? Thanks, -Luke [root at localhost dovecot]# doveconf -n # 2.2.15: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.6 (3e924b1b6c5c+) # OS: Linux 2.6.32-358.11.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_master_user_separator = * default_login_user = vmail disable_plaintext_auth = no doveadm_password = secret doveadm_port = 12345 first_valid_gid = 490 first_valid_uid = 490 imapc_ssl_verify = no listen = * mail_access_groups = vmail mail_location = mdbox:~/mdbox/ mail_plugins = " zlib acl" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mdbox_preallocate_space = yes mdbox_rotate_size = 10 M namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = mdbox:/srv/mail/%%d/%%n/mdbox prefix = %%u/ separator = / subscriptions = yes type = shared } namespace personal { hidden = yes inbox = yes location = mailbox LMAX-Sent { auto = subscribe } mailbox Sent { auto = subscribe special_use = \Sent } prefix = INBOX/ separator = / subscriptions = yes type = private } passdb { args = scheme=SSHA512 /etc/dovecot/local-users.passdb driver = passwd-file } passdb { args = scheme=SSHA512 /etc/dovecot/master-users.passdb driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap skip = authenticated } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db sieve = ~/%d/%n/.dovecot.sieve sieve_dir = ~/%d/%n/sieve sieve_extensions = +notify +imapflags +vacation-seconds sieve_vacation_min_period = 10s zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve replication_dsync_parameters = -d -l 30 -U service auth { unix_listener auth-userdb { group = vmail user = vmail } } service config { unix_listener config { user = vmail } } service imap-login { process_limit = 500 process_min_avail = 2 user = vmail } service imap-postlogin { executable = script-login /etc/dovecot/ldap_groups.sh user = vmail } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> <55251C1D.3090703@jpunix.net> <55251C85.3050304@jpunix.net> Message-ID: <55252B78.9080905@talpey.com> On 4/8/2015 8:18 AM, John Perry wrote: > I found the developer's page: > > http://johannes.sipsolutions.net/Projects/dovecot-antispam > That project forked, and there are two versions now. They have subtly different configuration parameters, which trips folks up. See also: http://wiki2.dovecot.org/Plugins/Antispam/ where it mentions: >> Introduction >> >> The antispam plugin allows you to retrain the spam filter by simply >> moving emails in and out of the Spam folder. This is the fork of the >> analogous plugin for Dovecot versions prior to v2.0. The original >> project can be found ... From skdovecot at smail.inf.fh-brs.de Wed Apr 8 13:31:22 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Apr 2015 15:31:22 +0200 (CEST) Subject: Need a bit of help with the antispam plugin In-Reply-To: <55252B78.9080905@talpey.com> References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> <55251C1D.3090703@jpunix.net> <55251C85.3050304@jpunix.net> <55252B78.9080905@talpey.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Apr 2015, Tom Talpey wrote: > Date: Wed, 08 Apr 2015 09:22:00 -0400 > From: Tom Talpey > To: dovecot at dovecot.org > Subject: Re: Need a bit of help with the antispam plugin > > On 4/8/2015 8:18 AM, John Perry wrote: >> I found the developer's page: >> >> http://johannes.sipsolutions.net/Projects/dovecot-antispam this version 1.99 and 2.0 has "run program failed with exit code" and "running mailtrain backend program", but no "unning mailtrain backend program parameter". If your package maintainer uses this version as base, it looks like, that forked program crashes, that is WIFEXITED() returns false. As it happens with the script, too, it sounds like chroot or SELinux problems ;-) > That project forked, and there are two versions now. They have > subtly different configuration parameters, which trips folks up. > > See also: http://wiki2.dovecot.org/Plugins/Antispam/ That's the version I use. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSUtqnz1H7kL/d9rAQJ5Sgf7B2HvKDWvIcO+7WtdpAfeJ64ebbvT/psX vIW3QxeiphKyod6P1qoO1yE1HCc+rkUbg786CZvqxZoNhzBvJxbPqkSRIwN/zAJX ejYCr75m9uvHV/rPbGVswUt8InPYVXvLKjti3x4jRRlG1tpH7T8n/N3d3Ma/CcKn VetLsSgnz84RAY9wYM5l09zsC9edN+dEy392r+qjms3DH7am+EXCsX/jYCS+bs8g aJgwzOFre0T7aNeRPOp4WCBnp32t2LCoYTuPyELKW8TarAEO4wex1H5XXKsoTPES 5jEsa2+0Afp3QB1UV7O2biqq9J+Cplb/kqhM+fx2hVm/23xYOnzLRw== =bjsh -----END PGP SIGNATURE----- From perry at jpunix.net Wed Apr 8 13:39:37 2015 From: perry at jpunix.net (John Perry) Date: Wed, 08 Apr 2015 08:39:37 -0500 Subject: Need a bit of help with the antispam plugin In-Reply-To: References: <551B2FBE.2030504@cajuntechie.org> <147befea03280ae91d16573ba2aad147@jpunix.net> <5524F3B5.3060502@jpunix.net> <55251AB3.40403@jpunix.net> <55251C1D.3090703@jpunix.net> <55251C85.3050304@jpunix.net> <55252B78.9080905@talpey.com> Message-ID: <55252F99.50506@jpunix.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Steffen Kaiser: > On Wed, 8 Apr 2015, Tom Talpey wrote: > >> Date: Wed, 08 Apr 2015 09:22:00 -0400 From: Tom Talpey >> To: dovecot at dovecot.org Subject: Re: Need a bit >> of help with the antispam plugin > >> On 4/8/2015 8:18 AM, John Perry wrote: >>> I found the developer's page: >>> >>> http://johannes.sipsolutions.net/Projects/dovecot-antispam > > this version 1.99 and 2.0 has "run program failed with exit code" > and "running mailtrain backend program", but no "unning mailtrain > backend program parameter". > > If your package maintainer uses this version as base, it looks > like, that forked program crashes, that is WIFEXITED() returns > false. > > As it happens with the script, too, it sounds like chroot or > SELinux problems ;-) > >> That project forked, and there are two versions now. They have >> subtly different configuration parameters, which trips folks up. > >> See also: http://wiki2.dovecot.org/Plugins/Antispam/ > > That's the version I use. > > -- Steffen Kaiser I'll try the mercurial version later today and see what happens. Thanks! - -- John Perry - WX5JP http://www.jpunix.net https://www.digitalocean.com/?refcode=b90b690ca5bb https://lastpass.com/f?3921926 -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJVJS+YAAoJEIn5ENyiI2/No0cQAMlHN2/bFBDDyrVQkkAVcJww 2K1d7pqr3wvxSkT+SUM+FRjl634ZPvDcihHySh8HTYxVVwE3xMYWi6sG+hQjduLr IuNfdQBoaDGPU+AvhkPa0d44+vqgJ5yJl79u3csMCch5+xqUXp1xJL+bFb3snKFO sks3b2yef97P2k3ep0op6/AacdQf/u1syfUMkF/UMxTKDECs3KKH59e9IrcJSXHF VJbjpmAcxn9Sm7YQkH90GaklEAdm5OWHvLsiEpKdjRfR1BkRdT9rO3qwT6OGTTsu a14S8rNGVwmc9Uy5A4S9glR1lTVJr1ju4LBxWfranXqd1TPwdLtSIPYjug4Qtkkz gGZ7GbJQbKadTJef/pxLi49twR339Qbx85DE4NkVgKocH/Gvy50zNnXADp7BQXwh kGw26tlUhBEik0pqTQlodRhu2BYe8AyAKChsO5w3hoGn/vB07DZQihJFHYrgiq2M Oepe0npaBUOVGimyx9V4nFgwZbydZ/YpR+l/rdgPyMijSMVAoHpSFfP00LYJQQJH OyM1yp/xox4YTorlaNZv5liEsXl0qUUT+VtYEJv2UnNOSGtOQxOKWSV/HuV/0GRn RxJTZ49ciJB8UqZOQ2O8Pi2TPsRqqjA8u+6L7BfaoUG0a4at0dthiRtzYGXefV4k oyyMDDFn+q2Qg3KEaJa5 =gkaH -----END PGP SIGNATURE----- From Juergen.Obermann at hrz.uni-giessen.de Wed Apr 8 14:24:49 2015 From: Juergen.Obermann at hrz.uni-giessen.de (=?utf-8?b?SsO8cmdlbg==?= Obermann) Date: Wed, 08 Apr 2015 16:24:49 +0200 Subject: dovecot-2.2.16 compilation problems under Solaris Studio 11 Message-ID: <20150408162449.Horde.JVFLyGh86N7lbldXeYJmwA1@horde5.hrz.uni-giessen.de> Hello here are two problems I get when I compile dovecot 2.2.16 under Solaris 10 with Studio 11 Compiler: gmake[4]: Entering directory `/net/fileserv/export/sunsrc/src/dovecot-2.2.16/src/lib' source='test-array.c' object='test_lib-test-array.o' libtool=no \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-test -I/opt/local/include -I/usr/local/include -fast -xarch=v8plusa -I/opt/local/include -c -o test_lib-test-array.o `test -f 'test-array.c' || echo './'`test-array.c "test-array.c", line 129: warning: initializer does not fit or is out of range: -32768 "test-array.c", line 129: warning: initializer does not fit or is out of range: -16384 "test-array.c", line 129: warning: initializer does not fit or is out of range: -512 "test-array.c", line 129: warning: initializer does not fit or is out of range: -256 "test-array.c", line 129: warning: initializer does not fit or is out of range: -128 "test-array.c", line 129: warning: initializer does not fit or is out of range: -64 "test-array.c", line 129: warning: initializer does not fit or is out of range: -2 "test-array.c", line 129: warning: initializer does not fit or is out of range: -1 "test-array.c", line 154: operand cannot have void type: op "=" "test-array.c", line 154: assignment type mismatch: unsigned short "=" const void "test-array.c", line 206: operand cannot have void type: op "=" "test-array.c", line 206: assignment type mismatch: pointer to const char "=" const void cc: acomp failed for test-array.c gmake[4]: [test_lib-test-array.o] Fehler 2 (ignoriert) gmake[3]: Entering directory `/net/fileserv/export/sunsrc/src/dovecot-2.2.16/src/lib-imap' source='imap-match.c' object='imap-match.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-charset -I../../src/lib-mail -I/opt/local/include -I/usr/local/include -fast -xarch=v8plusa -I/opt/local/include -c -o imap-match.lo imap-match.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-charset -I../../src/lib-mail -I/opt/local/include -I/usr/local/include -fast -xarch=v8plusa -I/opt/local/include -c imap-match.c -KPIC -DPIC -o .libs/imap-match.o "imap-match.c", line 199: identifier redeclared: imap_match_dup current : function(pointer to struct pool {pointer to const struct pool_vfuncs {..} v, unsigned int alloconly_pool :1, unsigned int datastack_pool :1}, pointer to const struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data}) returning pointer to struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data} previous: function(pointer to struct pool {pointer to const struct pool_vfuncs {..} v, unsigned int alloconly_pool :1, unsigned int datastack_pool :1}, pointer to const struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data}) returning pointer to struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data} : "imap-match.h", line 33 "imap-match.c", line 214: identifier redeclared: imap_match_globs_equal current : function(pointer to const struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data}, pointer to const struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data}) returning _Bool previous: function(pointer to const struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data}, pointer to const struct imap_match_glob {pointer to struct pool {..} pool, pointer to struct imap_match_pattern {..} patterns, char sep, array[-1] of char patterns_data}) returning _Bool : "imap-match.h", line 36 cc: acomp failed for imap-match.c gmake[3]: [imap-match.lo] Fehler 1 (ignoriert) Greetings J?rgen -- Hochschulrechenzentrum der | Mail: Juergen.Obermann at hrz.uni-giessen.de Justus-Liebig-Universitaet | WWW: http://www.uni-giessen.de/obermann/ Heinrich-Buff-Ring 44 | Tel: 0641-99-13054 (0641-99-13001) D-35392 Giessen, Germany | Fax: 0641-99-13009 From list.dovecot at tiri.li Wed Apr 8 14:44:10 2015 From: list.dovecot at tiri.li (Thomas Baumann) Date: Wed, 8 Apr 2015 16:44:10 +0200 Subject: dovecot debug LDAP expansion Message-ID: Hello all, how can LDAP Expansion being debugged? I need to see which LDAP Query is sent to the LDAP server and which Result is sent by the Server. Best regards, Thomas. From devnull at ehwat.de Wed Apr 8 14:53:26 2015 From: devnull at ehwat.de (Patrick Lion) Date: Wed, 8 Apr 2015 16:53:26 +0200 Subject: sieve plugin editheader not found Message-ID: Hey folks, ive already made a bug report in the gentoo bugtracker last year. In the meantime after some releases the error persists with the current dovecot and pigeonhole versions. Please see my bug report at gentoo mailinglist: https://bugs.gentoo.org/show_bug.cgi?id=522148 Okay, here are some informations: Steps to Reproduce: add "editheader" to sieve options or "sievec" a file that need the extension if header :matches "Something" "*" { addheader "Anything" "${1}"; deleteheader "Something"; } sievec mod_header.sieve sievec(root): Fatal: Plugin 'editheader' not found from directory /usr/lib64/dovecot/sieve dovecot --version 2.2.16 pigeonhole-0.4.7 sources got downloaded and used in the build process dovecot -n # 2.2.16: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.7 # OS: Linux 2.6.32-openvz-042stab102.9-amd64 x86_64 Gentoo Base System release 2.2 auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no imap_capability = CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=ORDEREDSUBJECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED CONTEXT=SEARCH LIST-STATUS SPECIAL-USE XLIST QUOTA info_log_path = syslog login_log_format_elements = user=<%u> method=%m ip=%r mpid=%e mail_location = maildir:%h/.maildir mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include body enotify environment mailbox date index ihave duplicate imapflags notify namespace compat { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { args = /etc/dovecot/dovecot-sql.conf.ext quota = maildir quota_rule2 = trash:storage=+150M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_extensions = variables } postmaster_address = mailer-daemon at dev.someserver service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /etc/postfix/quota-warning.sh unix_listener quota-warning { group = hosting mode = 0660 user = postfix } user = postfix } ssl_cert = References: Message-ID: <552548BD.2040407@raptor.kiev.ua> On 04/08/2015 05:53 PM, Patrick Lion wrote: > Hey folks, > > ive already made a bug report in the gentoo bugtracker last year. In the > meantime after some releases the error persists with the current dovecot > and pigeonhole versions. > > Please see my bug report at gentoo mailinglist: > > https://bugs.gentoo.org/show_bug.cgi?id=522148 > > Okay, here are some informations: > > Steps to Reproduce: > > add "editheader" to sieve options or "sievec" a file that need the extension > > if header :matches "Something" "*" { > addheader "Anything" "${1}"; > deleteheader "Something"; > } > > sievec mod_header.sieve > sievec(root): Fatal: Plugin 'editheader' not found from directory > /usr/lib64/dovecot/sieve > > > > dovecot --version > 2.2.16 > > pigeonhole-0.4.7 sources got downloaded and used in the build process > > dovecot -n > > # 2.2.16: /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.7 > # OS: Linux 2.6.32-openvz-042stab102.9-amd64 x86_64 Gentoo Base System > release 2.2 > auth_mechanisms = plain login > auth_socket_path = /var/run/dovecot/auth-userdb > auth_verbose = yes > dict { > quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > } > disable_plaintext_auth = no > imap_capability = CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE IDLE SORT > SORT=DISPLAY THREAD=REFERENCES THREAD=ORDEREDSUBJECT CHILDREN NAMESPACE > UIDPLUS LIST-EXTENDED CONTEXT=SEARCH LIST-STATUS SPECIAL-USE XLIST QUOTA > info_log_path = syslog > login_log_format_elements = user=<%u> method=%m ip=%r mpid=%e > mail_location = maildir:%h/.maildir > mail_plugins = quota > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include body enotify environment mailbox date index ihave duplicate > imapflags notify > namespace compat { > alias_for = > hidden = yes > inbox = no > list = no > location = > prefix = INBOX. > separator = . > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > separator = / > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > args = /etc/dovecot/dovecot-sql.conf.ext > quota = maildir > quota_rule2 = trash:storage=+150M > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > sieve_extensions = +notify +imapflags > sieve_global_extensions = variables > } > postmaster_address = mailer-daemon at dev.someserver > service auth { > unix_listener /var/spool/postfix/private/auth { > group = mail > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0660 > user = postfix > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > } > service quota-warning { > executable = script /etc/postfix/quota-warning.sh > unix_listener quota-warning { > group = hosting > mode = 0660 > user = postfix > } > user = postfix > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol lda { > mail_plugins = quota sieve > postmaster_address = mailer-daemon at dev.someserver > } > protocol imap { > mail_plugins = quota imap_quota > } > protocol pop3 { > mail_plugins = quota > } > protocol lmtp { > hostname = dev.someserver > mail_plugins = quota sieve > postmaster_address = postmaster at dev.someserver > } > > > Please let me know if you need any additional informations, build logs ( > log from 2.213 attached at bugs.gentoo.org ) or whatever may be helpful to > track this down. I'm not using gentoo, but here on Debian everything works as expected. eugene at hopper[pts/4]:~> locate editheader /usr/share/doc/dovecot-core/sieve/extensions/editheader.txt That is a txt version of http://wiki2.dovecot.org/Pigeonhole/Sieve/Extensions/Editheader eugene at hopper[pts/4]:~> doveconf -a | grep sieve sieve = ~/.sieve/.current sieve_dir = ~/.sieve sieve_global_dir = /etc/dovecot/sieve mail_plugins = " sieve eugene at hopper[pts/4]:~> cat test.sieve require ["editheader"]; if header :matches "Something" "*" { addheader "Anything" "${1}"; deleteheader "Something"; } Notice that require line. eugene at hopper[pts/4]:~> sievec -d -x +editheader test.sieve - * Script metadata (block: 0): class = file class.version = 0 location = /home/eugene/test.sieve * Required extensions (block: 1): 0: editheader (id: 30) * Main program (block: 2): Address Line Code 00000000: DEBUG BLOCK: 3 00000001: EXTENSIONS [1]: 00000002: editheader 00000003: 3: HEADER 00000006: match type: matches 00000009: header names: STR[9] "Something" 00000015: key list: STR[1] "*" 00000019: 3: JMPFALSE 39 [00000041] 0000001e: 4: addheader 00000020: field-name: STR[8] "Anything" 0000002b: value: STR[4] "${1}" 00000032: 5: DELETEHEADER 00000034: field name: STR[9] "Something" 00000041: 5: [End of code] -- Eugene Paskevich | *==)----------- | Plug me into eugene at raptor.kiev.ua | -----------(==* | The Matrix From lista at xdrv.co.uk Wed Apr 8 16:25:53 2015 From: lista at xdrv.co.uk (James) Date: Wed, 08 Apr 2015 17:25:53 +0100 Subject: dovecot-2.2.16 compilation problems under Solaris Studio 11 In-Reply-To: <20150408162449.Horde.JVFLyGh86N7lbldXeYJmwA1@horde5.hrz.uni-giessen.de> References: <20150408162449.Horde.JVFLyGh86N7lbldXeYJmwA1@horde5.hrz.uni-giessen.de> Message-ID: <55255691.2060409@xdrv.co.uk> On 08/04/2015 15:24, J?rgen Obermann wrote: Hello J?rgen, > here are two problems I get when I compile dovecot 2.2.16 under Solaris > 10 with Studio 11 Compiler: Is there a reason to use a 10 year old compiler? Try 12.4: http://www.oracle.com/technetwork/server-storage/solarisstudio/downloads/index-jsp-141149.html I am using Solaris 10 and dovecot compiled with SS12.4. James. From ajs at crankycanuck.ca Wed Apr 8 17:32:23 2015 From: ajs at crankycanuck.ca (Andrew Sullivan) Date: Wed, 8 Apr 2015 13:32:23 -0400 Subject: Sieve, multiple addresses, and variables In-Reply-To: <552479C7.6020506@rename-it.nl> References: <20150407204821.GA29777@crankycanuck.ca> <552479C7.6020506@rename-it.nl> Message-ID: <20150408173223.GG30145@crankycanuck.ca> On Wed, Apr 08, 2015 at 02:43:51AM +0200, Stephan Bosch wrote: > > This script doesn't compile, due to mismatching '}', but I get the idea. Doh! Yes, obviously, I copied it from something longer in order to get an isolated example, but should have checked. Thanks. > This is a bit of a limitation of Sieve. These tests always yield the > first matching address (part) and there is no way to link the tests > based on which address matched previously (logic connectives have no > effect on that either). Got it. Thanks. > However, since this concerns mailing lists, there is a better, more > reliable way using the List-Id header that the IETF also uses for its > mailing lists: That was what I originally wanted to do, but of course that doesn't work when someone does reply-all, I sent the mail, and the list is configured to suppress duplicates. I could turn off duplicate suppression, I suppose, except that the version of pigeonhole in Ubuntu 14.04 LTS doesn't have the duplicate extension (so I guess it's slightly older; dovecot --version says 2.2.9). The more I think about this (or actually, live with it), however, the less satisfactory the generic answer is anyway, since people often copy more than one list and I discover I have an opinion about which one ought to be "primary". So I think I'll have to go back to a rule per list. Thanks very much for your help, because this is at least allowing me to learn. Best regards, A -- Andrew Sullivan ajs at crankycanuck.ca From guillermo.narvaja at fierro.com.ar Wed Apr 8 21:52:57 2015 From: guillermo.narvaja at fierro.com.ar (Guillermo M. Narvaja) Date: Wed, 08 Apr 2015 18:52:57 -0300 Subject: pop3 retr responses too large lines - Fails with current python's poplib Message-ID: <1428529977.20288.15.camel@catamarca.fierro-soft.com.ar> Since December 2014, clients using the Python poplib library (getmail in my case) started to limit the line length of RETR and other command responses sent from the server to 2048 bytes: See https://bugs.python.org/issue16041 (Included at least in Python-2.7.9) Dovecot doesn't have line split in the POP3 module, so Python fails to retrieve messages with long lines. RFC 1939 says: " Responses in the POP3 consist of a status indicator and a keyword possibly followed by additional information. All responses are terminated by a CRLF pair. Responses may be up to 512 characters long, including the terminating CRLF. " I think dovecot-pop3 should split it's output in lines of at least 512 characters. Or at least it should have a "pop3_max_line_length" setting (like "imap_max_line_length"). Server side: # dovecot --version 2.2.13 Client side: # python --version Python 2.7.9 # getmail --version getmail 4.47.0 Temporary workaround (on client-side): --- poplib.py.orig 2015-04-08 18:46:48.280879211 -0300 +++ poplib.py 2015-04-08 18:26:01.288556028 -0300 @@ -36,7 +36,7 @@ # reading arbitrary length lines. RFC 1939 limits POP3 line length to # 512 characters, including CRLF. We have selected 2048 just to be on # the safe side. -_MAXLINE = 2048 +_MAXLINE = 2048*100 class POP3: Thanks in advance. -- Guillermo M. Narvaja Lambda Sistemas S.R.L. www.fierro-soft.com.ar - radiocut.fm Tel: (5411) 3220-1520 (rotativas) y 4857-6662 Cel: (5411) 15-6783-4435 Email: guillermo.narvaja at fierro-soft.com.ar MSN: guillermo_narvaja at hotmail.com Skype: guillermonarvaja Lavalleja 519 1er Piso - Ciudad de Buenos Aires - Argentina From bjlockie at lockie.ca Thu Apr 9 04:35:22 2015 From: bjlockie at lockie.ca (James) Date: Thu, 09 Apr 2015 00:35:22 -0400 Subject: imap doesn't like my passwd Message-ID: <5526018A.7030902@lockie.ca> I spent days on this problem. I have dovecot setup to use SSL and IMAP. I also have a pop account that I had no trouble getting working. Both use PAM authentication on Linux. openssl s_client -connect localhost:993 a login test_user test_secure_password The response I got back was: a BAD Invalid characters in atom I changed the password to "abc" and it worked. The secure password used to work but it was a different architecture (x86_64 I think). The current architecture is armhf. It may be different versions of the software too. Dovecot v2.1.7 From bjlockie at lockie.ca Thu Apr 9 04:37:55 2015 From: bjlockie at lockie.ca (James) Date: Thu, 09 Apr 2015 00:37:55 -0400 Subject: imap doesn't like my passwd In-Reply-To: <5526018A.7030902@lockie.ca> References: <5526018A.7030902@lockie.ca> Message-ID: <55260223.3070100@lockie.ca> It is not architecture related, my phone uses the same account and it used to work. It is either IMAP or Dovecot. On 04/09/2015 12:35 AM, James wrote: > > I spent days on this problem. > I have dovecot setup to use SSL and IMAP. > I also have a pop account that I had no trouble getting working. > Both use PAM authentication on Linux. > openssl s_client -connect localhost:993 > a login test_user test_secure_password > The response I got back was: > a BAD Invalid characters in atom > > I changed the password to "abc" and it worked. > > The secure password used to work but it was a different architecture > (x86_64 I think). > The current architecture is armhf. > It may be different versions of the software too. > > Dovecot v2.1.7 > From bob.wooldridge at edm-inc.com Tue Apr 7 22:11:31 2015 From: bob.wooldridge at edm-inc.com (Bob Wooldridge) Date: Tue, 07 Apr 2015 17:11:31 -0500 Subject: Search Public Folder Message-ID: <55245613.9000300@edm-inc.com> I'm trying to use doveadm fetch to search a folder that is public for all users. The command runs but the output is empty. There are no error messages. Is there anything different to do in order to search public folders? -- Bob Wooldridge EDM Incorporated http://www.edm-inc.com From skdovecot at smail.inf.fh-brs.de Thu Apr 9 06:32:48 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 9 Apr 2015 08:32:48 +0200 (CEST) Subject: dovecot debug LDAP expansion In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Apr 2015, Thomas Baumann wrote: > how can LDAP Expansion being debugged? > I need to see which LDAP Query is sent to the LDAP server and which Result > is sent by the Server. use wireshark (or similiar) or turn on debugging on the LDAP server - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSYdEHz1H7kL/d9rAQL/Bwf/SdnMoHikF8Fmok+xVyPcn7kcIH58SN05 vHiBJ01U0ZqZ5FJpA0HkVxOSW+1H1i4y075LbDtfi72HyexD9wfDNfcvFounkirv KEGmua9qh3jNYgu8B6aEJMib0COlvEWoj+VLTMOBVsnDSD+3td/kLwOdvR+wj9gG zNvUx/YN9c//U+hAKg7grgCKQQtwMe+sfN1BCVo0z9jRyN5CgyH1clPCImm1hcFd g7YTvpyMceunKb89O90ot8QqfQMhYfGdBv4qGdtQsfSV2AcC3k6Q3SD6I6BjwxyA 6pp9uObA64F0lFT7uRgQADzGzNK7dH4MvW0wM1NMZQTX5M0TWOcgcA== =I960 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Apr 9 06:40:10 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 9 Apr 2015 08:40:10 +0200 (CEST) Subject: imap doesn't like my passwd In-Reply-To: <5526018A.7030902@lockie.ca> References: <5526018A.7030902@lockie.ca> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 9 Apr 2015, James wrote: > Both use PAM authentication on Linux. > openssl s_client -connect localhost:993 > a login test_user test_secure_password > The response I got back was: > a BAD Invalid characters in atom Does your password contain the " quote? If not, enclose the password in "". Or try the literal form: 1 login user {##} password where ## is the number of octets of password > The secure password used to work but it was a different architecture (x86_64 > I think). > The current architecture is armhf. architecture of the server or client? Maybe you need to re-create the password store? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSYeynz1H7kL/d9rAQIsqwgAgVzzXjZj1hAO22hoamDM0mPJovqnNlIF YQ9/pR421GOca8YOebh9YHqqMbxuj8DFADS06EAdcKQdyONKd0CsxtHsjqIrV/FB uxEMY/MFdTto9ToMjj33YtQFz0MjACvrqO/hzepgCK3Pgt3HK0UHyN36qYmwnpNs Vzbm/YYb+4xnciYq2sLlAKvrvIn+LQT25OP7toGiXnOkGQSTbwxRtysmLe+f3Cvv XlnYTZsKTIuwAJNcDphKpd0LSts5k6Fua4pw1LtxP42W63xE5iq3KTqGdi4u6nQS jVRdKwAKVjihbbLFN1K1nlVyEEQP2dpEk4B+smRwGQTaxRrDFlki8A== =L7CD -----END PGP SIGNATURE----- From p.heinlein at heinlein-support.de Thu Apr 9 14:14:20 2015 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 09 Apr 2015 16:14:20 +0200 Subject: gmail-migration: archived mails in \ALL Message-ID: <5526893C.7020208@heinlein-support.de> Hi, I don't completly understand http://wiki2.dovecot.org/Migration/Gmail I can't find the documentation for the -a and the -F Flag. I'd like to migrate ONLY archived mails from an existing gmail-Account. So I'd have to import all Mails from the \ALL-Folder that does NOT have any virtual folder flags set. I tried to use this command: doveadm -D -o imapc_user=user at example.com -o pop3c_user=user at exampe.com -o imapc_password=secret -o pop3c_password=secret -o imapc_host=imap.googlemail.com -v backup -m '[Gmail]/Tutti i messaggi' -F '-$GmailHaveLabels' -x \Flagged -x \Junk -x \Trash -x \Important -R -u user at example.com imapc: But it looks like it's importing too many mails and not only the archived mails without Flags. How do I have do understand -F '-$GmailHaveLabels ?? Is it "that NOT have $GmailHaveLabels"? And: Is there any better way to address the \ALL-Folder? I can use "-x \All" to exclude that folder, but it looks like I can't use "-m \All" to select that folder. We're a little bit in hurry since Google will stop its service this weekend. Any fast help would be appreciated. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From andreas.kasenides at cs.ucy.ac.cy Thu Apr 9 15:37:58 2015 From: andreas.kasenides at cs.ucy.ac.cy (Andreas Kasenides) Date: Thu, 09 Apr 2015 18:37:58 +0300 Subject: sa-learn with remote Dovecot folders In-Reply-To: <551E9530.7080809@gedalya.net> References: <551E67DD.70107@cs.ucy.ac.cy> <551E9530.7080809@gedalya.net> Message-ID: <55269CD6.6090303@cs.ucy.ac.cy> Thanks for your reply. You got me thinking towards the antispam plugin which I have nto used before, but can you elaborate if my users are system users and the training is done only via a cron entry? Andreas On 03/04/15 16:27, Gedalya wrote: > On 04/03/2015 06:13 AM, Andreas Kasenides wrote: >> Hi all! >> >> The set-up I have is a classic one: >> 1. one or more Dovecot relay/directors Postfix SMTP servers in DMZ >> 2. one or more backend IMAP/SMTP servers on the inside network >> 3. There may or may not be separate incoming or outgoing designated >> SMTP servers. >> Now the desired functionality is (of course): >> 1. relay machines receive messages from outside AND inside >> 2. relays check for all the bad things (spam, viruses etc). >> 3. for incoming messages relays check for valid local users and >> reject messages for invalid users >> 4. after all checks are done incoming messages are transferred to the >> backend systems where they are accessed via the Dovecot directors >> >> While all the above works nicely, the problem I have is how to train >> my spamassassin (used by amavisd) on the front ends when all messages >> are on the back ends. Of course transferring the spam detection >> procedures internally is not such a great option.Am I missing >> something? I tried googling for info but nothing substantial turned up. >> >> Thanks. >> > I use ssh. The exact details depend on your setup, of course. Do you > use system users of virtual users? What triggers the training? Is it > the antispam plugin? From mimicafe at gmail.com Thu Apr 9 16:46:04 2015 From: mimicafe at gmail.com (mimicafe at gmail.com) Date: Thu, 9 Apr 2015 17:46:04 +0100 Subject: Calendar and address book with Dovecot Message-ID: Hi all I recently install Postfix and Dovecot, and so far so good. My assumption was that calendar and address book (similar to Gmail calendar or address book) are part of Dovecot. However I do not see anything concerning them in any of the docs I have read so far. What other software (ideally open source, free) do I need in other to have Calendar and address book so my users can manage their contact on their phones or computer? I have looked at Roundcube already, but my requirement is not necessarily to provide web mail. Thanks Mimi From mihai at badici.ro Thu Apr 9 17:07:33 2015 From: mihai at badici.ro (mihai at badici.ro) Date: Thu, 09 Apr 2015 20:07:33 +0300 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <3135495.s62GViskNO@hpdesktop> On Thursday 09 April 2015 17:46:04 mimicafe at gmail.com wrote: > Hi all > > I recently install Postfix and Dovecot, and so far so good. My assumption > was that calendar and address book (similar to Gmail calendar or address > book) are part of Dovecot. However I do not see anything concerning them in > any of the docs I have read so far. Check the kolab project. It's cyrus based but there are some attempt to use Dovecot instead, it works pretty well . > > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. You need client support for calendar /address book because is not standard. If not webmail, you need support in imap/activesync/webdav etc > > Thanks > > Mimi From Jochen.Bern at LINworks.de Thu Apr 9 17:07:54 2015 From: Jochen.Bern at LINworks.de (Jochen Bern) Date: Thu, 09 Apr 2015 19:07:54 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <5526B1EA.4010205@LINworks.de> On 04/09/2015 06:46 PM, mimicafe at gmail.com wrote: > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. The keyword you're looking for is "groupware" - which dovecot isn't. Now, what *protocols* do those pre-existing clients support to tie them to a groupware solution? MAPI? CalDAV? LDAP? (And I'm pretty sure I can't list even *half* of the contenders ...) Regards, J. Bern -- *NEU* - NEC IT-Infrastruktur-Produkte im : Server--Storage--Virtualisierung--Management SW--Passion for Performance Jochen Bern, Systemingenieur --- LINworks GmbH Postfach 100121, 64201 Darmstadt | Robert-Koch-Str. 9, 64331 Weiterstadt PGP (1024D/4096g) FP = D18B 41B1 16C0 11BA 7F8C DCF7 E1D5 FAF4 444E 1C27 Tel. +49 6151 9067-231, Zentr. -0, Fax -299 - Amtsg. Darmstadt HRB 85202 Unternehmenssitz Weiterstadt, Gesch?ftsf?hrer Metin Dogan, Oliver Michel From rs at sys4.de Thu Apr 9 17:24:39 2015 From: rs at sys4.de (Robert Schetterer) Date: Thu, 09 Apr 2015 19:24:39 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <5526B5D7.70002@sys4.de> Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: > Hi all > > I recently install Postfix and Dovecot, and so far so good. My assumption > was that calendar and address book (similar to Gmail calendar or address > book) are part of Dovecot. However I do not see anything concerning them in > any of the docs I have read so far. > > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. > > Thanks > > Mimi > cal/card dav may come in dovecot http://www.dovecot.org/talks/berlin-20140513.pptx.pdf ... Future: Random New Stuff CalDAV CardDAV Can?t fall behind Cyrus meanwhile you need another solution i.e horde webmail acts as cal/card dav ,active sync , syncml server http://en.wikipedia.org/wiki/CalDAV http://en.wikipedia.org/wiki/CardDAV http://en.wikipedia.org/wiki/ActiveSync http://en.wikipedia.org/wiki/SyncML Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From dominik at dominikbreu.de Thu Apr 9 17:34:06 2015 From: dominik at dominikbreu.de (Dominik Breu) Date: Thu, 09 Apr 2015 19:34:06 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <1428600846.26175.0.camel@dominikbreu.de> Hello, if you don't depend on a fancy webinterface give http://radicale.org/ a shot you can auth users aganst your imap server. greets Am Donnerstag, den 09.04.2015, 17:46 +0100 schrieb mimicafe at gmail.com: > Hi all > > I recently install Postfix and Dovecot, and so far so good. My assumption > was that calendar and address book (similar to Gmail calendar or address > book) are part of Dovecot. However I do not see anything concerning them in > any of the docs I have read so far. > > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. > > Thanks > > Mimi From list at airstreamcomm.net Thu Apr 9 18:17:17 2015 From: list at airstreamcomm.net (list at airstreamcomm.net) Date: Thu, 9 Apr 2015 13:17:17 -0500 Subject: Calendar and address book with Dovecot In-Reply-To: <1428600846.26175.0.camel@dominikbreu.de> References: <1428600846.26175.0.camel@dominikbreu.de> Message-ID: <0F9DB293-6C85-44D2-B0F6-26FED84175C8@airstreamcomm.net> We tried radicale, it didn't work at all as we found out the db support was completely broken. > On Apr 9, 2015, at 12:34 PM, Dominik Breu wrote: > > Hello, > > if you don't depend on a fancy webinterface give http://radicale.org/ a > shot you can auth users aganst your imap server. > > greets > > Am Donnerstag, den 09.04.2015, 17:46 +0100 schrieb mimicafe at gmail.com: >> Hi all >> >> I recently install Postfix and Dovecot, and so far so good. My assumption >> was that calendar and address book (similar to Gmail calendar or address >> book) are part of Dovecot. However I do not see anything concerning them in >> any of the docs I have read so far. >> >> What other software (ideally open source, free) do I need in other to have >> Calendar and address book so my users can manage their contact on their >> phones or computer? I have looked at Roundcube already, but my requirement >> is not necessarily to provide web mail. >> >> Thanks >> >> Mimi > From list at airstreamcomm.net Thu Apr 9 18:21:39 2015 From: list at airstreamcomm.net (list at airstreamcomm.net) Date: Thu, 9 Apr 2015 13:21:39 -0500 Subject: Calendar and address book with Dovecot In-Reply-To: <5526B5D7.70002@sys4.de> References: <5526B5D7.70002@sys4.de> Message-ID: On Apr 9, 2015, at 12:24 PM, Robert Schetterer wrote: > >> Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: >> Hi all >> >> I recently install Postfix and Dovecot, and so far so good. My assumption >> was that calendar and address book (similar to Gmail calendar or address >> book) are part of Dovecot. However I do not see anything concerning them in >> any of the docs I have read so far. >> >> What other software (ideally open source, free) do I need in other to have >> Calendar and address book so my users can manage their contact on their >> phones or computer? I have looked at Roundcube already, but my requirement >> is not necessarily to provide web mail. >> >> Thanks >> >> Mimi > > cal/card dav may come in dovecot > > > http://www.dovecot.org/talks/berlin-20140513.pptx.pdf > > ... > Future: > Random > New > Stuff > > CalDAV > CardDAV > > Can?t > fall > behind > Cyrus > > meanwhile you need another solution > i.e horde webmail acts as cal/card dav ,active sync , syncml server > > http://en.wikipedia.org/wiki/CalDAV > http://en.wikipedia.org/wiki/CardDAV > http://en.wikipedia.org/wiki/ActiveSync > http://en.wikipedia.org/wiki/SyncML > > > > Best Regards > MfG Robert Schetterer > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein > The notion that dovecot needs to stay just an IMAP server is ridiculous. I thoroughly encourage it to grow into a fully featured and open source messaging and groupware system. This is great news! From mihai at badici.ro Thu Apr 9 18:55:07 2015 From: mihai at badici.ro (Mihai Badici) Date: Thu, 09 Apr 2015 21:55:07 +0300 Subject: Calendar and address book with Dovecot In-Reply-To: <0F9DB293-6C85-44D2-B0F6-26FED84175C8@airstreamcomm.net> References: <1428600846.26175.0.camel@dominikbreu.de> <0F9DB293-6C85-44D2-B0F6-26FED84175C8@airstreamcomm.net> Message-ID: <68031445.hetPVL8LDG@hpdesktop> On Thursday 09 April 2015 13:17:17 list at airstreamcomm.net wrote: > We tried radicale, it didn't work at all as we found out the db support was > completely broken. I think is stupid to use two different storage, one for mails and the second for contact/calendar. That's why I choose kolab, who store all thing in IMAP folders. I think is The Right Way :) But is not easy, I must admit. The suport for metadata need some extensions ( I'm not sure it works for public folders) Kolab is a little bit too complex, it use 389 directory , php extensions etc. But with a little effort you can use the basic with dovecot. I tried to put together all thing here http://machinet.badici.ro/ but is rather a draft. I use this setup from some time and it works well, but if you want an click and go solution you need to go elswere. Mihai Badici[1] -------- [1] http://mihai.badici.ro From j.echter at echter-kuechen-elektro.de Thu Apr 9 20:44:41 2015 From: j.echter at echter-kuechen-elektro.de (J. Echter) Date: Thu, 09 Apr 2015 22:44:41 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <5526E4B9.6030907@echter-kuechen-elektro.de> Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: > Hi all > > I recently install Postfix and Dovecot, and so far so good. My assumption > was that calendar and address book (similar to Gmail calendar or address > book) are part of Dovecot. However I do not see anything concerning them in > any of the docs I have read so far. > > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. > > Thanks > > Mimi SOGo? www.sogo.nu From p at sys4.de Thu Apr 9 20:49:32 2015 From: p at sys4.de (Patrick Ben Koetter) Date: Thu, 9 Apr 2015 22:49:32 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <20150409204932.GF28431@sys4.de> * mimicafe at gmail.com : > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. What comes to mind: - Horde - SOGo - Kolab - Radicale - Modoboa (with management for Radicale) -- [*] sys4 AG https://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From bjlockie at lockie.ca Thu Apr 9 23:10:14 2015 From: bjlockie at lockie.ca (James) Date: Thu, 09 Apr 2015 19:10:14 -0400 Subject: imap doesn't like my passwd In-Reply-To: References: <5526018A.7030902@lockie.ca> Message-ID: <552706D6.7070605@lockie.ca> I took the " out of the password and it works. The other install worked with the " in the password. On 04/09/2015 02:40 AM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 9 Apr 2015, James wrote: > >> Both use PAM authentication on Linux. >> openssl s_client -connect localhost:993 >> a login test_user test_secure_password >> The response I got back was: >> a BAD Invalid characters in atom > > Does your password contain the " quote? If not, enclose the password > in "". Or try the literal form: > > 1 login user {##} > password > > where ## is the number of octets of password > >> The secure password used to work but it was a different architecture >> (x86_64 I think). >> The current architecture is armhf. > > architecture of the server or client? > Maybe you need to re-create the password store? > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVSYeynz1H7kL/d9rAQIsqwgAgVzzXjZj1hAO22hoamDM0mPJovqnNlIF > YQ9/pR421GOca8YOebh9YHqqMbxuj8DFADS06EAdcKQdyONKd0CsxtHsjqIrV/FB > uxEMY/MFdTto9ToMjj33YtQFz0MjACvrqO/hzepgCK3Pgt3HK0UHyN36qYmwnpNs > Vzbm/YYb+4xnciYq2sLlAKvrvIn+LQT25OP7toGiXnOkGQSTbwxRtysmLe+f3Cvv > XlnYTZsKTIuwAJNcDphKpd0LSts5k6Fua4pw1LtxP42W63xE5iq3KTqGdi4u6nQS > jVRdKwAKVjihbbLFN1K1nlVyEEQP2dpEk4B+smRwGQTaxRrDFlki8A== > =L7CD > -----END PGP SIGNATURE----- > From pch at myzel.net Fri Apr 10 00:01:02 2015 From: pch at myzel.net (Peter Chiochetti) Date: Fri, 10 Apr 2015 02:01:02 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <552712BE.600@myzel.net> Am 2015-04-09 um 18:46 schrieb mimicafe at gmail.com: > > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I use davical quite painless for calendaring http://www.davical.org/ with Thunderbird and Android app. Addresses synced to Thunderbird with sogo connector (not 100% deterministic). It is completely separate from dovecot. I do not see why dovecot should do caldav or carddav. -- peter From gedalya at gedalya.net Fri Apr 10 00:41:45 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 09 Apr 2015 20:41:45 -0400 Subject: sa-learn with remote Dovecot folders In-Reply-To: <55269CD6.6090303@cs.ucy.ac.cy> References: <551E67DD.70107@cs.ucy.ac.cy> <551E9530.7080809@gedalya.net> <55269CD6.6090303@cs.ucy.ac.cy> Message-ID: <55271C49.5030405@gedalya.net> On 04/09/2015 11:37 AM, Andreas Kasenides wrote: > You got me thinking towards the antispam plugin which I have nto used > before, but can you elaborate if my users are system users and the > training is done only via a cron entry? I always used the antispam plugin, as a way to initiate training via IMAP. Is your bayes database central (system-wide) or per user? Is it SQL or separate db files owned per user? Without antispam plugin, your cron command can be perhaps something like this (as root) doveadm user '*' | while read user; do doveadm search -u $user mailbox Junk all | while read guid uid; do doveadm -f flow fetch -u $user text mailbox-guid $guid uid $uid | sed s/^text=// | ssh -i /path/to/ssh-key root@$spamassassin-box "su -l -c 'spamassassin --report' $user" # expunge, so we don't repeat it if no other reason doveadm expunge -u $user mailbox-guid $guid uid $uid done done remember to do this before: ssh-keyscan $spamassassin-box >> /etc/ssh/ssh_known_hosts to allow non-interactive ssh connections. You can improve security by setting up a special user instead of root, allowing it to become other users with no password using sudo with only the needed command(s) allowed, and use a: command="/usr/local/bin/training-wrapper" prefixed to the ssh public key in the authorized_keys file. /usr/local/bin/training-wrapper: #!/bin/sh case "$SSH_ORIGINAL_COMMAND" in report) sa-learn --spam ;; revoke) sa-learn --ham ;; *) echo "Wwwwhat?" ;; esac and invoke this as ssh $user@$sa-box report or: ssh $user@$sa-box revoke It is very important to allow for ham training, not only spam training. The antispam plugin allows for that. If your bayes database is SQL, you can use sa-learn -u $user --ham / sa-learn -u $user --spam, instead of su / sudo. I however like spamassassin --report for reporting to dcc / razor / pyzor (--revoke exists but doesn't really do anything beyond bayes ;-)). This command doesn't have a -u flag so I guess su / sudo is necessary. If you configure the antispam plugin to ssh into another box and run a learning process, the IMAP command won't complete until the ssh command returns. I personally like to drop off the email messages to be picked up asynchronously by another process, for better IMAP responsiveness. Fill out the few missing details about your spamassassin / bayes setup and I can gladly give you more specific details on how to set this up. From tss at iki.fi Fri Apr 10 01:21:32 2015 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Apr 2015 10:21:32 +0900 Subject: pop3 retr responses too large lines - Fails with current python's poplib In-Reply-To: <1428529977.20288.15.camel@catamarca.fierro-soft.com.ar> References: <1428529977.20288.15.camel@catamarca.fierro-soft.com.ar> Message-ID: On 09 Apr 2015, at 06:52, Guillermo M. Narvaja wrote: > > Since December 2014, clients using the Python poplib library (getmail in > my case) started to limit the line length of RETR and other command > responses sent from the server to 2048 bytes: > > See https://bugs.python.org/issue16041 (Included at least in > Python-2.7.9) > > Dovecot doesn't have line split in the POP3 module, so Python fails to > retrieve messages with long lines. > > RFC 1939 says: > " > Responses in the POP3 consist of a status indicator and a keyword > possibly followed by additional information. All responses are > terminated by a CRLF pair. Responses may be up to 512 characters > long, including the terminating CRLF. > " > > I think dovecot-pop3 should split it's output in lines of at least 512 > characters. Or at least it should have a "pop3_max_line_length" setting > (like "imap_max_line_length"). Um. This is talking about POP3 responses themselves - not about the actual email message body. Dovecot's POP3 reponses are short always I think. The message body is sent exactly as it was originally saved. Changing this could break things like PGP/SMIME signing and so on. From tss at iki.fi Fri Apr 10 01:28:10 2015 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Apr 2015 10:28:10 +0900 Subject: gmail-migration: archived mails in \ALL In-Reply-To: <5526893C.7020208@heinlein-support.de> References: <5526893C.7020208@heinlein-support.de> Message-ID: <6C91B453-C87C-45C0-96C6-8F843CFB1EDD@iki.fi> On 09 Apr 2015, at 23:14, Peer Heinlein wrote: > > > Hi, > > I don't completly understand > > http://wiki2.dovecot.org/Migration/Gmail > > I can't find the documentation for the -a and the -F Flag. > > I'd like to migrate ONLY archived mails from an existing gmail-Account. > So I'd have to import all Mails from the \ALL-Folder that does NOT have > any virtual folder flags set. > > I tried to use this command: > > doveadm -D -o imapc_user=user at example.com -o pop3c_user=user at exampe.com > -o imapc_password=secret -o pop3c_password=secret -o > imapc_host=imap.googlemail.com -v backup -m '[Gmail]/Tutti i messaggi' > -F '-$GmailHaveLabels' -x \Flagged -x \Junk -x \Trash -x \Important -R > -u user at example.com imapc: > > > But it looks like it's importing too many mails and not only the > archived mails without Flags. > > How do I have do understand > > -F '-$GmailHaveLabels ?? > > Is it "that NOT have $GmailHaveLabels"? Yes. I think the part you're missing is having imapc_features=gmail-migration setting which actually sets that flag. > And: Is there any better way to address the \ALL-Folder? I can use "-x > \All" to exclude that folder, but it looks like I can't use "-m \All" to > select that folder. I think \All should work for both -m and -x in v2.2.16.. From gedalya at gedalya.net Fri Apr 10 01:49:51 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 09 Apr 2015 21:49:51 -0400 Subject: sa-learn with remote Dovecot folders In-Reply-To: <55271C49.5030405@gedalya.net> References: <551E67DD.70107@cs.ucy.ac.cy> <551E9530.7080809@gedalya.net> <55269CD6.6090303@cs.ucy.ac.cy> <55271C49.5030405@gedalya.net> Message-ID: <55272C3F.40702@gedalya.net> On 04/09/2015 08:41 PM, Gedalya wrote: > doveadm user '*' | while read user; do > doveadm search -u $user mailbox Junk all | while read guid uid; do > doveadm -f flow fetch -u $user text mailbox-guid $guid uid > $uid | sed s/^text=// | ssh -i /path/to/ssh-key root@$spamassassin-box > "su -l -c 'spamassassin --report' $user" > # expunge, so we don't repeat it if no other reason > doveadm expunge -u $user mailbox-guid $guid uid $uid > done > done Oh, actually `doveadm search -A mailbox Junk all` returns 3 columns - username, mailbox-guid, uid, so you don't need a separate command in the outer loop iterating over usernames :P .. From idefix at fechner.net Fri Apr 10 06:03:42 2015 From: idefix at fechner.net (Matthias Fechner) Date: Fri, 10 Apr 2015 08:03:42 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <552767BE.6080607@fechner.net> Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. check in addition to dovecot owncloud.org. Both in combination with roundcube is working fine. Gru? Matthias -- "Programming today is a race between software engineers striving to build bigger and better idiot-proof programs, and the universe trying to produce bigger and better idiots. So far, the universe is winning." -- Rich Cook From skdovecot at smail.inf.fh-brs.de Fri Apr 10 06:14:25 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 10 Apr 2015 08:14:25 +0200 (CEST) Subject: imap doesn't like my passwd In-Reply-To: <552706D6.7070605@lockie.ca> References: <5526018A.7030902@lockie.ca> <552706D6.7070605@lockie.ca> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 9 Apr 2015, James wrote: > I took the " out of the password and it works. > The other install worked with the " in the password. pass"word is no atom and Dovecot should reject it. Maybe the former version did not checked the atoms 100% RFC conform. You can always use a litral to pass these words. > > On 04/09/2015 02:40 AM, Steffen Kaiser wrote: >> On Thu, 9 Apr 2015, James wrote: >> >>> Both use PAM authentication on Linux. >>> openssl s_client -connect localhost:993 >>> a login test_user test_secure_password >>> The response I got back was: >>> a BAD Invalid characters in atom >> >> Does your password contain the " quote? If not, enclose the password in "". >> Or try the literal form: >> >> 1 login user {##} >> password >> >> where ## is the number of octets of password >> >>> The secure password used to work but it was a different architecture >>> (x86_64 I think). >>> The current architecture is armhf. >> >> architecture of the server or client? >> Maybe you need to re-create the password store? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSdqQXz1H7kL/d9rAQI//ggAyAADFM6ct/cBiE6uebHIfFFWtP4yi3GW ghG+6w58yNguekrBYl7D5K8tGLVHwCMsLagJ0OWU30H8LiEY8w4uV33B8lit3XFD RL6RPCPW8imEgKx2cPI4JLPFimRuTZN/tsHB6ej4QsAJSJ6KiyNx6o9XYYfR6oQ6 JARROQ7v266wBPx1U6HnVfbZPpM32I5fUE4FKd88JkfBODYrZNlSULqWEh9XVnWX 1ZdUmb3gi+5zCZpXMZT49EMpLGwArHrLtJyf24KPMUATtQoZ1n8GyJJ3zajSZL0F eceQ4c/5gza4dQJVwpHozkR2fSrwFR8iCgCcD43qQBQvX/fc9g64fg== =yYqF -----END PGP SIGNATURE----- From jean-francois.senechal at ac.marche.be Fri Apr 10 09:20:46 2015 From: jean-francois.senechal at ac.marche.be (=?UTF-8?B?SmVhbi1GcmFuw6dvaXMgU8OpbsOpY2hhbA==?=) Date: Fri, 10 Apr 2015 11:20:46 +0200 Subject: Calendar and address book with Dovecot In-Reply-To: <552767BE.6080607@fechner.net> References: <552767BE.6080607@fechner.net> Message-ID: <552795EE.5020804@ac.marche.be> sogo works fine otherwise there was open xchange ^ - ^ Le 10/04/2015 08:03, Matthias Fechner a ?crit : > Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: >> What other software (ideally open source, free) do I need in other to have >> Calendar and address book so my users can manage their contact on their >> phones or computer? I have looked at Roundcube already, but my requirement >> is not necessarily to provide web mail. > check in addition to dovecot owncloud.org. Both in combination with > roundcube is working fine. > > > Gru? > Matthias > From giedrius at liubavicius.lt Fri Apr 10 09:39:29 2015 From: giedrius at liubavicius.lt (=?UTF-8?B?R2llZHJpdXMgTGl1YmF2acSNaXVz?=) Date: Fri, 10 Apr 2015 12:39:29 +0300 Subject: Calendar and address book with Dovecot In-Reply-To: <552767BE.6080607@fechner.net> References: <552767BE.6080607@fechner.net> Message-ID: <55279A51.9000208@liubavicius.lt> 2015.04.10 09:03, Matthias Fechner ra??: > Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: >> What other software (ideally open source, free) do I need in other to have >> Calendar and address book so my users can manage their contact on their >> phones or computer? I have looked at Roundcube already, but my requirement >> is not necessarily to provide web mail. > check in addition to dovecot owncloud.org. Both in combination with > roundcube is working fine. Correction. It is working fine up to the point when you want to use AD...... and by using AD, I mean: you either use AD logins, or ownCloud (probably email based) ones...... (nobody wants to use separate accounts: {AD} one for data sharing and {email based} other for cal / addr book) But this implies a problem with constantly changing passwords {for CalDav / CardDav} on mobile devices / email clients etc.... (dovecot's own IMAP CalDav / CardDav support because of this mess would be SUPER) [OT] if anyone is interested I have dirty, but quite good SSO login addon + patch for ownCloud's seamless auhentication with AD, *if* any computer is connected to the AD {user has Kerberos ticket} > > > Gru? > Matthias > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From jeroen at massar.ch Fri Apr 10 09:59:05 2015 From: jeroen at massar.ch (Jeroen Massar) Date: Fri, 10 Apr 2015 11:59:05 +0200 Subject: Disabling of userdb/passdb modules using config statements Message-ID: <55279EE9.9060501@massar.ch> Hola, Debian (and possibly other distros) use the /etc/dovecot/conf.d/* setup where default config files are stuffed and then one can just add a 99-myconfig.conf et voila, variables are overruled. This allows the distro to supply updates to the files at package upgrade time without any/much user intervention. The problem (for me ;) is that the system comes provided with: auth-system.conf.ext containing: passdb { driver = pam } userdb { driver = passwd } Hence pam & /etc/passwd based are always enabled. This while I don't have any local users. Replication seems to then always pick up the local users, which are vmail + nobody (65536). doveadm user '*' thus reports vmail, nobody + virtual users Setting: first_valid_uid = 5000 last_valid_uid = 5000 only keeps vmail in there, but apparently some module (guess replication) is still able to figure out that 'nobody' exists: Apr 10 09:48:25 mail dovecot: doveadm(IPADDR,nobody): Error: Mail access for users with UID 65534 not permitted (see first_valid_uid in config file, uid from userdb lookup). Apr 10 09:48:25 mail dovecot: doveadm(IPADDR,nobody): Error: dsync-server: User init failed Apr 10 09:49:38 mail dovecot: doveadm(nobody): Error: sync: Failed to start remote dsync-server command: Remote exit_code=75 and on the other side: Apr 10 09:54:38 mail dovecot: doveadm(nobody): Error: sync: Unknown user in remote This can be resolved by commenting out the entries in auth-system.conf.ext but then I'll have to do that again at package upgrade time. Hence, would it be a cool option to be able (in the 99-myconfig.conf) file to put: passdb { driver = pam enabled = false } userdb { driver = passwd enabled = false } And thereby disabling those modules completely? Thus avoiding upgrade conflicts etc. Greets, Jeroen From jeroen at massar.ch Fri Apr 10 10:05:50 2015 From: jeroen at massar.ch (Jeroen Massar) Date: Fri, 10 Apr 2015 12:05:50 +0200 Subject: FYI: Some 'fun' unlinks with random memory space references Message-ID: <5527A07E.8010708@massar.ch> Hola, Dovecot: 2.2.16 (6bde7868cffd) That is the rename-it 2:2.2.16-1~auto+43 edition. In the beginning of syncing it caused scary things like: Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10672) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(ox/mailboxes/INBOX/dbox-Mails/u.10927) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10839) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10656) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(11147) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10637) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10807) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(<80>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink() failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink() failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(#020) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(@) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(p) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink() failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(?) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink() failed: No such file or directory Might want to put a check before that unlink that nothing dirty is in the buffer... I would not be surprised if this was related to a broken index, as the other side effect I saw during this sync was an ever-expanding maildir (read: sdbox), multiplying itself during sync, keeping large amounts of the the .temp. in the dir, never moving them to a final directory. That was resolved by stopping dovecot, then deleting the broken sdbox (backups++) and performing a 'dovecot force-resync -u user Folder' on the source. Maybe there was a race somewhere while syncing the large amount of data over; seems that everything is okay now though. Greets, Jeroen From gedalya at gedalya.net Fri Apr 10 10:16:55 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 10 Apr 2015 06:16:55 -0400 Subject: Disabling of userdb/passdb modules using config statements In-Reply-To: <55279EE9.9060501@massar.ch> References: <55279EE9.9060501@massar.ch> Message-ID: <5527A317.6060906@gedalya.net> On 04/10/2015 05:59 AM, Jeroen Massar wrote: > > This can be resolved by commenting out the entries in > auth-system.conf.ext but then I'll have to do that again at package > upgrade time. Comment out the !include auth-system.conf.ext line in 10-auth.conf. > > Hence, would it be a cool option to be able (in the 99-myconfig.conf) > file to put: Actually you mean local.conf. See the master dovecont.conf file, it's included last. > > passdb { > driver = pam > enabled = false > } > userdb { > driver = passwd > enabled = false > } > > And thereby disabling those modules completely? Thus avoiding upgrade > conflicts etc. That's an interesting idea actually. My first thought is that it could be helpful to use *named* passdb / userdb sections to facilitate this. > > Greets, > Jeroen From jeroen at massar.ch Fri Apr 10 10:27:12 2015 From: jeroen at massar.ch (Jeroen Massar) Date: Fri, 10 Apr 2015 12:27:12 +0200 Subject: Disabling of userdb/passdb modules using config statements In-Reply-To: <5527A317.6060906@gedalya.net> References: <55279EE9.9060501@massar.ch> <5527A317.6060906@gedalya.net> Message-ID: <5527A580.9050405@massar.ch> On 2015-04-10 12:16, Gedalya wrote: > On 04/10/2015 05:59 AM, Jeroen Massar wrote: >> >> This can be resolved by commenting out the entries in >> auth-system.conf.ext but then I'll have to do that again at package >> upgrade time. > > Comment out the !include auth-system.conf.ext line in 10-auth.conf. Though indeed simpler than commenting out multiple lines, that file also gets replaced by a package upgrade. Hence does not solve the 'can just upgrade silently' issue. >> Hence, would it be a cool option to be able (in the 99-myconfig.conf) >> file to put: > Actually you mean local.conf. See the master dovecont.conf file, it's > included last. Only when it exists, one can use both. from dovecot.conf: 8<------------- # Most of the actual configuration gets included below. The filenames are # first sorted by their ASCII value and parsed in that order. The 00-prefixes # in filenames are intended to make it easier to understand the ordering. !include conf.d/*.conf # A config file can also tried to be included without giving an error if # it's not found: !include_try local.conf --------------------------->8 Both conf.d/99-myconfig.conf and local.conf can work for this. I prefer 99- as that is what other daemons also use. >> >> passdb { >> driver = pam >> enabled = false >> } >> userdb { >> driver = passwd >> enabled = false >> } >> >> And thereby disabling those modules completely? Thus avoiding upgrade >> conflicts etc. > That's an interesting idea actually. My first thought is that it could > be helpful to use *named* passdb / userdb sections to facilitate this. That would require a default system, which now works out of the box with pam/etc to be properly named and then renamed... Greets, Jeroen From 24x7server at 24x7server.net Fri Apr 10 11:53:04 2015 From: 24x7server at 24x7server.net (Rajesh M) Date: Fri, 10 Apr 2015 17:23:04 +0530 Subject: dovecot debug message help required Message-ID: hi i was carrying out some testing using qmailtoaster with dovecot on a centos 64 server i am connecting to the mailbox using a windows machine with outlook across the lan. the mailbox is around 7gb in size with around 12000 emails spread across multiple folders and i am trying to sync the mailbox folders to by creating an account imap account in outlook. the mails are getting downloaded in the imap folder but the sync does not complete and outlook throws an error. Task 'Synchronizing subscribed folders for user at mydomain.com.' reported error (0x800CCC0F) : 'Outlook cannot synchronize subscribed folders for user at mydomain.com.. Error: The TCP/IP connection was unexpectedly terminated by the server. If you continue to receive this message, contact your server administrator or Internet service provider (ISP).' in the dovecot log i see the following. Apr 10 17:12:10 imap(user at mydomain.com): Debug: Effective uid=89, gid=89, home=/home/vpopmail/domains/mydomain.com/user Apr 10 17:12:10 imap(user at mydomain.com): Debug: Quota root: name=ignore=Trash backend=maildir args= Apr 10 17:12:10 imap(user at mydomain.com): Debug: Quota rule: root=ignore=Trash mailbox=? bytes=0 messages=0 Apr 10 17:12:10 imap(user at mydomain.com): Debug: Quota grace: root=ignore=Trash bytes=0 (10%) Apr 10 17:12:10 imap(user at mydomain.com): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location= Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: access(/home/vpopmail/domains/mydomain.com/user/mdbox, rwx): failed: No such file or directory Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: couldn't find root dir Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: access(/home/vpopmail/domains/mydomain.com/user/sdbox, rwx): failed: No such file or directory Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: couldn't find root dir Apr 10 17:12:10 imap(user at mydomain.com): Debug: maildir: root exists (/home/vpopmail/domains/mydomain.com/user/Maildir) Apr 10 17:12:10 imap(user at mydomain.com): Debug: maildir++: root=/home/vpopmail/domains/mydomain.com/user/Maildir, index=, indexpvt=, control=, inbox=/home/vpopmail/domains/mydomain.com/user/Maildir, alt= Apr 10 17:12:40 imap(user at mydomain.com): Info: Disconnected: Logged out in=28 out=460 i would like to know what the following means -- specifically mdbox and sdbox #################### Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: access(/home/vpopmail/domains/mydomain.com/user/mdbox, rwx): failed: No such file or directory Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: couldn't find root dir Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: access(/home/vpopmail/domains/mydomain.com/user/sdbox, rwx): failed: No such file or directory Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: couldn't find root dir #################### my dovecot config file # dovecot -n # 2.2.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_cache_size = 32 M auth_mechanisms = plain login digest-md5 cram-md5 default_login_user = vpopmail disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 log_path = /var/log/dovecot.log login_greeting = Dovecot toaster ready. mail_debug = yes mail_max_userip_connections = 50 mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } protocols = imap pop3 service imap-login { client_limit = 1000 process_limit = 400 process_min_avail = 4 service_count = 0 vsz_limit = 512 M } service pop3-login { client_limit = 1000 process_limit = 400 process_min_avail = 12 service_count = 0 vsz_limit = 512 M } ssl_cert = References: <55279EE9.9060501@massar.ch> <5527A317.6060906@gedalya.net> <5527A580.9050405@massar.ch> Message-ID: <20150410122320.Horde.H5HsY32KRTFGhpHw74syhA7@mail.kalinowski.com.br> On Sex, 10 Abr 2015, Jeroen Massar wrote: > Though indeed simpler than commenting out multiple lines, that file also > gets replaced by a package upgrade. > > Hence does not solve the 'can just upgrade silently' issue. If the file is unchanged then, yes, it gets replaced on upgrades. If it has local changes, however, you'll get a prompt asking what you want to do (keep your changes or use the package version). So while it fails you "upgrade silently" requirement, you'll not automatically loose the changes you've made. -- Eduardo M KALINOWSKI eduardo at kalinowski.com.br From jeroen at massar.ch Fri Apr 10 12:28:31 2015 From: jeroen at massar.ch (Jeroen Massar) Date: Fri, 10 Apr 2015 14:28:31 +0200 Subject: Disabling of userdb/passdb modules using config statements In-Reply-To: <20150410122320.Horde.H5HsY32KRTFGhpHw74syhA7@mail.kalinowski.com.br> References: <55279EE9.9060501@massar.ch> <5527A317.6060906@gedalya.net> <5527A580.9050405@massar.ch> <20150410122320.Horde.H5HsY32KRTFGhpHw74syhA7@mail.kalinowski.com.br> Message-ID: <5527C1EF.1050507@massar.ch> On 2015-04-10 14:23, Eduardo M KALINOWSKI wrote: > On Sex, 10 Abr 2015, Jeroen Massar wrote: >> Though indeed simpler than commenting out multiple lines, that file also >> gets replaced by a package upgrade. >> >> Hence does not solve the 'can just upgrade silently' issue. > > If the file is unchanged then, yes, it gets replaced on upgrades. If it > has local changes, however, you'll get a prompt asking what you want to > do (keep your changes or use the package version). So while it fails you > "upgrade silently" requirement, you'll not automatically loose the > changes you've made. That is correct, though as I don't want to ever be asked about such things, I am looking for a nicer solution and suggested the 'enabled = false' option for these kind of situations. One does not want to manually approve such changes on every box one runs, can be quite a few of them ;) Greets, Jeroen From gedalya at gedalya.net Fri Apr 10 12:30:49 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 10 Apr 2015 08:30:49 -0400 Subject: Disabling of userdb/passdb modules using config statements In-Reply-To: <20150410122320.Horde.H5HsY32KRTFGhpHw74syhA7@mail.kalinowski.com.br> References: <55279EE9.9060501@massar.ch> <5527A317.6060906@gedalya.net> <5527A580.9050405@massar.ch> <20150410122320.Horde.H5HsY32KRTFGhpHw74syhA7@mail.kalinowski.com.br> Message-ID: <5527C279.1000109@gedalya.net> On 04/10/2015 08:23 AM, Eduardo M KALINOWSKI wrote: > On Sex, 10 Abr 2015, Jeroen Massar wrote: >> Though indeed simpler than commenting out multiple lines, that file also >> gets replaced by a package upgrade. >> >> Hence does not solve the 'can just upgrade silently' issue. > > If the file is unchanged then, yes, it gets replaced on upgrades. If > it has local changes, however, you'll get a prompt asking what you > want to do (keep your changes or use the package version). So while it > fails you "upgrade silently" requirement, you'll not automatically > loose the changes you've made. Actually, a config file in Debian is replaced if it has _not_ been changed locally, and it _has_ been changed upstream. If it has been changed on both sides, you get prompted. If the new package is just a security update, which in most cases means changes to the binaries and not to the default config, then it will just install without prompts, and not touch your config files. If it's an entirely new version, then the desire to just upgrade silently is sort of inappropriate anyway - you will need some preparation. From gedalya at gedalya.net Fri Apr 10 12:39:41 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 10 Apr 2015 08:39:41 -0400 Subject: Disabling of userdb/passdb modules using config statements In-Reply-To: <5527C1EF.1050507@massar.ch> References: <55279EE9.9060501@massar.ch> <5527A317.6060906@gedalya.net> <5527A580.9050405@massar.ch> <20150410122320.Horde.H5HsY32KRTFGhpHw74syhA7@mail.kalinowski.com.br> <5527C1EF.1050507@massar.ch> Message-ID: <5527C48D.6060606@gedalya.net> On 04/10/2015 08:28 AM, Jeroen Massar wrote: > That is correct, though as I don't want to ever be asked about such > things, I am looking for a nicer solution and suggested the 'enabled = > false' option for these kind of situations. If you have many boxes then I'll assume you have already tested your upgrade path and you have some solid reasons to assume the new version will upgrade smoothly and you have already done the necessary preparations, and you're only missing the information about how to manage these prompts. http://raphaelhertzog.com/2010/09/21/debian-conffile-configuration-file-managed-by-dpkg/ Once again, a config file only needs to be replaced if it has actually changed upstream, and most of the changes upstream are commented out because 90% of dovecot config files is commented out, either actual comments or commented-out settings that serve only to document the defaults. If upgrading from e.g. 2.2.15 to 2.2.16, chances are you can totally skip all config file changes. If upgrading from 2.1, you have bigger problems than this. Keep things in perspective :-) From alex2grad at gmail.com Thu Apr 9 21:44:34 2015 From: alex2grad at gmail.com (Alexei Gradinari) Date: Thu, 9 Apr 2015 17:44:34 -0400 Subject: Trash Plugin bugs Message-ID: <1137483717.20150409174434@gmail.com> dovecot v2.2.16 I've found a few bugs in Trash plugin. 1. If Quota set only messages limit (without storage limit) then Trash plugin does not expunge any message because Quota plugin sets too_large_r=TRUE. It's because quota_default_test_alloc function does not check if bytes_limit is set. /* if size is bigger than any limit, then it is bigger than the lowest limit */ - if (size > bytes_limit) { + if (bytes_limit > 0 && size > bytes_limit) { *too_large_r = TRUE; break; } 2. Trash plugin does not use bytes_ceil/count_ceil to calculate size_needed/count_needed to expunge. Trash plugin may expunge more messages that nedeed. + if (ctx->bytes_ceil!=(uint64_t)-1 && ctx->bytes_ceil < size + ctx->bytes_over) { + size_needed = size + ctx->bytes_over - ctx->bytes_ceil; + } + if (ctx->count_ceil!=(uint64_t)-1 && ctx->count_ceil < 1 + ctx->count_over) { + count_needed = 1 + ctx->count_over - ctx->count_ceil; + } + /* not enough space. try deleting some from mailbox. */ - ret = trash_try_clean_mails(ctx, size + ctx->bytes_over, - 1 + ctx->count_over); + ret = trash_try_clean_mails(ctx, size_needed, count_needed); 3. Trash plugin does not check 'unlimited' values in bytes_ceil/count_ceil and may overflow them when add expunged size/messages - ctx->bytes_ceil += size_expunged; - ctx->count_ceil += expunged_count; + if (ctx->bytes_ceil!=(uint64_t)-1) { + ctx->bytes_ceil += size_expunged; + } + if (ctx->count_ceil!=(uint64_t)-1) { + ctx->count_ceil += expunged_count; + } See attached patch. -------------- next part -------------- A non-text attachment was scrubbed... Name: trash-plugin.patch Type: application/octet-stream Size: 1931 bytes Desc: not available URL: From mimicafe at gmail.com Fri Apr 10 13:44:03 2015 From: mimicafe at gmail.com (mimicafe at gmail.com) Date: Fri, 10 Apr 2015 14:44:03 +0100 Subject: Calendar and address book with Dovecot In-Reply-To: <5526B1EA.4010205@LINworks.de> References: <5526B1EA.4010205@LINworks.de> Message-ID: Firstly I need to look at various available options to determine which way to go. However, our clients including Windows machine, Mac, Android and iOS. To the best of my knowledge, all the clients support the various protocols except LDAP which may not be supported on mobile devices. A quick search for suggested "groupware" showed a number of implementation I could look at. Thanks Mimi On 9 April 2015 at 18:07, Jochen Bern wrote: > On 04/09/2015 06:46 PM, mimicafe at gmail.com wrote: > > What other software (ideally open source, free) do I need in other to > have > > Calendar and address book so my users can manage their contact on their > > phones or computer? I have looked at Roundcube already, but my > requirement > > is not necessarily to provide web mail. > > The keyword you're looking for is "groupware" - which dovecot isn't. > > Now, what *protocols* do those pre-existing clients support to tie them > to a groupware solution? MAPI? CalDAV? LDAP? (And I'm pretty sure I > can't list even *half* of the contenders ...) > > Regards, > J. Bern > -- > *NEU* - NEC IT-Infrastruktur-Produkte im : > Server--Storage--Virtualisierung--Management SW--Passion for Performance > Jochen Bern, Systemingenieur --- LINworks GmbH > Postfach 100121, 64201 Darmstadt | Robert-Koch-Str. 9, 64331 Weiterstadt > PGP (1024D/4096g) FP = D18B 41B1 16C0 11BA 7F8C DCF7 E1D5 FAF4 444E 1C27 > Tel. +49 6151 9067-231, Zentr. -0, Fax -299 - Amtsg. Darmstadt HRB 85202 > Unternehmenssitz Weiterstadt, Gesch?ftsf?hrer Metin Dogan, Oliver Michel > From matthias at familie-sitte.org Fri Apr 10 13:50:46 2015 From: matthias at familie-sitte.org (Matthias Sitte) Date: Fri, 10 Apr 2015 08:50:46 -0500 Subject: Calendar and address book with Dovecot In-Reply-To: References: Message-ID: <5527D536.9050505@familie-sitte.org> > What other software (ideally open source, free) do I need in other to have > Calendar and address book so my users can manage their contact on their > phones or computer? I have looked at Roundcube already, but my requirement > is not necessarily to provide web mail. sabre/dav [1] is a PHP-based CalDAV/CardDAV server and easy to set up; docs are really good with examples. Took me less than 30 min to set it up and get it working with multiple Thunderbird/Icedove instances (you have to use SoGO connector) and multiple iPhones. If needed, you can integrate many backends and frontends like Roundcube as well. Matthias [1] http://sabre.io/ From sami.ketola at dovecot.fi Fri Apr 10 14:27:44 2015 From: sami.ketola at dovecot.fi (Sami Ketola) Date: Fri, 10 Apr 2015 17:27:44 +0300 Subject: dovecot-2.2.16 compilation problems under Solaris Studio 11 In-Reply-To: <55255691.2060409@xdrv.co.uk> References: <20150408162449.Horde.JVFLyGh86N7lbldXeYJmwA1@horde5.hrz.uni-giessen.de> <55255691.2060409@xdrv.co.uk> Message-ID: <26A2856C-679D-4A59-85A1-E7E865E348FE@dovecot.fi> > On 08 Apr 2015, at 19:25, James wrote: > > On 08/04/2015 15:24, J?rgen Obermann wrote: > > Hello J?rgen, > >> here are two problems I get when I compile dovecot 2.2.16 under Solaris >> 10 with Studio 11 Compiler: > > Is there a reason to use a 10 year old compiler? Try 12.4: > > http://www.oracle.com/technetwork/server-storage/solarisstudio/downloads/index-jsp-141149.html > > I am using Solaris 10 and dovecot compiled with SS12.4. I?m using Solaris 11 and SS 12.4, but I can still replicate the issue. It?s seems not to be compiler version or operating system version tied. Dovecot does compile but I can see the error during the compile. Sami From guillermo.narvaja at fierro.com.ar Fri Apr 10 14:51:04 2015 From: guillermo.narvaja at fierro.com.ar (Guillermo M. Narvaja) Date: Fri, 10 Apr 2015 11:51:04 -0300 Subject: pop3 retr responses too large lines - Fails with current python's poplib In-Reply-To: References: <1428529977.20288.15.camel@catamarca.fierro-soft.com.ar> Message-ID: <1428677464.30175.8.camel@catamarca.fierro-soft.com.ar> El vie, 10-04-2015 a las 10:21 +0900, Timo Sirainen escribi?: > On 09 Apr 2015, at 06:52, Guillermo M. Narvaja wrote: > > > > Since December 2014, clients using the Python poplib library (getmail in > > my case) started to limit the line length of RETR and other command > > responses sent from the server to 2048 bytes: > > > > See https://bugs.python.org/issue16041 (Included at least in > > Python-2.7.9) > > > > Dovecot doesn't have line split in the POP3 module, so Python fails to > > retrieve messages with long lines. > > > > RFC 1939 says: > > " > > Responses in the POP3 consist of a status indicator and a keyword > > possibly followed by additional information. All responses are > > terminated by a CRLF pair. Responses may be up to 512 characters > > long, including the terminating CRLF. > > " > > > > I think dovecot-pop3 should split it's output in lines of at least 512 > > characters. Or at least it should have a "pop3_max_line_length" setting > > (like "imap_max_line_length"). > > Um. This is talking about POP3 responses themselves - not about the > actual email message body. Dovecot's POP3 reponses are short always I > think. The message body is sent exactly as it was originally saved. > Changing this could break things like PGP/SMIME signing and so on. So there is no way to break the lines without breaking the message? Please note that if you are right, I should post a bug on the Python project. You can see in this "traceforward" that Python's poplib will throw an error_proto exception if RETR returns lines longer than 2048 bytes: https://hg.python.org/cpython/file/0db36098b908/Lib/poplib.py#l227 https://hg.python.org/cpython/file/0db36098b908/Lib/poplib.py#l165 https://hg.python.org/cpython/file/0db36098b908/Lib/poplib.py#l142 https://hg.python.org/cpython/file/0db36098b908/Lib/poplib.py#l370 def _getline(self): line = "" renewline = re.compile(r'.*?\n') match = renewline.match(self.buffer) while not match: self._fillBuffer() >>> if len(self.buffer) > _MAXLINE: # _MAXLINE=2048 >>> raise error_proto('line too long') match = renewline.match(self.buffer) line = match.group(0) ... -- Guillermo M. Narvaja Lambda Sistemas S.R.L. www.fierro-soft.com.ar - radiocut.fm Tel: (5411) 3220-1520 (rotativas) y 4857-6662 Cel: (5411) 15-6783-4435 Email: guillermo.narvaja at fierro-soft.com.ar MSN: guillermo_narvaja at hotmail.com Skype: guillermonarvaja Lavalleja 519 1er Piso - Ciudad de Buenos Aires - Argentina From tss at iki.fi Fri Apr 10 14:59:25 2015 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Apr 2015 17:59:25 +0300 Subject: pop3 retr responses too large lines - Fails with current python's poplib In-Reply-To: <1428677464.30175.8.camel@catamarca.fierro-soft.com.ar> References: <1428529977.20288.15.camel@catamarca.fierro-soft.com.ar> <1428677464.30175.8.camel@catamarca.fierro-soft.com.ar> Message-ID: <8F57BD0D-AA3A-41B2-BC1B-3D19ABC4013F@iki.fi> On 10 Apr 2015, at 17:51, Guillermo M. Narvaja wrote: > > El vie, 10-04-2015 a las 10:21 +0900, Timo Sirainen escribi?: >> On 09 Apr 2015, at 06:52, Guillermo M. Narvaja wrote: >>> >>> Since December 2014, clients using the Python poplib library (getmail in >>> my case) started to limit the line length of RETR and other command >>> responses sent from the server to 2048 bytes: >>> >>> See https://bugs.python.org/issue16041 (Included at least in >>> Python-2.7.9) >>> >>> Dovecot doesn't have line split in the POP3 module, so Python fails to >>> retrieve messages with long lines. >>> >>> RFC 1939 says: >>> " >>> Responses in the POP3 consist of a status indicator and a keyword >>> possibly followed by additional information. All responses are >>> terminated by a CRLF pair. Responses may be up to 512 characters >>> long, including the terminating CRLF. >>> " >>> >>> I think dovecot-pop3 should split it's output in lines of at least 512 >>> characters. Or at least it should have a "pop3_max_line_length" setting >>> (like "imap_max_line_length"). >> >> Um. This is talking about POP3 responses themselves - not about the >> actual email message body. Dovecot's POP3 reponses are short always I >> think. The message body is sent exactly as it was originally saved. >> Changing this could break things like PGP/SMIME signing and so on. > > So there is no way to break the lines without breaking the message? Right. > Please note that if you are right, I should post a bug on the Python > project. Yes. They are crazy if they think their behavior would work with any POP3 server. I think they have simply misunderstood the RFC. From guillermo.narvaja at fierro.com.ar Fri Apr 10 15:33:37 2015 From: guillermo.narvaja at fierro.com.ar (Guillermo M. Narvaja) Date: Fri, 10 Apr 2015 12:33:37 -0300 Subject: pop3 retr responses too large lines - Fails with current python's poplib In-Reply-To: <8F57BD0D-AA3A-41B2-BC1B-3D19ABC4013F@iki.fi> References: <1428529977.20288.15.camel@catamarca.fierro-soft.com.ar> <1428677464.30175.8.camel@catamarca.fierro-soft.com.ar> <8F57BD0D-AA3A-41B2-BC1B-3D19ABC4013F@iki.fi> Message-ID: <1428680017.30175.17.camel@catamarca.fierro-soft.com.ar> El vie, 10-04-2015 a las 17:59 +0300, Timo Sirainen escribi?: > On 10 Apr 2015, at 17:51, Guillermo M. Narvaja wrote: > > > > El vie, 10-04-2015 a las 10:21 +0900, Timo Sirainen escribi?: > >> On 09 Apr 2015, at 06:52, Guillermo M. Narvaja wrote: > >>> > >>> Since December 2014, clients using the Python poplib library (getmail in > >>> my case) started to limit the line length of RETR and other command > >>> responses sent from the server to 2048 bytes: > >>> > >>> See https://bugs.python.org/issue16041 (Included at least in > >>> Python-2.7.9) > >>> > >>> Dovecot doesn't have line split in the POP3 module, so Python fails to > >>> retrieve messages with long lines. > >>> > >>> RFC 1939 says: > >>> " > >>> Responses in the POP3 consist of a status indicator and a keyword > >>> possibly followed by additional information. All responses are > >>> terminated by a CRLF pair. Responses may be up to 512 characters > >>> long, including the terminating CRLF. > >>> " > >>> > >>> I think dovecot-pop3 should split it's output in lines of at least 512 > >>> characters. Or at least it should have a "pop3_max_line_length" setting > >>> (like "imap_max_line_length"). > >> > >> Um. This is talking about POP3 responses themselves - not about the > >> actual email message body. Dovecot's POP3 reponses are short always I > >> think. The message body is sent exactly as it was originally saved. > >> Changing this could break things like PGP/SMIME signing and so on. > > > > So there is no way to break the lines without breaking the message? > > Right. > > > Please note that if you are right, I should post a bug on the Python > > project. > > Yes. They are crazy if they think their behavior would work with any POP3 server. I think they have simply misunderstood the RFC. > Ok, I posted an issue on the Python's issue tracker: http://bugs.python.org/issue23906 I expect this can be fixed in either of the sides. -- Guillermo M. Narvaja Lambda Sistemas S.R.L. www.fierro-soft.com.ar - radiocut.fm Tel: (5411) 3220-1520 (rotativas) y 4857-6662 Cel: (5411) 15-6783-4435 Email: guillermo.narvaja at fierro-soft.com.ar MSN: guillermo_narvaja at hotmail.com Skype: guillermonarvaja Lavalleja 519 1er Piso - Ciudad de Buenos Aires - Argentina From marcio.merlone at a1.ind.br Fri Apr 10 16:46:04 2015 From: marcio.merlone at a1.ind.br (=?UTF-8?B?TcOhcmNpbyBNZXJsb25l?=) Date: Fri, 10 Apr 2015 13:46:04 -0300 Subject: Calendar and address book with Dovecot In-Reply-To: <5526E4B9.6030907@echter-kuechen-elektro.de> References: <5526E4B9.6030907@echter-kuechen-elektro.de> Message-ID: <5527FE4C.6020507@a1.ind.br> On 09-04-2015 17:44, J. Echter wrote: > Am 09.04.2015 um 18:46 schrieb mimicafe at gmail.com: >> What other software (ideally open source, free) do I need in other to have >> Calendar and address book so my users can manage their contact on their >> phones or computer? I have looked at Roundcube already, but my requirement >> is not necessarily to provide web mail. > SOGo? > > www.sogo.nu +1 We have SOGo providing shared calendars and contacts for 100+ users, using Thunderbird + Lightning and SOGo extensions. It has a full-featured web interface for mail, calendar and contacts. My boss once said he wanted MS-Exchange no matter what cost. Once we got the quotation (within the price range he asked for) we scheduled a briefing to demo its functionalities and features. After that day he realized we already have all we need and never mentioned it again. SOGo also implements MS-ActiveSync protocol, so you can use native Android and iOS features as if it were an MS-Exchange server. We run Postfix + Dovecot (with sieve) + SOGo -- *Marcio Merlone* From lista at xdrv.co.uk Fri Apr 10 17:52:16 2015 From: lista at xdrv.co.uk (James) Date: Fri, 10 Apr 2015 18:52:16 +0100 Subject: dovecot-2.2.16 compilation problems under Solaris Studio 11 In-Reply-To: <26A2856C-679D-4A59-85A1-E7E865E348FE@dovecot.fi> References: <20150408162449.Horde.JVFLyGh86N7lbldXeYJmwA1@horde5.hrz.uni-giessen.de> <55255691.2060409@xdrv.co.uk> <26A2856C-679D-4A59-85A1-E7E865E348FE@dovecot.fi> Message-ID: <55280DD0.1070707@xdrv.co.uk> On 10/04/2015 15:27, Sami Ketola wrote: > I?m using Solaris 11 and SS 12.4, but I can still replicate the issue. It?s seems not to be compiler version or operating system version tied. > Dovecot does compile but I can see the error during the compile. Which issue, what error? The warning about sloppy programming (putting a negative number in an unsigned value) can be ignored. I see no compile error. James. From dmiller at amfes.com Fri Apr 10 18:55:59 2015 From: dmiller at amfes.com (Daniel Miller) Date: Fri, 10 Apr 2015 11:55:59 -0700 Subject: Disk space usage with mdbox In-Reply-To: <552197B6.20308@ekt.gr> References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> <551EF232.5080104@ekt.gr> <551F24EE.6030301@amfes.com> <552197B6.20308@ekt.gr> Message-ID: Why things happen is one of the great mysteries and joys of being a sysadmin... As for cleaning up SIS, I believe the "doveadm purge" command takes care of it. I have a daily cronjob which includes: #!/bin/sh # Permanently expunge old Trash doveadm expunge -A mailbox Trash savedbefore 2w # Optimize mdbox storage doveadm purge -A # Update fts indexes doveadm fts rescan -A -- Daniel On 4/5/2015 1:14 PM, Alexandros Soumplis wrote: > Daniel thank you for the advice, I have done this exact procedure to > clean up some space and I reduced the used space by more than 60% > (huge gain!). Yet it is still a mystery why this happened first place > and more important if it will occur again, time will tell. I have kept > one mailbox out of this procedure (the "live" size is 8,8G, the backup > size is less than 1GB) to do some testing or debugging if possible. > > Another question I am not able to answer is if this procedure cleans > up potentialy orphaned attachments as I store them seperately for SiS > to work. > > a. > > > On 04/04/15 02:40, Daniel Miller wrote: >> Shot in the dark here...haven't tried it myself so no promises. >> There's probably a much better way to do this but sometimes a little >> "brute force" helps. >> >> Theoretical steps: >> 1. Stop all mail processes - both SMTP and IMAP. >> 2. Use "doveadm sync" to backup the user mailbox, e.g., >> doveadm backup -u user mdbox:/tmp/usermail >> 3. Verify /tmp/usermail looks reasonable >> 4. Move the user's mail store somewhere else, e.g. /tmp/useroldmail >> 5. Move /tmp/usermail to the user's mailstore >> 6. Verify file permissions are set correctly in the mailstore >> 7. Start the mail processes...and test. >> >> -- >> Daniel >> >> On 4/3/2015 1:04 PM, Alexandros Soumplis wrote: >>> Nobody any suggestions ? >>> >>> >>> On 02/04/15 10:09, Alexandros Soumplis wrote: >>>> Yes I have done it, it is the third command I have run, without any >>>> change. >>>> >>>> a. >>>> >>>> >>>> On 02/04/2015 09:53 ??, Urban Loesch wrote: >>>>> Did you "purged" the deleted mails for this user? >>>>> On mdbox you must run "doveadm purge -u $USER" to whipe out any as >>>>> deleted marked mails etc. >>>>> >>>>> Details: http://wiki2.dovecot.org/Tools/Doveadm/Purge >>>>> >>>>> I use a nightly cronjob wor this. >>>>> >>>>> Regards >>>>> Urban >>>>> >>>>> Am 01.04.2015 um 23:26 schrieb Alexandros Soumplis: >>>>>> Hello, >>>>>> >>>>>> I am using dovecot with mdbox+sis and I notice an ever increasing >>>>>> disk space usage since I converted mailboxes from Maildir to >>>>>> mdboxes. I have checked >>>>>> with a user and while it actually uses only 65K, his mdbox files >>>>>> on disk are more than 6G. The backup of his mailbox is just 64K. >>>>>> Any suggestions ? >>>>>> >>>>>> Below are some relevant commands: >>>>>> >>>>>> [root at mail ~]# doveadm quota get -u test >>>>>> Quota name Type Value Limit % >>>>>> User quota STORAGE 10135 31457280 0 >>>>>> User quota MESSAGE 186 - 0 >>>>>> >>>>>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>>>>> 220 /mdboxes/test/mailboxes >>>>>> 6029348 /mdboxes/test/storage >>>>>> 6029592 /mdboxes/test/ >>>>>> >>>>>> [root at mail ~]# doveadm purge -u test >>>>>> [root at mail ~]# du -k --max-depth=1 /mdboxes/test/ >>>>>> 220 /mdboxes/test/mailboxes >>>>>> 6029348 /mdboxes/test/storage >>>>>> 6029592 /mdboxes/test/ >>>>>> >>>>>> [root at mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ >>>>>> [root at mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ >>>>>> 16 /tmp/MDBOX_TEMP/mailboxes >>>>>> 65540 /tmp/MDBOX_TEMP/storage >>>>>> 65568 /tmp/MDBOX_TEMP/ >>>>>> >>>> >>>> From stephan at rename-it.nl Fri Apr 10 19:52:51 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 10 Apr 2015 21:52:51 +0200 Subject: sieve plugin editheader not found In-Reply-To: References: Message-ID: <55282A13.20208@rename-it.nl> On 4/8/2015 4:53 PM, Patrick Lion wrote: > Hey folks, > > ive already made a bug report in the gentoo bugtracker last year. In the > meantime after some releases the error persists with the current dovecot > and pigeonhole versions. > > Please see my bug report at gentoo mailinglist: > > https://bugs.gentoo.org/show_bug.cgi?id=522148 > > Okay, here are some informations: > > Steps to Reproduce: > > add "editheader" to sieve options or "sievec" a file that need the extension What exactly do you mean by 'sieve options' ? What is your sievec command line? > if header :matches "Something" "*" { > addheader "Anything" "${1}"; > deleteheader "Something"; > } > > sievec mod_header.sieve > sievec(root): Fatal: Plugin 'editheader' not found from directory > /usr/lib64/dovecot/sieve This indicates that sievec is looking for a plugin called 'editheader' (there is no such thing). That is strange unless you've configured sieve_plugins (I don't see that in your config) or you provide a -P option to sievec. Regards, Stephan. From kremels at kreme.com Fri Apr 10 20:09:27 2015 From: kremels at kreme.com (@lbutlr) Date: Fri, 10 Apr 2015 14:09:27 -0600 Subject: imap doesn't like my passwd In-Reply-To: References: <5526018A.7030902@lockie.ca> <552706D6.7070605@lockie.ca> Message-ID: On Apr 10, 2015, at 12:14 AM, Steffen Kaiser wrote: > pass"word > > is no atom and Dovecot should reject it. No, not passwords should be rejected. > Maybe the former version did not checked the atoms 100% RFC conform. Where is the definition that passwords have to be atomic? And if it is there, it should be changed. Nothing anywhere at anytime should care about the contents of a password once it passes basic ?not password of monkey? complexity checks. -- "You see, in this world there's two kinds of people, my friend: Those with loaded guns and those who dig. You dig." From HFlor at gmx.de Fri Apr 10 21:10:46 2015 From: HFlor at gmx.de (Hardy Flor) Date: Fri, 10 Apr 2015 23:10:46 +0200 Subject: Why are here ignore a simple question? In-Reply-To: <55223798.2050403@gmx.de> References: <55223798.2050403@gmx.de> Message-ID: <55283C56.9040201@gmx.de> Am 06.04.2015 um 09:36 schrieb Hardy Flor: > Hello, > > when I have with "doveadm save ..." store a message, how do I get the > guid or uid of this message for the setthe flags? > > Hardy From gedalya at gedalya.net Fri Apr 10 21:39:30 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 10 Apr 2015 17:39:30 -0400 Subject: Why are here ignore a simple question? In-Reply-To: <55283C56.9040201@gmx.de> References: <55223798.2050403@gmx.de> <55283C56.9040201@gmx.de> Message-ID: <55284312.2010704@gedalya.net> On 04/10/2015 05:10 PM, Hardy Flor wrote: > > Am 06.04.2015 um 09:36 schrieb Hardy Flor: >> Hello, >> >> when I have with "doveadm save ..." store a message, how do I get the >> guid or uid of this message for the setthe flags? >> >> Hardy Maybe the feature is just not there? This command has just been added and is not even on the wiki or man page yet. Perhaps in the future doveadm save can provide this as output, but until then, if you have some good known criteria about the message you have just saved, such as Message-Id you can use that in doveadm search, combined with savedsince, this might be reliable enough for your needs. From HFlor at gmx.de Sat Apr 11 06:39:21 2015 From: HFlor at gmx.de (Hardy Flor) Date: Sat, 11 Apr 2015 08:39:21 +0200 Subject: Why are here ignore a simple question? In-Reply-To: <55284312.2010704@gedalya.net> References: <55223798.2050403@gmx.de> <55283C56.9040201@gmx.de> <55284312.2010704@gedalya.net> Message-ID: <5528C199.5010800@gmx.de> I had been on 3/12/2015 pointed to the lack of documentation of "doveadm save". It was in the changelog of 2.2.16. Am 10.04.2015 um 23:39 schrieb Gedalya: > On 04/10/2015 05:10 PM, Hardy Flor wrote: >> >> Am 06.04.2015 um 09:36 schrieb Hardy Flor: >>> Hello, >>> >>> when I have with "doveadm save ..." store a message, how do I get the >>> guid or uid of this message for the setthe flags? >>> >>> Hardy > > > Maybe the feature is just not there? This command has just been added > and is not even on the wiki or man page yet. > > Perhaps in the future doveadm save can provide this as output, but > until then, if you have some good known criteria about the message you > have just saved, such as Message-Id you can use that in doveadm > search, combined with savedsince, this might be reliable enough for > your needs. -------------- next part -------------- An embedded message was scrubbed... From: Hardy Flor Subject: Re: v2.2.16 released Date: Thu, 12 Mar 2015 19:50:40 +0100 Size: 4877 URL: From gedalya at gedalya.net Sat Apr 11 06:46:18 2015 From: gedalya at gedalya.net (Gedalya) Date: Sat, 11 Apr 2015 02:46:18 -0400 Subject: Why are here ignore a simple question? In-Reply-To: <5528C199.5010800@gmx.de> References: <55223798.2050403@gmx.de> <55283C56.9040201@gmx.de> <55284312.2010704@gedalya.net> <5528C199.5010800@gmx.de> Message-ID: <5528C33A.70107@gedalya.net> On 04/11/2015 02:39 AM, Hardy Flor wrote: > I had been on 3/12/2015 pointed to the lack of documentation of "doveadm > save". It was in the changelog of 2.2.16. Unfortunately this is not unique. Dovecot's documentation is at all times significantly lagging behind the code, this is the MO for this project. I guess someone will say "contributions are welcome". There has also been some general discussion about organizing the documentation differently, making it more comprehensive and perhaps verbose, and my own personal impression that every line on the wiki seems to assume you already know everything there is no know about dovecot, except the line you're reading right now ;-) But I must say the documentation is still quite helpful, in its own way. And nothing will change unless people get into a practical discussion about organizing an effort to improve the documentation. From HFlor at gmx.de Sat Apr 11 07:48:24 2015 From: HFlor at gmx.de (Hardy Flor) Date: Sat, 11 Apr 2015 09:48:24 +0200 Subject: Why are here ignore a simple question? In-Reply-To: <5528C33A.70107@gedalya.net> References: <55223798.2050403@gmx.de> <55283C56.9040201@gmx.de> <55284312.2010704@gedalya.net> <5528C199.5010800@gmx.de> <5528C33A.70107@gedalya.net> Message-ID: <5528D1C8.7060100@gmx.de> I've also looked at the source code. But my attempt to output the UID fails because of the error message: doveadm-mail save.c: 62: 36: error: dereferencing pointer to incomplete type in the line: printf("uid =%s\n", dec2str(save_ctx->dest_mail->uid)); Am 11.04.2015 um 08:46 schrieb Gedalya: > Unfortunately this is not unique. Dovecot's documentation is at all > times significantly lagging behind the code, this is the MO for this > project. I guess someone will say "contributions are welcome". > There has also been some general discussion about organizing the > documentation differently, making it more comprehensive and perhaps > verbose, and my own personal impression that every line on the wiki > seems to assume you already know everything there is no know about > dovecot, except the line you're reading right now ;-) > But I must say the documentation is still quite helpful, in its own way. > And nothing will change unless people get into a practical discussion > about organizing an effort to improve the documentation. From devnull at ehwat.de Sat Apr 11 13:26:42 2015 From: devnull at ehwat.de (Patrick Lion) Date: Sat, 11 Apr 2015 15:26:42 +0200 Subject: sieve plugin editheader not found In-Reply-To: <55282A13.20208@rename-it.nl> References: <55282A13.20208@rename-it.nl> Message-ID: Hi Eugene and Stephan, doveconf -a | grep sieve managesieve(root): Fatal: Plugin 'editheader' not found from directory /usr/lib64/dovecot/sieve doveconf: Error: managesieve-login: dump-capability process returned 89 managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_sieve_capability = sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_extensions = variables sieve_plugins = editheader service managesieve-login { executable = managesieve-login inet_listener sieve { protocol = sieve service managesieve { executable = managesieve protocol = sieve unix_listener login/sieve { mail_plugins = quota sieve mail_plugins = quota sieve sievec -d -x +editheader /etc/postfix/sieve_add_xorg.sieve sievec(root): Fatal: Plugin 'editheader' not found from directory /usr/lib64/dovecot/sieve ( with added "require ["editheader"]" in my sieve file ) find / -type f -name editheader.txt /opt/dovecot-2.2-pigeonhole-0.4.3/doc/extensions/editheader.txt /opt/_dovecot-2.2-pigeonhole-0.4.3/doc/extensions/editheader.txt ( these are files from tests i did with manual compiling the pigeonhole sources, not used at all and deleted in the meantime). Stephan, i was testing some things and the general mail delivery fails when loading the plugin like you can see in this doveconf output. So in my first mail it wasnt present at specific time, but it is for sure and giving me same error over and over again with failing mail delivery. Thanks in advance. From eugene at raptor.kiev.ua Sat Apr 11 15:42:10 2015 From: eugene at raptor.kiev.ua (Eugene Paskevich) Date: Sat, 11 Apr 2015 18:42:10 +0300 Subject: sieve plugin editheader not found In-Reply-To: References: <55282A13.20208@rename-it.nl> Message-ID: <552940D2.4010408@raptor.kiev.ua> On 04/11/2015 04:26 PM, Patrick Lion wrote: > sieve_extensions = +notify +imapflags > sieve_plugins = editheader Editheader is not a plugin. It's an extension. Ergo, if you put +editheader into sieve_extensions sievec -x flag won't be necessary. Require line will be though. -- Eugene Paskevich | *==)----------- | Plug me into eugene at raptor.kiev.ua | -----------(==* | The Matrix From tss at iki.fi Sun Apr 12 13:53:19 2015 From: tss at iki.fi (Timo Sirainen) Date: Sun, 12 Apr 2015 16:53:19 +0300 Subject: Disk space usage with mdbox In-Reply-To: References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> <551EF232.5080104@ekt.gr> <551F24EE.6030301@amfes.com> <552197B6.20308@ekt.gr> Message-ID: On 10 Apr 2015, at 21:55, Daniel Miller wrote: > > Why things happen is one of the great mysteries and joys of being a sysadmin... > > As for cleaning up SIS, I believe the "doveadm purge" command takes care of it. I have a daily cronjob which includes: > > #!/bin/sh > # Permanently expunge old Trash > doveadm expunge -A mailbox Trash savedbefore 2w > # Optimize mdbox storage > doveadm purge -A > # Update fts indexes > doveadm fts rescan -A doveadm index updates the indexes. doveadm fts rescan makes sure that after something has broken it makes sure to update all the mails to the index after indexing is done - so it by itself doesn't even add any missing mails to the index.(And with fts-lucene it's actually looking if there are any mails that were supposed to have been deleted already - with Solr it should do that too but the code isn't written yet. So I don't think that needs to be run nightly (if ever automatically). From tss at iki.fi Sun Apr 12 13:58:58 2015 From: tss at iki.fi (Timo Sirainen) Date: Sun, 12 Apr 2015 16:58:58 +0300 Subject: Why are here ignore a simple question? In-Reply-To: <5528D1C8.7060100@gmx.de> References: <55223798.2050403@gmx.de> <55283C56.9040201@gmx.de> <55284312.2010704@gedalya.net> <5528C199.5010800@gmx.de> <5528C33A.70107@gedalya.net> <5528D1C8.7060100@gmx.de> Message-ID: On 11 Apr 2015, at 10:48, Hardy Flor wrote: > > I've also looked at the source code. But my attempt to output the UID fails because of the error message: > doveadm-mail save.c: 62: 36: error: dereferencing pointer to incomplete type > in the line: > printf("uid =%s\n", dec2str(save_ctx->dest_mail->uid)); The UID isn't actually assigned at that point yet - it's only after transaction has been committed. See imap/cmd-append.c how it does it. Outputting the guid + uidvalidity + uid automatically would be useful I guess (for getting the GUID I think you'd need to create yet another transaction + mail_alloc() + mail_set_uid() + mail_get_special(MAIL_FETCH_GUID) - so maybe not worth the trouble since with the UID you can already do another doveadm fetch for the GUID). From rgelfand2 at gmail.com Mon Apr 13 00:08:10 2015 From: rgelfand2 at gmail.com (Roman Gelfand) Date: Sun, 12 Apr 2015 20:08:10 -0400 Subject: special_use folders Message-ID: My setup is postfix mail gateway/spamassassin on one machine and dovecot mail box server on another machine. Will the following configuration work? 1. On the mail gateway, I install dovecot-lmtp and use it to deliver locally spam. 2. On the mailbox server, I configure special use junk folder to point mail gateway's spam folder via nfs. If this is correct, how can I configure special use folder to point to a path (variable based on email) which is different from default path? If there is a different way to handle this, I would interested. Thanks in advance From gedalya at gedalya.net Mon Apr 13 01:05:38 2015 From: gedalya at gedalya.net (Gedalya) Date: Sun, 12 Apr 2015 21:05:38 -0400 Subject: special_use folders In-Reply-To: References: Message-ID: <552B1662.7030804@gedalya.net> On 04/12/2015 08:08 PM, Roman Gelfand wrote: > My setup is postfix mail gateway/spamassassin on one machine and dovecot > mail box server on another machine. > > Will the following configuration work? > > 1. On the mail gateway, I install dovecot-lmtp and use it to deliver > locally spam. > 2. On the mailbox server, I configure special use junk folder to point > mail gateway's spam folder via nfs. > > If this is correct, how can I configure special use folder to point to a > path (variable based on email) which is different from default path? > > If there is a different way to handle this, I would interested. > > Thanks in advance Do you have some special motivation here? It's not quite clear in your post. Why would you want to store junk mail on the gateway box and not just deliver it along with everything else? If you do need to have a folder in separate storage, that can be done with namespaces, see http://wiki2.dovecot.org/Namespaces From phil at dovecot.fi Mon Apr 13 12:29:50 2015 From: phil at dovecot.fi (Phil Carmody) Date: Mon, 13 Apr 2015 15:29:50 +0300 Subject: dovecot-2.2.16 compilation problems under Solaris Studio 11 In-Reply-To: <55280DD0.1070707@xdrv.co.uk> References: <20150408162449.Horde.JVFLyGh86N7lbldXeYJmwA1@horde5.hrz.uni-giessen.de> <55255691.2060409@xdrv.co.uk> <26A2856C-679D-4A59-85A1-E7E865E348FE@dovecot.fi> <55280DD0.1070707@xdrv.co.uk> Message-ID: <20150413122950.GH21887@phil.dovecot.net> On Fri, Apr 10, 2015 at 06:52:16PM +0100, James wrote: > On 10/04/2015 15:27, Sami Ketola wrote: > > >I???m using Solaris 11 and SS 12.4, but I can still replicate the issue. It???s seems not to be compiler version or operating system version tied. > >Dovecot does compile but I can see the error during the compile. > > Which issue, what error? The warning about sloppy programming (putting a > negative number in an unsigned value) can be ignored. I see no compile > error. Some people like -Werror, or whatever the local equivalent is, and therefore we strive to not have any compiler warnings. I'll note that the "sloppy" code has perfectly well defined semantics in N1570 (6.7.9p11, 6.5.16.1p2, and 6.3.1.3p2). It's as idiomatic as ``unsigned int foo = -1;'', which doesn't cause me to bat an eyelid. However, for the sake of -Werror and other static code analysis tools, a patch will very soon be in the dovecot.org tree. Phil From skdovecot at smail.inf.fh-brs.de Mon Apr 13 13:18:03 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 13 Apr 2015 15:18:03 +0200 (CEST) Subject: Why are here ignore a simple question? In-Reply-To: <55283C56.9040201@gmx.de> References: <55223798.2050403@gmx.de> <55283C56.9040201@gmx.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 10 Apr 2015, Hardy Flor wrote: > Subject: Why are here ignore a simple question? do you have a support contract with somebody, that covers Dovecot? > Am 06.04.2015 um 09:36 schrieb Hardy Flor: >> Hello, >> >> when I have with "doveadm save ..." store a message, how do I get the >> guid or uid of this message for the setthe flags? >> >> Hardy > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSvCC3z1H7kL/d9rAQKlKAgAgFBpZH/LLi2nDX/wqOMV3cBr2Oon0/bA SIlDrYPiaWSBsabw3AsZPyemfFIeOlae0NpiGVKpLi/o1xzDUJrMhTc+WLI8PsgR mu81sBjh/E7UyjPEwiIq6XJPi5x6f+Y+IuYz4sTQolguNSH8tnWXRYso0v2p711B 2ny5m8vsihlCydSIP+5lulVWQ/aRAIU+Rh0VaelSqdEWM5pOV0ySKjf3yffwl2Fe zxkUvFn4c9sjzDfoj9KOHdeSFmypVo6OTPyrLI1pkDX48hiR0sirSPnszVqQvtkL zhFqK7ujXOzPGzbHDWUhvfi8l8oHGVGP4fnhxcpPeqVtFJ/PkzCbxg== =Nhwg -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Mon Apr 13 13:25:32 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 13 Apr 2015 15:25:32 +0200 (CEST) Subject: Disabling of userdb/passdb modules using config statements In-Reply-To: <55279EE9.9060501@massar.ch> References: <55279EE9.9060501@massar.ch> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 10 Apr 2015, Jeroen Massar wrote: > Debian (and possibly other distros) use the /etc/dovecot/conf.d/* setup > where default config files are stuffed and then one can just add a > 99-myconfig.conf et voila, variables are overruled. > This allows the distro to supply updates to the files at package upgrade > time without any/much user intervention. > > The problem (for me ;) is that the system comes provided with: > > auth-system.conf.ext containing: > > passdb { > driver = pam > } > userdb { > driver = passwd > } > > Hence pam & /etc/passwd based are always enabled. > This while I don't have any local users. Isn't that a packaging problem then? Debian should use DEBCONF to ask you while installation, which db to enable by default. You should file a bug with Debian to let the admin choose, which (if at all) db to enable by default. There are no config files installed by Dovecot, if compiled by source. > > Replication seems to then always pick up the local users, which are > vmail + nobody (65536). > > doveadm user '*' thus reports vmail, nobody + virtual users > > Setting: > first_valid_uid = 5000 > last_valid_uid = 5000 > > only keeps vmail in there, but apparently some module (guess > replication) is still able to figure out that 'nobody' exists: > > Apr 10 09:48:25 mail dovecot: doveadm(IPADDR,nobody): Error: Mail access > for users with UID 65534 not permitted (see first_valid_uid in config > file, uid from userdb lookup). > Apr 10 09:48:25 mail dovecot: doveadm(IPADDR,nobody): Error: > dsync-server: User init failed > Apr 10 09:49:38 mail dovecot: doveadm(nobody): Error: sync: Failed to > start remote dsync-server command: Remote exit_code=75 > > and on the other side: > Apr 10 09:54:38 mail dovecot: doveadm(nobody): Error: sync: Unknown user > in remote > > This can be resolved by commenting out the entries in > auth-system.conf.ext but then I'll have to do that again at package > upgrade time. > > Hence, would it be a cool option to be able (in the 99-myconfig.conf) > file to put: > > passdb { > driver = pam > enabled = false > } > userdb { > driver = passwd > enabled = false > } > > And thereby disabling those modules completely? Thus avoiding upgrade > conflicts etc. > > Greets, > Jeroen > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSvDzHz1H7kL/d9rAQJybAgAyOmtGbDyp6nzR0IqK2RUTWTHtjkbcmrN G6MNxMCzsByp7JCCKaKZy4Ec9//4ua5+29zwsF4f/EjdyxOtCdZkOA2TRuw3Zbns nuECm4h03HsjkGIi216mMHP3z2QjqTuZNWFj0MppBuiBqSuNrNFfxQ0pac3xEeAo IYnKl1Oq4SKfwr351iF94NSHzCbR7CJDe5Q7TqkK8OB7PuASFIbYX9R6CYZc1jsR euLRHKssX7Brw44PkQGLjHEOBG8xWP4/cAVf4bApskSiW8q1IZWhMR7Z4rbUgxRY 3RInqI/rJ8azOjZWd8Us25eCJl3f30bFkdbmOlL6LlUkzPAjMPx/3A== =MZqU -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Mon Apr 13 13:28:58 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 13 Apr 2015 15:28:58 +0200 (CEST) Subject: dovecot debug message help required In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 10 Apr 2015, Rajesh M wrote: > in the dovecot log i see the following. > > Apr 10 17:12:10 imap(user at mydomain.com): Debug: Effective uid=89, gid=89, home=/home/vpopmail/domains/mydomain.com/user > Apr 10 17:12:10 imap(user at mydomain.com): Debug: Quota root: name=ignore=Trash backend=maildir args= > Apr 10 17:12:10 imap(user at mydomain.com): Debug: Quota rule: root=ignore=Trash mailbox=? bytes=0 messages=0 > Apr 10 17:12:10 imap(user at mydomain.com): Debug: Quota grace: root=ignore=Trash bytes=0 (10%) > Apr 10 17:12:10 imap(user at mydomain.com): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location= > Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: access(/home/vpopmail/domains/mydomain.com/user/mdbox, rwx): failed: No such file or directory > Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: couldn't find root dir > Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: access(/home/vpopmail/domains/mydomain.com/user/sdbox, rwx): failed: No such file or directory > Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: couldn't find root dir > Apr 10 17:12:10 imap(user at mydomain.com): Debug: maildir: root exists (/home/vpopmail/domains/mydomain.com/user/Maildir) > Apr 10 17:12:10 imap(user at mydomain.com): Debug: maildir++: root=/home/vpopmail/domains/mydomain.com/user/Maildir, index=, indexpvt=, control=, inbox=/home/vpopmail/domains/mydomain.com/user/Maildir, alt= > Apr 10 17:12:40 imap(user at mydomain.com): Info: Disconnected: Logged out in=28 out=460 > > i would like to know what the following means -- specifically mdbox and sdbox > > #################### > Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: access(/home/vpopmail/domains/mydomain.com/user/mdbox, rwx): failed: No such file or directory > Apr 10 17:12:10 imap(user at mydomain.com): Debug: mdbox: couldn't find root dir > Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: access(/home/vpopmail/domains/mydomain.com/user/sdbox, rwx): failed: No such file or directory > Apr 10 17:12:10 imap(user at mydomain.com): Debug: sdbox: couldn't find root dir > #################### Your config does not specify, which mail storage the user is using. That's why Dovecot probes for various "signs", mdbox is the first and so on. Eventually it probes for Maildir and uses the user's mail dir as a Maildir storage. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEUAwUBVSvEmnz1H7kL/d9rAQJU/wf1EoaHomOrWmSkE+llzdSLnlRgXZAXbHYD DAQCGuHRNNH7Er1x1lPQQponxz2ora/ONu1+fpbNocWcTYcFIf/iJwBSfzgAAVB/ 4lSwB/mCFRZ62vhT/eOEChSmkfql8HvuSIJH7Q9+pwz5xrBCgFyqC4aiJv7rLAEm I53mfXeHdjIwddzydj5cyapcMbR8PwScwOi2TRnKIKWDBnR1WD28EhmRDhGmOdDY kKYDGwAZek9uqPVFnSpdv1o/Yle3MHpyQ/kp1kt5e/jQ7jVqjkonW9AgJb8BBVUu qEaqx4qMaa6V2iPhikoVsgKw4YlJuks6CaBwb1PGoZMGgr17YamL =xhme -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Mon Apr 13 13:39:20 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 13 Apr 2015 15:39:20 +0200 (CEST) Subject: special_use folders In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 12 Apr 2015, Roman Gelfand wrote: > My setup is postfix mail gateway/spamassassin on one machine and dovecot > mail box server on another machine. > > Will the following configuration work? > > 1. On the mail gateway, I install dovecot-lmtp and use it to deliver > locally spam. > 2. On the mailbox server, I configure special use junk folder to point > mail gateway's spam folder via nfs. > > If this is correct, how can I configure special use folder to point to a > path (variable based on email) which is different from default path? > > If there is a different way to handle this, I would interested. If you use Maildir or something like that, you probably can symlink the NFS path into each user's Maildir. You cannot configure a "filesystem path" to point to a mailbox, as far as I know. Maybe there is a plugin for that. But you could create a new namespace for the NFS storage and use the config mailbox Junk { special_use = \Junk } in that namespace. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSvHCHz1H7kL/d9rAQJxXgf+KvqVSR+bZZ0koCfquVR8fllU0TjbmS9h QcZ/9WH4OYpQrqU+T1c6NjHrVa693pTeDH6lQkzeeA/ZC7Fv33z9TcSf3dZtX9Vs 71vJ/o2gTGODJS9Hdjs41O/75FaKc+S71ueNX6DMb8rZ6CiFhki4HLrnxKQdxBgA 62O1Xl4uWhI1iGwY+VI4tH+eMBUQkLPUT40iLuUNCj/xJQII5dU9yGUBZU7ljRuK p2ZLqXLoggYt795VhXuyauYf+mkO5JcOpoe1EN1OTWf2KxKQ7BenqeV3Kv7h0sII qtZHGWPb/a2yn2GknTOtpXRVQa9gdD0/igNb5ci6+OBq7IpLOxnzzw== =PcWW -----END PGP SIGNATURE----- From alex2grad at gmail.com Mon Apr 13 15:27:16 2015 From: alex2grad at gmail.com (Alexei Gradinari) Date: Mon, 13 Apr 2015 11:27:16 -0400 Subject: Trash Plugin bugs In-Reply-To: <1137483717.20150409174434@gmail.com> References: <1137483717.20150409174434@gmail.com> Message-ID: <1278581516.20150413112716@gmail.com> > 3. Trash plugin does not check 'unlimited' values in > bytes_ceil/count_ceil and may overflow them > when add expunged size/messages check any overflow - ctx->bytes_ceil += size_expunged; - ctx->count_ceil += expunged_count; + if (ctx->bytes_ceil > ((uint64_t)-1 - size_expunged)) { + ctx->bytes_ceil = (uint64_t)-1; + } else { + ctx->bytes_ceil += size_expunged; + } + if (ctx->count_ceil > ((uint64_t)-1 - expunged_count)) { + ctx->count_ceil = (uint64_t)-1; + } else { + ctx->count_ceil += expunged_count; + } Attached the last patch. Regards, Alexei -------------- next part -------------- A non-text attachment was scrubbed... Name: trash-plugin.patch Type: application/octet-stream Size: 2118 bytes Desc: not available URL: From tss at iki.fi Mon Apr 13 17:38:34 2015 From: tss at iki.fi (Timo Sirainen) Date: Mon, 13 Apr 2015 20:38:34 +0300 Subject: Authcache and user changing In-Reply-To: References: Message-ID: On 09 Jan 2015, at 12:36, Lazy wrote: > I have atached a dirty hack that fixes the issue for me (username > changes are cached in userdb auth cache). These should also work: http://hg.dovecot.org/dovecot-2.2/rev/08b2f79e8212 http://hg.dovecot.org/dovecot-2.2/rev/635f9c7d5991 From gessel at blackrosetech.com Tue Apr 14 01:11:11 2015 From: gessel at blackrosetech.com (David Gessel) Date: Tue, 14 Apr 2015 04:11:11 +0300 Subject: Problem: mail moved by thunderbird script is invisible to mail clients, but in cur directory Message-ID: Over the last year I've had a script moving old mail (120 days) into my annual archive folder. This is the first year I've done this with Dovecot, previously it was running against Cyrus. There's nothing particularly clever: a few conditions to match, then "move message to" the appropriate archive folder. There's one for every year from 2000 to 2015. 2015 is just barely ahead of need. 2014 has about a year's mail in the cur directory. The 2000-2013 folders were filled by Cyrus and were migrated over using IMAP Migrate. They're fine, and read normally. The 2014 layout looks normal to me # ls cur dovecot-uidlist dovecot.index.cache dovecot.index.log.2 new dovecot-keywords dovecot.index dovecot.index.log maildirfolder tmp Permissions are the same as every other folder, as is owner: drw-r----- 2 vmail vmail 9.6K Apr 12 21:13 cur and # ls | wc -l 9822 I've checked with Thunderbird, Mulberry, Claws, and Sylpheed - none can read the directory. The files look normal: 2014/cur 1426411329.M123928P26360.host.domain.com,S=3523,W=3591:2,R More or less the same as a working directory: 2013/cur 1405500734.M958596P27867.host.domain.com,S=794,W=819:2,RS I've run # doveadm force-resync -u user .archives.2014 and nothing changed. I'm at a bit of a loss since no client can read them, something like moving them to another folder and back is a little complicated. Any hints? From skdovecot at smail.inf.fh-brs.de Tue Apr 14 06:07:54 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 14 Apr 2015 08:07:54 +0200 (CEST) Subject: Problem: mail moved by thunderbird script is invisible to mail clients, but in cur directory In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 14 Apr 2015, David Gessel wrote: > There's nothing particularly clever: a few conditions to match, then "move > message to" the appropriate archive folder. There's one for every year from > 2000 to 2015. 2015 is just barely ahead of need. 2014 has about a year's > mail in the cur directory. > > The 2000-2013 folders were filled by Cyrus and were migrated over using IMAP > Migrate. They're fine, and read normally. > > The 2014 layout looks normal to me > # ls > cur dovecot-uidlist dovecot.index.cache > dovecot.index.log.2 new > dovecot-keywords dovecot.index dovecot.index.log > maildirfolder tmp > > Permissions are the same as every other folder, as is owner: > drw-r----- 2 vmail vmail 9.6K Apr 12 21:13 cur > > I've checked with Thunderbird, Mulberry, Claws, and Sylpheed - none can read > the directory. What does Dovecot log? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVSyuunz1H7kL/d9rAQKRRAf/fn3KoLeLyjgZcB3r6TV7WuothiUg513/ Nf/eTbyu/Xe1dR24oFyWVSE7yOKPttwSKsSFHZqVs75MOGRCv9j0441WEXnDFiqE TJ8JZ8KQfkgjaS7YEIO2loZJfJa4ValcTWsL2kO23UCmITsedIQLwqtO5n+1yhUT 5InO2FC2TsEuD0kmWjEnFoNq0jpqkwCZhRDYrW3eZC/dFr95mNAxS7PlQe2Ps5n+ 4NEVLPSfBCuM02iL+Gni+SgFGGo3iCtxeacfYLx5wCNDIV4kwX0WAwaKagGQdcGF ZNm8dOZJ1L5BVBOj+MbE6THc0RW3Dq3UDbL107MS8FsKhmKcYDEalg== =X1/v -----END PGP SIGNATURE----- From j.echter at echter-kuechen-elektro.de Tue Apr 14 12:04:17 2015 From: j.echter at echter-kuechen-elektro.de (J. Echter) Date: Tue, 14 Apr 2015 14:04:17 +0200 Subject: Dovecot and recipient_delimiter Message-ID: <552D0241.8070906@echter-kuechen-elektro.de> Hi, we're using thunderbird as our client, it has the functionality to sort spamassassin tagged mails in a folder called 'Junk'. I have this folder on my dovecot server and i'd like to use the recipient_delimiter feature to get my spam/junk mails directly to this folder. what i have done yet: dovecot.conf: plugin { recipient_delimiter = + } postfix: master.cf dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail null_sender= argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -e -m ${extension} postfix: main.cf recipient_delimiter = + what i get: Apr 14 13:46:50 mule postfix/pickup[22664]: 71ED53C05EE: uid=0 from= Apr 14 13:46:50 mule postfix/cleanup[1408]: 71ED53C05EE: message-id=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test> Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: from=, size=465, nrcpt=2 (queue active) Apr 14 13:46:50 mule dovecot: lda(testuser at testdomain.test): msgid=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test>: save failed to junk: Mailbox doesn't exist: junk Apr 14 13:46:50 mule dovecot: lda(testuser at testdomain.test): msgid=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test>: saved mail to INBOX Apr 14 13:46:50 mule postfix/pipe[10898]: 71ED53C05EE: to=, relay=dovecot, delay=0.04, delays=0.02/0/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot service) Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: removed here is my complete dovecot -n output: dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) ext4 auth_cache_negative_ttl = 0 auth_cache_size = 50 M auth_verbose = yes base_dir = /var/run/dovecot/ imap_id_log = * imap_id_send = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = 5000 mail_home = /DATEN/vmail/%d/%n mail_location = maildir:/DATEN/vmail/%d/%n/mail/ mail_plugins = " zlib" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { autocreate = Junk autosubscribe = Junk recipient_delimiter = + sieve = /DATEN/vmail/%d/%n/.dovecot.sieve sieve_dir = /DATEN/vmail/%d/%n/sieve zlib_save = gz zlib_save_level = 6 } protocols = sieve imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = root } service imap-login { chroot = login executable = /usr/libexec/dovecot/imap-login inet_listener imap { port = 0 } process_min_avail = 4 user = dovecot } service imap { executable = /usr/libexec/dovecot/imap } service managesieve-login { chroot = login user = dovecot } service pop3-login { chroot = login user = dovecot } ssl = required ssl_cert = References: <552D0241.8070906@echter-kuechen-elektro.de> Message-ID: <552D0CA5.2000201@echter-kuechen-elektro.de> Am 14.04.2015 um 14:04 schrieb J. Echter: > Hi, > > we're using thunderbird as our client, it has the functionality to > sort spamassassin tagged mails in a folder called 'Junk'. > > I have this folder on my dovecot server and i'd like to use the > recipient_delimiter feature to get my spam/junk mails directly to this > folder. > > what i have done yet: > > dovecot.conf: > > plugin { > recipient_delimiter = + > } > > postfix: master.cf > > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail null_sender= > argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} > -e -m ${extension} > > postfix: main.cf > > recipient_delimiter = + > > > what i get: > > Apr 14 13:46:50 mule postfix/pickup[22664]: 71ED53C05EE: uid=0 > from= > Apr 14 13:46:50 mule postfix/cleanup[1408]: 71ED53C05EE: > message-id=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test> > Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: > from=, size=465, nrcpt=2 (queue active) > Apr 14 13:46:50 mule dovecot: lda(testuser at testdomain.test): > msgid=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test>: save > failed to junk: Mailbox doesn't exist: junk > Apr 14 13:46:50 mule dovecot: lda(testuser at testdomain.test): > msgid=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test>: saved mail > to INBOX > Apr 14 13:46:50 mule postfix/pipe[10898]: 71ED53C05EE: > to=, relay=dovecot, delay=0.04, > delays=0.02/0/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot > service) > Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: removed > > here is my complete dovecot -n output: > > dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 > (Final) ext4 > auth_cache_negative_ttl = 0 > auth_cache_size = 50 M > auth_verbose = yes > base_dir = /var/run/dovecot/ > imap_id_log = * > imap_id_send = * > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e > %c %k > mail_gid = 5000 > mail_home = /DATEN/vmail/%d/%n > mail_location = maildir:/DATEN/vmail/%d/%n/mail/ > mail_plugins = " zlib" > mail_uid = 5000 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > passdb { > args = /etc/dovecot/dovecot-ldap.conf > driver = ldap > } > plugin { > autocreate = Junk > autosubscribe = Junk > recipient_delimiter = + > sieve = /DATEN/vmail/%d/%n/.dovecot.sieve > sieve_dir = /DATEN/vmail/%d/%n/sieve > zlib_save = gz > zlib_save_level = 6 > } > protocols = sieve imap > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0660 > user = vmail > } > user = root > } > service imap-login { > chroot = login > executable = /usr/libexec/dovecot/imap-login > inet_listener imap { > port = 0 > } > process_min_avail = 4 > user = dovecot > } > service imap { > executable = /usr/libexec/dovecot/imap > } > service managesieve-login { > chroot = login > user = dovecot > } > service pop3-login { > chroot = login > user = dovecot > } > ssl = required > ssl_cert = ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT > ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf > driver = ldap > } > valid_chroot_dirs = /var/spool/vmail > protocol lda { > mail_plugins = sieve > postmaster_address = postmaster > } > > any hints on what i do wrong here? > > thanks > > juergen as always i asked my question and figured it out, i only had to change dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail null_sender= argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -e -m ${extension} to dovecot unix - n n - - pipe flags=DR user=vmail:vmail null_sender= argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -e -m ${extension} From wdgarc88 at gmail.com Tue Apr 14 13:28:53 2015 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Tue, 14 Apr 2015 23:28:53 +1000 Subject: Dovecot and recipient_delimiter In-Reply-To: <552D0CA5.2000201@echter-kuechen-elektro.de> References: <552D0241.8070906@echter-kuechen-elektro.de> <552D0CA5.2000201@echter-kuechen-elektro.de> Message-ID: On 4/14/15, J. Echter wrote: > Am 14.04.2015 um 14:04 schrieb J. Echter: >> Hi, >> >> we're using thunderbird as our client, it has the functionality to >> sort spamassassin tagged mails in a folder called 'Junk'. >> >> I have this folder on my dovecot server and i'd like to use the >> recipient_delimiter feature to get my spam/junk mails directly to this >> folder. >> >> what i have done yet: >> >> dovecot.conf: >> >> plugin { >> recipient_delimiter = + >> } >> >> postfix: master.cf >> >> dovecot unix - n n - - pipe >> flags=DRhu user=vmail:vmail null_sender= >> argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} >> -e -m ${extension} >> >> postfix: main.cf >> >> recipient_delimiter = + >> >> >> what i get: >> >> Apr 14 13:46:50 mule postfix/pickup[22664]: 71ED53C05EE: uid=0 >> from= >> Apr 14 13:46:50 mule postfix/cleanup[1408]: 71ED53C05EE: >> message-id=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test> >> Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: >> from=, size=465, nrcpt=2 (queue active) >> Apr 14 13:46:50 mule dovecot: lda(testuser at testdomain.test): >> msgid=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test>: save >> failed to junk: Mailbox doesn't exist: junk >> Apr 14 13:46:50 mule dovecot: lda(testuser at testdomain.test): >> msgid=<552cfe2a.tR3wZK7y16RgA548%testuser at testdomain.test>: saved mail >> to INBOX >> Apr 14 13:46:50 mule postfix/pipe[10898]: 71ED53C05EE: >> to=, relay=dovecot, delay=0.04, >> delays=0.02/0/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot >> service) >> Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: removed >> >> here is my complete dovecot -n output: >> >> dovecot -n >> # 2.0.9: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 >> (Final) ext4 >> auth_cache_negative_ttl = 0 >> auth_cache_size = 50 M >> auth_verbose = yes >> base_dir = /var/run/dovecot/ >> imap_id_log = * >> imap_id_send = * >> log_timestamp = "%Y-%m-%d %H:%M:%S " >> login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e >> %c %k >> mail_gid = 5000 >> mail_home = /DATEN/vmail/%d/%n >> mail_location = maildir:/DATEN/vmail/%d/%n/mail/ >> mail_plugins = " zlib" >> mail_uid = 5000 >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character vacation subaddress comparator-i;ascii-numeric >> relational regex imap4flags copy include variables body enotify >> environment mailbox date ihave >> passdb { >> args = /etc/dovecot/dovecot-ldap.conf >> driver = ldap >> } >> plugin { >> autocreate = Junk >> autosubscribe = Junk >> recipient_delimiter = + >> sieve = /DATEN/vmail/%d/%n/.dovecot.sieve >> sieve_dir = /DATEN/vmail/%d/%n/sieve >> zlib_save = gz >> zlib_save_level = 6 >> } >> protocols = sieve imap >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener auth-userdb { >> group = vmail >> mode = 0660 >> user = vmail >> } >> user = root >> } >> service imap-login { >> chroot = login >> executable = /usr/libexec/dovecot/imap-login >> inet_listener imap { >> port = 0 >> } >> process_min_avail = 4 >> user = dovecot >> } >> service imap { >> executable = /usr/libexec/dovecot/imap >> } >> service managesieve-login { >> chroot = login >> user = dovecot >> } >> service pop3-login { >> chroot = login >> user = dovecot >> } >> ssl = required >> ssl_cert = > ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT >> ssl_key = > userdb { >> args = /etc/dovecot/dovecot-ldap.conf >> driver = ldap >> } >> valid_chroot_dirs = /var/spool/vmail >> protocol lda { >> mail_plugins = sieve >> postmaster_address = postmaster >> } >> >> any hints on what i do wrong here? >> >> thanks >> >> juergen > > as always i asked my question and figured it out, i only had to change > > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail null_sender= > argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -e > -m ${extension} > > to > > dovecot unix - n n - - pipe > flags=DR user=vmail:vmail null_sender= > argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -e > -m ${extension} > Should not need to alter flags, eg: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda -f ${sender} -e -d ${user}@${nexthop} works perfectly good. From j.echter at echter-kuechen-elektro.de Tue Apr 14 13:56:46 2015 From: j.echter at echter-kuechen-elektro.de (J. Echter) Date: Tue, 14 Apr 2015 15:56:46 +0200 Subject: Dovecot and recipient_delimiter In-Reply-To: References: <552D0241.8070906@echter-kuechen-elektro.de> <552D0CA5.2000201@echter-kuechen-elektro.de> Message-ID: <552D1C9E.80507@echter-kuechen-elektro.de> Am 14.04.2015 um 15:28 schrieb Edwardo Garcia: > Should not need to alter flags, eg: > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda > -f ${sender} -e -d ${user}@${nexthop} > > works perfectly good. Hi Edwardo, here it doesn't. If i use your settings i get this: Apr 14 15:47:34 mule dovecot: lda(testuser at testdomain.test): sieve: msgid=<552d1a76.iwJqJzvGJbJAf0ZG%testuser at testdomain.test>: stored mail into mailbox 'INBOX' Apr 14 15:47:34 mule postfix/pipe[10706]: 37B973C05EF: to=, relay=dovecot, delay=0.04, delays=0.01/0/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot service) If i change the flags back to 'DR' it gets delivered again. Apr 14 15:48:44 mule dovecot: lda(testuser at testdomain.test): sieve: msgid=<552d1abc.gjmvNeZY2U/p5jj0%testuser at testdomain.test>: stored mail into mailbox 'Junk' if i just add the flags back 'DRhu' and use my settings it can't find folder 'junk' Apr 14 15:48:22 mule dovecot: lda(testuser at testdomain.test): msgid=<552d1aa6.cyPum9dem1XfZ8kN%testuser at testdomain.test>: save failed to junk: Mailbox doesn't exist: junk do you have sieve rules to get it sorted right? i try to achive it without sieve rules. cheers juergen From dmiller at amfes.com Tue Apr 14 16:11:00 2015 From: dmiller at amfes.com (Daniel Miller) Date: Tue, 14 Apr 2015 09:11:00 -0700 Subject: Updating Solr - was Disk space usage with mdbox In-Reply-To: References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> <551EF232.5080104@ekt.gr> <551F24EE.6030301@amfes.com> <552197B6.20308@ekt.gr> <55281CBF.5080501@amfes.com> Message-ID: So with "fts_autoindex=yes" enabled in plugins, is there anything I should be running regularly, other than the expunge/purge, to ensure Solr indexes are updated? I have a daily Solr optimize, and Solr autocommit enabled. I have an hourly "doveadm index -A *" command - is that unneeded? -- Daniel On 4/12/2015 6:53 AM, Timo Sirainen wrote: > On 10 Apr 2015, at 21:55, Daniel Miller wrote: >> Why things happen is one of the great mysteries and joys of being a sysadmin... >> >> As for cleaning up SIS, I believe the "doveadm purge" command takes care of it. I have a daily cronjob which includes: >> >> #!/bin/sh >> # Permanently expunge old Trash >> doveadm expunge -A mailbox Trash savedbefore 2w >> # Optimize mdbox storage >> doveadm purge -A >> # Update fts indexes >> doveadm fts rescan -A > doveadm index updates the indexes. doveadm fts rescan makes sure that after something has broken it makes sure to update all the mails to the index after indexing is done - so it by itself doesn't even add any missing mails to the index.(And with fts-lucene it's actually looking if there are any mails that were supposed to have been deleted already - with Solr it should do that too but the code isn't written yet. So I don't think that needs to be run nightly (if ever automatically). From gessel at blackrosetech.com Tue Apr 14 16:59:38 2015 From: gessel at blackrosetech.com (David Gessel) Date: Tue, 14 Apr 2015 19:59:38 +0300 Subject: Problem: mail moved by thunderbird script is invisible to mail clients, but in cur directory In-Reply-To: References: Message-ID: <552D477A.5070902@blackrosetech.com> -------- Original Message -------- Subject: Re: Problem: mail moved by thunderbird script is invisible to mail clients, but in cur directory From: Steffen Kaiser To: David Gessel Date: Tue Apr 14 2015 09:07:54 GMT+0300 (Arabic Standard Time) > On Tue, 14 Apr 2015, David Gessel wrote: > >> There's nothing particularly clever: a few conditions to match, then "move message to" the appropriate archive folder. There's one for every year from 2000 to 2015. 2015 is just barely ahead of need. 2014 has about a year's mail in the cur directory. > >> The 2000-2013 folders were filled by Cyrus and were migrated over using IMAP Migrate. They're fine, and read normally. > >> The 2014 layout looks normal to me >> # ls >> cur dovecot-uidlist dovecot.index.cache dovecot.index.log.2 new >> dovecot-keywords dovecot.index dovecot.index.log maildirfolder tmp > >> Permissions are the same as every other folder, as is owner: >> drw-r----- 2 vmail vmail 9.6K Apr 12 21:13 cur > >> I've checked with Thunderbird, Mulberry, Claws, and Sylpheed - none can read the directory. > > What does Dovecot log? > > > -- Steffen Kaiser Nothing useful as I tried to list it, but just to make sure, I tried copying a new file in and got the immensely useful: Apr 14 09:48:15 imap(user at domain): Error: rename(/mail/domain/user//.archives.2014/tmp/1429030095.M674819P29788.shiofuki, /mail/domain/user//.archives.2014/cur/1405004806.M943913P44906.shiofuki.domain,S=36977,W=37882:2,S) failed: Permission denied And checking again I see the above permissions are accurate but incorrect. 640 isn't right for cur, it should be 740. Curiously, this directory was created by t-bird, but a simple # chmod 740 cur and the folder opens correctly. Thank you, Steffen, for the help! -David From tss at iki.fi Wed Apr 15 16:40:19 2015 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Apr 2015 19:40:19 +0300 Subject: setting service_count results in Permission denied In-Reply-To: <876199t318.fsf@muck.riseup.net> References: <876199t318.fsf@muck.riseup.net> Message-ID: <54D2599E-8339-48AA-B731-792D51620A11@iki.fi> On 06 Apr 2015, at 23:28, Micah Anderson wrote: > > but when I added that to the service imap block, and restarted dovecot, > I see this in the logs: Error: > net_connect_unix(/run/dovecot/imap-postlogin) failed: Permission denied imap process can't connect to imap-postlogin after it has already dropped privileges to the mail user (first time it runs as root). > service imap-postlogin { > # the script process runs as the user specified here (v2.0.14+): > #user = $default_internal_user > > executable = script-login /usr/local/sbin/postlogin_imap > > # this UNIX socket listener must use the same name as given to imap executable > unix_listener imap-postlogin { # whatever user/mode permissions needed in here, for example: user = vmail > } > } From tss at iki.fi Wed Apr 15 16:41:48 2015 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Apr 2015 19:41:48 +0300 Subject: Updating Solr - was Disk space usage with mdbox In-Reply-To: References: <551C628F.6090405@ekt.gr> <551CE760.8080508@enas.net> <551CEB2E.6030601@ekt.gr> <551EF232.5080104@ekt.gr> <551F24EE.6030301@amfes.com> <552197B6.20308@ekt.gr> <55281CBF.5080501@amfes.com> Message-ID: <32F58543-6CDA-4E66-AAB6-72CD655840F2@iki.fi> > On 14 Apr 2015, at 19:11, Daniel Miller wrote: > > So with "fts_autoindex=yes" enabled in plugins, is there anything I should be running regularly, other than the expunge/purge, to ensure Solr indexes are updated? I have a daily Solr optimize, and Solr autocommit enabled. Should be enough. > I have an hourly "doveadm index -A *" command - is that unneeded? Shouldn't be needed. > > -- > Daniel > > On 4/12/2015 6:53 AM, Timo Sirainen wrote: >> On 10 Apr 2015, at 21:55, Daniel Miller wrote: >>> Why things happen is one of the great mysteries and joys of being a sysadmin... >>> >>> As for cleaning up SIS, I believe the "doveadm purge" command takes care of it. I have a daily cronjob which includes: >>> >>> #!/bin/sh >>> # Permanently expunge old Trash >>> doveadm expunge -A mailbox Trash savedbefore 2w >>> # Optimize mdbox storage >>> doveadm purge -A >>> # Update fts indexes >>> doveadm fts rescan -A >> doveadm index updates the indexes. doveadm fts rescan makes sure that after something has broken it makes sure to update all the mails to the index after indexing is done - so it by itself doesn't even add any missing mails to the index.(And with fts-lucene it's actually looking if there are any mails that were supposed to have been deleted already - with Solr it should do that too but the code isn't written yet. So I don't think that needs to be run nightly (if ever automatically). From gessel at blackrosetech.com Thu Apr 16 01:45:24 2015 From: gessel at blackrosetech.com (David Gessel) Date: Thu, 16 Apr 2015 04:45:24 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads Message-ID: My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. Dovecot 2.2.16 on FreeBSD 10.1-release r280247M ZFS is interacting suboptimally with various email clients. Output of "dovecot -n" further down. *Client Artifacts* Thunderbird 31.6 Win 7 Ultimate SP1: - messages disappear and reappear with checks somewhat randomly. - Sometimes full re-download of folders is triggered, also seems random - Copies of messages appear, sometimes multiplying with each mail check up to about 5-8 or so of each message. - The summary information in the list pane doesn't match the message headers in the preview pane - quit and restart always cleans it up. - sometimes changing folders cleans it up, but not always - sometimes instigating a manual mail check cleans it up but not always Mulberry 4.08 Win 7 Ultimate SP1: - messages disappear and reappear - full re-scans of entire folders triggered occasionally when changing folders, but not always - message list filled with semi-blank entries (message number, status flags, and dates are listed, but no sender, subject, or body is available). The time stamps do not appear to be correct "date received". - message list fills with duplicates - the last of the set of duplicates, which are not necessarily sequentially numbered, has load-able body text and headers, but the others do not. There may be 3-5 copies, only one of which is the real message. The inbox is sequentially numbered by "message number" (the "natural order of the mailbox") and duplicates have unique numbers. - If there's a deleted message left, the "expunge" button is enabled and this also restores normal mailbox view. - disconnecting and reconnecting usually fixes the issues - changing mailboxes while connected sometimes fixes the issues. Claws 3.10.1 Win 7 Ultimate SP1 - initial load is correct, but once claws tries to sync mail, it locks up and never releases (even after days). Claws is weird like that. Sylpheed 3.4.2 Win 7 Ultimate SP1 - mail list always looks fine, but sometimes clicking a message shows "can't display" in the preview pane - "get messages" restores access to messages. Thunderbird 31.5 Linux Mint 17 Qaina 3.13.0-24-generic - messages disappear and reappear with checks somewhat randomly. - Sometimes full redownload of folders is triggered, also seems random - Copies of messages appear, sometimes multiplying with each mail check - The summary information in the list pane doesn't match the message headers in the preview pane - wrong message total (every other client agrees on 2576 but TB-linux says 3242, perhaps counting dups) Claws 3.9.3 Linux Mint 17 Qaina 3.13.0-24-generic - Occasionally shows "this message can't be displayed" - executing a "get mail" fixes the error K-9 5.004 Android 4.3 - messages appear and then disappear on the next check - message body is occasionally blank (only subject and arrival time appear, no body preview line, clicking on the message shows "no text" *Server artifacts:* dovecot.log shows runs of this error: Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) or this error: Apr 15 10:04:00 indexer-worker(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) # grep -c "Expunged message reappeared" dovecot.log.0 8981 The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. # doveadm dump -t mailboxlog /mail/domain.com/user #0: rename 000000803de108b60f00000000000000 (1969-12-31 16:00:00) #24: 00000000000000000000000000000000 (1969-12-31 16:00:00) #48: 000000000000000000000000c8272100 (1969-12-31 16:01:04) #72: 00002e61726368697665732e32303031 (2031-02-20 10:50:40) Fatal: rec read() 10 != 24 "Fatal" seems like an error. I do not see much argument with the assertion that 10 != 24. # doveadm dump -t fts-expunge-log /mail/domain.com/user Fatal: Invalid record_size=2147483648 at offset 0 dovecot-debug.log examples follow after # dovecot -n output, which follows "fixes tried:" *Fixes Tried* # doveadm purge -A # doveadm fts rescan -u user at domain.com # doveadm -Dv index -u user INBOX # doveadm force-resync -u user INBOX I've set mbox_dirty_syncs = no mbox_lazy_writes = no ...in an attempt to fix the problem, but none did. I tried removing most of my customizations one by one and testing, but the problem has not been improved. I strongly suspect that the index files are getting thrashed or otherwise abused. I have no idea what's triggering whatever event is resulting in the thousands of expunged messages reappearing, but the client artifacts suggest a mismatch between cache or index files and files on disk: UID, keywords, and set date appear as if from cache but the body of the message does not. It seems as if the UID doesn't match a message on disk any more, which soon gets automatically fixed and everything syncs again until something re-triggers - a false expunge perhaps? Or perhaps the transaction log is suffering some sort of ongoing abuse? *dovecot -n* # dovecot -n # 2.2.16: /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.7 # OS: FreeBSD 10.1-RELEASE amd64 auth_default_realm = blackrosetech.com auth_mechanisms = plain login auth_realms = blackrosetech.com eroticanarchy.org debug_log_path = /var/log/dovecot-debug.log deliver_log_format = msgid=%m: %f $p %$ disable_plaintext_auth = no first_valid_gid = 5000 first_valid_uid = 5000 hostname = blackrosetech.com info_log_path = /var/log/dovecot-info.log last_valid_gid = 5000 last_valid_uid = 5000 lda_mailbox_autocreate = yes listen = 10.3.69.135 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = 5000 mail_location = maildir:~:CONTROL=/var/no-quota/%u mail_plugins = quota mail_log notify fts fts_lucene mail_temp_dir = /var/tmp mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate spamtest spamtestplus editheader mbox_dirty_syncs = no mbox_lazy_writes = no namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. mime_parts mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_rule = *:storage=50G quota_rule2 = Trash:storage=+30%% quota_rule3 = Sent:storage=+30%% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /usr/local/etc/dovecot/sieve/ sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +relational +comparator-i;ascii-numeric +editheader sieve_global_dir = /usr/local/etc/dovecot/sieve } postmaster_address = gessel at blackrosetech.com protocols = imap lmtp sieve sieve sendmail_path = /usr/local/sbin/sendmail service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 128 M } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = required ssl_cert = References: Message-ID: > > mail_location = maildir:~:CONTROL=/var/no-quota/%u At first glance the above looks like it may be wrong or a typo. I don't remember now why I added the following, but it seems like it may be worth a shot: imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags > > mbox_dirty_syncs = no > mbox_lazy_writes = no Pretty sure the above is for mbox if you are using maildir I don't think they apply, but I could be wrong. Good luck. Edgar From gessel at blackrosetech.com Thu Apr 16 03:21:44 2015 From: gessel at blackrosetech.com (David Gessel) Date: Thu, 16 Apr 2015 06:21:44 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: <552F2AC8.8000901@blackrosetech.com> Edgar, Thank you very much for your help. -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Edgar Pettijohn III To: David Gessel Date: Thu Apr 16 2015 05:10:50 GMT+0300 (Arabic Standard Time) >> >> mail_location = maildir:~:CONTROL=/var/no-quota/%u > > At first glance the above looks like it may be wrong or a typo. > It does what I expect: mail directories are virtual and look like /mail/domain.tld/user/cur /mail/domain.tld/user/.Sent/cur That's a little different than one would use for home directories where it would make sense to have something like /usr/home/user/maildir/INBOX/ control ends up looking like /var/no-quota/user at domain.tld/.INBOX I suppose "no-quota" was taken a little literally from the examples. I worried a bit that the lack of Maildir in the directory path might confuse something, but so far all clients can enumerate the IMAP structure. > I don't remember now why I added the following, but it seems like it may be worth a shot: > > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags >> I had tb-extra-mailbox-sep enabled, but on closer read it is only required if LAYOUT=fs, which I am not using so I removed it to simplify my options. I don't think it did anything better or worse being there. The documentation says delay-newmail is for outlook express 6 I haven't seen tb-lsub-flags - it seems to have been introduced in 2011 to help TB understand folders of folders. I'll give it a try, but I don't think it will impact the problems I'm seeing across so many clients. >> mbox_dirty_syncs = no >> mbox_lazy_writes = no > > Pretty sure the above is for mbox if you are using maildir I don't think they apply, but I could be wrong. I think you're right, and that would explain why they make no difference. > > Good luck. > > Edgar > From wdgarc88 at gmail.com Thu Apr 16 06:04:11 2015 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Thu, 16 Apr 2015 16:04:11 +1000 Subject: Dovecot and recipient_delimiter In-Reply-To: <552D1C9E.80507@echter-kuechen-elektro.de> References: <552D0241.8070906@echter-kuechen-elektro.de> <552D0CA5.2000201@echter-kuechen-elektro.de> <552D1C9E.80507@echter-kuechen-elektro.de> Message-ID: On 4/14/15, J. Echter wrote: > Am 14.04.2015 um 15:28 schrieb Edwardo Garcia: >> Should not need to alter flags, eg: >> dovecot unix - n n - - pipe >> flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/dovecot-lda >> -f ${sender} -e -d ${user}@${nexthop} >> >> works perfectly good. > Hi Edwardo, > > here it doesn't. > > If i use your settings i get this: > > Apr 14 15:47:34 mule dovecot: lda(testuser at testdomain.test): sieve: > msgid=<552d1a76.iwJqJzvGJbJAf0ZG%testuser at testdomain.test>: stored mail > into mailbox 'INBOX' > Apr 14 15:47:34 mule postfix/pipe[10706]: 37B973C05EF: > to=, relay=dovecot, delay=0.04, > delays=0.01/0/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot > service) > > If i change the flags back to 'DR' > > it gets delivered again. > > Apr 14 15:48:44 mule dovecot: lda(testuser at testdomain.test): sieve: > msgid=<552d1abc.gjmvNeZY2U/p5jj0%testuser at testdomain.test>: stored mail > into mailbox 'Junk' > > if i just add the flags back 'DRhu' and use my settings it can't find > folder 'junk' > > Apr 14 15:48:22 mule dovecot: lda(testuser at testdomain.test): > msgid=<552d1aa6.cyPum9dem1XfZ8kN%testuser at testdomain.test>: save failed > to junk: Mailbox doesn't exist: junk > > do you have sieve rules to get it sorted right? > > i try to achive it without sieve rules. > > cheers > > juergen > Yes, I use sieve, however h and u flags only say to postfix to force lowercase on host and user, strange. From skdovecot at smail.inf.fh-brs.de Thu Apr 16 06:56:54 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 16 Apr 2015 08:56:54 +0200 (CEST) Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 16 Apr 2015, David Gessel wrote: > My Dovecot 2.2.16 server is interacting poorly with a variety of mail > clients. The symptoms include disappearing messages, mismatched summaries, > duplicated messages, and excessive full re-downloads. > > Dovecot 2.2.16 on FreeBSD 10.1-release r280247M ZFS is interacting > suboptimally with various email clients. Output of "dovecot -n" further > down. ZFS does have some features, that allow backups and restore and such, if I remember correctly. > dovecot.log shows runs of this error: > Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir > /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID > (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) Such message I saw only, when I manually changed files in the Maildir directory. That's why I pointed out ZFS above. Do you use some strategies, that freezes a Maildir, then do something (e.g. backup), then thaw the Maildir. During the backup, a client could delete a message, which reapper after thaw. Other possibilities: rsync/copy, vi, ... on file system level When you operate on filesystem level on the Maildirs keep in mind, that filenames store message flags and status, which may change regularily. > I've set > mbox_dirty_syncs = no > mbox_lazy_writes = no you are using Maildir, no? They don't effect Maildir. > mail_location = maildir:~:CONTROL=/var/no-quota/%u this one hits me: http://wiki2.dovecot.org/VirtualUsers/Home "Home directory shouldn't be the same as mail directory. It's possible to do that, but you might run into trouble with it sooner or later. Some problems with this are: " ... > mail_plugins = quota mail_log notify fts fts_lucene I don't run FTS, where does lucene store its files? In the user's home? > Apr 15 13:17:26 indexer-worker(user at domain.com): > user-lookup(user at domain.com)Debug: Added userdb setting: mail=maildir:~/ > Apr 15 13:17:26 indexer-worker(user at domain.com): > user-lookup(user at domain.com)Debug: Added userdb setting: > plugin/quota_rule=*:bytes=0 > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Effective uid=5000, > gid=5000, home=/mail/domain.com/user/ > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota root: name=User > quota backend=maildir args= > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota rule: root=User > quota mailbox=* bytes=0 messages=0 > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota rule: root=User > quota mailbox=Trash bytes=0 (30%) messages=0 > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota rule: root=User > quota mailbox=Sent bytes=0 (30%) messages=0 > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota warning: > bytes=0 (90%) messages=0 reverse=no command=quota-warning 90 user at domain.com > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota warning: > bytes=0 (75%) messages=0 reverse=no command=quota-warning 75 user at domain.com > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota grace: > root=User quota bytes=0 (10%) > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Namespace inbox: > type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, > subscriptions=yes location=maildir:~/ > Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: maildir++: > root=/mail/domain.com/user/, index=, indexpvt=, control=, > inbox=/mail/domain.com/user/, alt= > Apr 15 13:17:27 indexer-worker(user at domain.com): Debug: Ignoring unknown > cache field: pop3.order > Apr 15 13:17:27 indexer-worker(user at domain.com): Debug: Ignoring unknown > cache field: binary.parts > Apr 15 13:17:27 indexer-worker(user at domain.com): Debug: Ignoring unknown > cache field: body.snippet > > > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota root: name=User quota > backend=maildir args= > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=* bytes=53687091200 messages=0 > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=Trash bytes=+16106127360 (30%) messages=0 > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=Sent bytes=+16106127360 (30%) messages=0 > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota warning: bytes=48318382080 > (90%) messages=0 reverse=no command=quota-warning 90 raw mail user > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota warning: bytes=40265318400 > (75%) messages=0 reverse=no command=quota-warning 75 raw mail user > Apr 15 13:44:25 lda(user at domain.com): Debug: Quota grace: root=User quota > bytes=5368709120 (10%) > Apr 15 13:44:25 lda(user at domain.com): Debug: none: root=, index=, indexpvt=, > control=, inbox=, alt= > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota root: name=User quota > backend=maildir args= > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=* bytes=53687091200 messages=0 > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=Trash bytes=+16106127360 (30%) messages=0 > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=Sent bytes=+16106127360 (30%) messages=0 > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota warning: bytes=48318382080 > (90%) messages=0 reverse=no command=quota-warning 90 raw mail user > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota warning: bytes=40265318400 > (75%) messages=0 reverse=no command=quota-warning 75 raw mail user > Apr 15 13:49:32 lda(user at domain.com): Debug: Quota grace: root=User quota > bytes=5368709120 (10%) > Apr 15 13:49:32 lda(user at domain.com): Debug: none: root=, index=, indexpvt=, > control=, inbox=, alt= > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file storage: Using > script storage path: /mail/domain.com/user//sieve > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file storage: Relative > path to sieve storage in active link: sieve/ > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `Forwards' from `/mail/domain.com/user/sieve/Forwards.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Server_Msg' from > `/mail/domain.com/user/sieve/File_Server_Msg.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_SRL' from `/mail/domain.com/user/sieve/File_SRL.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_BULK' from `/mail/domain.com/user/sieve/File_BULK.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Commerce' from `/mail/domain.com/user/sieve/File_Commerce.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Impersonal' from > `/mail/domain.com/user/sieve/File_Impersonal.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Travel' from `/mail/domain.com/user/sieve/File_Travel.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Tribe' from `/mail/domain.com/user/sieve/File_Tribe.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Info' from `/mail/domain.com/user/sieve/File_Info.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Lists' from `/mail/domain.com/user/sieve/File_Lists.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Trash' from `/mail/domain.com/user/sieve/File_Trash.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Security' from `/mail/domain.com/user/sieve/File_Security.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Notifications' from > `/mail/domain.com/user/sieve/File_Notifications.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened > script `File_Spam' from `/mail/domain.com/user/sieve/File_Spam.sieve' > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: Script binary > /mail/domain.com/user/.dovecot.svbin successfully loaded > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: binary save: not saving > binary /mail/domain.com/user/.dovecot.svbin, because it is already stored > Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: Executing script from > `/mail/domain.com/user/.dovecot.svbin' > Apr 15 13:49:41 lda(user at domain.com): Debug: Quota root: name=User quota > backend=maildir args= > Apr 15 13:49:41 lda(user at domain.com): Debug: Quota rule: root=User quota > mailbox=* bytes=53687091200 messages=0 > > > > Apr 15 13:30:31 imap(user at domain.com): Debug: Loading modules from directory: > /usr/local/lib/dovecot > Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: > /usr/local/lib/dovecot/lib10_quota_plugin.so > Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: > /usr/local/lib/dovecot/lib11_imap_quota_plugin.so > Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: > /usr/local/lib/dovecot/lib15_notify_plugin.so > Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: > /usr/local/lib/dovecot/lib20_fts_plugin.so > Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: > /usr/local/lib/dovecot/lib20_mail_log_plugin.so > Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: > /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so > Apr 15 13:30:31 imap(user at domain.com): Debug: Added userdb setting: > plugin/quota_rule=*:bytes=0 > Apr 15 13:30:31 imap(user at domain.com): Debug: Effective uid=5000, gid=5000, > home=/mail/domain.com/user/ > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota root: name=User quota > backend=maildir args= > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota rule: root=User quota > mailbox=* bytes=0 messages=0 > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota rule: root=User quota > mailbox=Trash bytes=0 (30%) messages=0 > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota rule: root=User quota > mailbox=Sent bytes=0 (30%) messages=0 > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota warning: bytes=0 (90%) > messages=0 reverse=no command=quota-warning 90 user at domain.com > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota warning: bytes=0 (75%) > messages=0 reverse=no command=quota-warning 75 user at domain.com > Apr 15 13:30:31 imap(user at domain.com): Debug: Quota grace: root=User quota > bytes=0 (10%) > Apr 15 13:30:31 imap(user at domain.com): Debug: Namespace inbox: type=private, > prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes > location=maildir:~:CONTROL=/var/no-quota/user at domain.com > Apr 15 13:30:31 imap(user at domain.com): Debug: maildir++: > root=/mail/domain.com/user/, index=, indexpvt=, > control=/var/no-quota/user at domain.com, inbox=/mail/domain.com/user/, alt= > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVS9dNnz1H7kL/d9rAQLn8Af/cQ8BSg6cmUFj6qGVcQUglJkI8hjY3CQM 2MBI/qQbouo4hg3eQNOLX+MOYAGcCV2I+wM8WkOJkqOjPn8vBZACHe5Y860mBbEA XipvGMML1DJt+4leNo/1jPpiFJEFZ3w9kFiCC+rPcjrTU8XV5g+l9RQDofu8vElZ jySGQvH3Ml7kP2afTrqiBb3cwoQVLXMYUTsjw4csw0qn3lWB7i3yN/WACsBMFBP6 H0KnM99UUYbOJ4TMsBJ7aDXIUIvlu6Eo1oGznIsKiX1k6BoCPQtXwlxk4NJ6f8B/ SaGYf6FPSQmKaePTVwxJfSc8sTBxb+rG7DsZQnGjwZFtGH3ti810eg== =6hFs -----END PGP SIGNATURE----- From emailbuilder88 at yahoo.com Thu Apr 16 09:35:21 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 16 Apr 2015 02:35:21 -0700 Subject: quota_over_flag examples? Message-ID: <1429176921.37441.YahooMailBasic@web142404.mail.bf1.yahoo.com> I can't find any posts on this list for peoples using quota_over_flag http://wiki2.dovecot.org/Quota/Configuration#Overquota-flag_.28v2.2.16.2B-.29 If my userdb is sql what would be best script to use in terms of performance? (I mean if over-quota-flag triggers script every time it changes and the script calls CLI mysql client isn't all this so expensive to spawn a new shell session which spawns a mysql client?) Anyone knows how to use this flag with postfix *making postfix send special reject* "user over quota" note instead of plain SMTP reject?? Is an additional database lookup (restriction class?) unavoidable? :( TIA1 PS Looks like it is tricky almost impossible to make postfix do rejects based on this flag for aliases. (Special query would be a little messy for our schema but i dunno at what point postfix resolves aliases?) From emailbuilder88 at yahoo.com Thu Apr 16 09:40:05 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 16 Apr 2015 02:40:05 -0700 Subject: Thunderbird sync time? (reverse quota warning) Message-ID: <1429177205.35687.YahooMailBasic@web142405.mail.bf1.yahoo.com> For reverse quota warning, it looks like webmail works nice. quota_warning3 = -storage=100%% quota-warning below %u # user is no longer over quota But using thunderbird I deleted enough messages to go below quota and I deleted them from trash folder too. But mail log does not show thunderbird connecting to imap to actually delete mails and get the trigger below quota warning msg. It's i thinks a thundrbrd behavior but i wonder if anyone on this list knows how it works? Do i just keep waiting for it to sync eventually? or??????? TIA! From gedalya at gedalya.net Thu Apr 16 09:47:24 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Apr 2015 05:47:24 -0400 Subject: Thunderbird sync time? (reverse quota warning) In-Reply-To: <1429177205.35687.YahooMailBasic@web142405.mail.bf1.yahoo.com> References: <1429177205.35687.YahooMailBasic@web142405.mail.bf1.yahoo.com> Message-ID: <552F852C.2080908@gedalya.net> On 04/16/2015 05:40 AM, E.B. wrote: > For reverse quota warning, it looks like webmail works nice. > > quota_warning3 = -storage=100%% quota-warning below %u # user is no longer over quota > > But using thunderbird I deleted enough messages to go below > quota and I deleted them from trash folder too. But mail log > does not show thunderbird connecting to imap to actually > delete mails and get the trigger below quota warning msg. > > It's i thinks a thundrbrd behavior but i wonder if anyone on > this list knows how it works? Do i just keep waiting for it > to sync eventually? or??????? > > TIA! Try to right-click a folder and click "compact". That should trigger an expunge. There are additional configuration items under account settings. You can make TB expunge on exit, you can turn off local cache to make it more "live" a la webmail... From gedalya at gedalya.net Thu Apr 16 09:49:26 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Apr 2015 05:49:26 -0400 Subject: Thunderbird sync time? (reverse quota warning) In-Reply-To: <552F852C.2080908@gedalya.net> References: <1429177205.35687.YahooMailBasic@web142405.mail.bf1.yahoo.com> <552F852C.2080908@gedalya.net> Message-ID: <552F85A6.40102@gedalya.net> On 04/16/2015 05:47 AM, Gedalya wrote: > On 04/16/2015 05:40 AM, E.B. wrote: >> For reverse quota warning, it looks like webmail works nice. >> >> quota_warning3 = -storage=100%% quota-warning below %u # user is no >> longer over quota >> >> But using thunderbird I deleted enough messages to go below >> quota and I deleted them from trash folder too. But mail log >> does not show thunderbird connecting to imap to actually >> delete mails and get the trigger below quota warning msg. >> >> It's i thinks a thundrbrd behavior but i wonder if anyone on >> this list knows how it works? Do i just keep waiting for it >> to sync eventually? or??????? >> >> TIA! > Try to right-click a folder and click "compact". That should trigger > an expunge. > There are additional configuration items under account settings. You > can make TB expunge on exit, you can turn off local cache to make it > more "live" a la webmail... See more: http://kb.mozillazine.org/Deleting_messages_in_IMAP_accounts From gessel at blackrosetech.com Thu Apr 16 14:13:08 2015 From: gessel at blackrosetech.com (David Gessel) Date: Thu, 16 Apr 2015 17:13:08 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: <301132D5BFE913686C9CAC63@[10.2.69.6]> Steffen, Thank you very much for your help. It is very much appreciated. --On Thursday, April 16, 2015 08:56 +0200 Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 16 Apr 2015, David Gessel wrote: > >> My Dovecot 2.2.16 server is interacting poorly with a variety of mail >> clients. The symptoms include disappearing messages, mismatched >> summaries, duplicated messages, and excessive full re-downloads. >> >> Dovecot 2.2.16 on FreeBSD 10.1-release r280247M ZFS is interacting >> suboptimally with various email clients. Output of "dovecot -n" further >> down. > > ZFS does have some features, that allow backups and restore and such, if > I remember correctly. ZFS can do some awesome things like snapshotting and the like, but they're hidden from the OS (no atime modification if that is enabled, for example) and you can exchange your disks for larger ones and expand into the new space with a single command. It is possible there is an unexpected interaction between ZFS and Maildir, but a good friend of mine runs Dovecot/Maildir on a BSD 10.0/ZFS system without the issues I'm seeing. I've created a diff of our dovecot -n outputs that I'd be happy to share, but it is a styled HTML file and attachments are usually mailing list unfriendly. The documentation at suggests that file system level issues are mostly about performance. This note seems aprops: "Locking "Although maildir was designed to be lockless, Dovecot locks the maildir while doing modifications to it or while looking for new messages in it. This is required because otherwise Dovecot might temporarily see mails incorrectly deleted, which would cause trouble. Basically the problem is that if one process modifies the maildir (eg. a rename() to change a message's flag), another process in the middle of listing files at the same time could skip a file. The skipping happens because readdir() system call doesn't guarantee that all the files are returned if the directory is modified between the calls to it. This problem exists with all the commonly used filesystems. "Because Dovecot uses its own non-standard locking (dovecot-uidlist.lock dotlock file), other MUAs accessing the maildir don't support it. This means that if another MUA is updating messages' flags or expunging messages, Dovecot might temporarily lose some message. After the next sync when it finds it again, *an error message may be written to log and the message will receive a new UID.* "Delivering mails to new/ directory doesn't have any problems, so there's no need for LDAs to support any type of locking." (emphasis added) Certainly flags are not being set on 1000's of messages at a time and while I tend to suspect Thunderbird of doing things that are flaky or out of spec in an attempt to be clever and efficient, Mulberry tends to be painfully strictly adherent to specification. > >> dovecot.log shows runs of this error: >> Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir >> /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new >> UID (old uid=306286, >> file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) > > Such message I saw only, when I manually changed files in the Maildir > directory. That's why I pointed out ZFS above. Do you use some > strategies, that freezes a Maildir, then do something (e.g. backup), then > thaw the Maildir. During the backup, a client could delete a message, > which reapper after thaw. Understood and agreed - it seems like some process is moving things around, but there's no file-system level indication that is happening. In fact, watching the logs live, these messages flood the log whenever a message is sent (sending this message will trigger an avalanche of "expunged message reappeared" messages, for example). > > Other possibilities: rsync/copy, vi, ... on file system level > When you operate on filesystem level on the Maildirs keep in mind, that > filenames store message flags and status, which may change regularily. > I do nightly RSYNC backups to a FreeNAS server from the host (mail runs from a freebsd jail), but the updates are far, far more frequent than those daily backups. >> I've set >> mbox_dirty_syncs = no >> mbox_lazy_writes = no > > you are using Maildir, no? They don't effect Maildir. > >> mail_location = maildir:~:CONTROL=/var/no-quota/%u > > this one hits me: > > http://wiki2.dovecot.org/VirtualUsers/Home > "Home directory shouldn't be the same as mail directory. It's possible to > do that, but you might run into trouble with it sooner or later. Some > problems with this are: " ... That makes sense, but this directory structure does not put the mail in the user's home directory. It is a directory that nothing but the mail system touches (normally, unless I'm poking around looking for problems). The home directories are in their usual places: /usr/home/user... and have no (active) Maildir. Mail is under an entirely separate root level directory: /mail/domain.tld/user... > >> mail_plugins = quota mail_log notify fts fts_lucene > > I don't run FTS, where does lucene store its files? In the user's home? Within the maildir, so the FTS_lucene indicies are at /mail/domain.tld/user/lucene-indexes/_8u.cfs /mail/domain.tld/user/lucene-indexes/segements.gen /mail/domain.tld/user/lucene-indexes/segements_hr Frankly, FTS is a little disappointing. Stand-alone clients don't support server-side search well, in particular they seem to limit search to the active folder rather than searching across the entire mailbox. The premise of FTS for me was to enable particularly mobile devices (=K9/Android) to have search access to the entire mailbox and all archives in some relatively expedient fashion since there are not yet uSD cards large enough to store all that mail. But no... it doesn't really seem to work that way. You can find a message within the currently active folder quickly, but you can do that without server-side search anyway. Mulberry does a pretty amazing job of this, however. You can watch it blast through directories that have FTS indexing one after another. > >> Apr 15 13:17:26 indexer-worker(user at domain.com): >> user-lookup(user at domain.com)Debug: Added userdb setting: mail=maildir:~/ >> Apr 15 13:17:26 indexer-worker(user at domain.com): >> user-lookup(user at domain.com)Debug: Added userdb setting: >> plugin/quota_rule=*:bytes=0 >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Effective >> uid=5000, gid=5000, home=/mail/domain.com/user/ >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota root: >> name=User quota backend=maildir args= >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota rule: >> root=User quota mailbox=* bytes=0 messages=0 >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota rule: >> root=User quota mailbox=Trash bytes=0 (30%) messages=0 >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota rule: >> root=User quota mailbox=Sent bytes=0 (30%) messages=0 >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Quota warning: >> bytes=0 (90%) messages=0 reverse=no command=quota-warning 90 >> user at domain.com Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: >> Quota warning: bytes=0 (75%) messages=0 reverse=no >> command=quota-warning 75 user at domain.com Apr 15 13:17:26 >> indexer-worker(user at domain.com): Debug: Quota grace: root=User quota >> bytes=0 (10%) >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: Namespace inbox: >> type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, >> subscriptions=yes location=maildir:~/ >> Apr 15 13:17:26 indexer-worker(user at domain.com): Debug: maildir++: >> root=/mail/domain.com/user/, index=, indexpvt=, control=, >> inbox=/mail/domain.com/user/, alt= >> Apr 15 13:17:27 indexer-worker(user at domain.com): Debug: Ignoring unknown >> cache field: pop3.order >> Apr 15 13:17:27 indexer-worker(user at domain.com): Debug: Ignoring unknown >> cache field: binary.parts >> Apr 15 13:17:27 indexer-worker(user at domain.com): Debug: Ignoring unknown >> cache field: body.snippet >> >> >> Apr 15 13:44:25 lda(user at domain.com): Debug: Quota root: name=User quota >> backend=maildir args= >> Apr 15 13:44:25 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=* bytes=53687091200 messages=0 >> Apr 15 13:44:25 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=Trash bytes=+16106127360 (30%) messages=0 >> Apr 15 13:44:25 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=Sent bytes=+16106127360 (30%) messages=0 >> Apr 15 13:44:25 lda(user at domain.com): Debug: Quota warning: >> bytes=48318382080 (90%) messages=0 reverse=no command=quota-warning 90 >> raw mail user Apr 15 13:44:25 lda(user at domain.com): Debug: Quota >> warning: bytes=40265318400 (75%) messages=0 reverse=no >> command=quota-warning 75 raw mail user Apr 15 13:44:25 >> lda(user at domain.com): Debug: Quota grace: root=User quota >> bytes=5368709120 (10%) >> Apr 15 13:44:25 lda(user at domain.com): Debug: none: root=, index=, >> indexpvt=, control=, inbox=, alt= >> Apr 15 13:49:32 lda(user at domain.com): Debug: Quota root: name=User quota >> backend=maildir args= >> Apr 15 13:49:32 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=* bytes=53687091200 messages=0 >> Apr 15 13:49:32 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=Trash bytes=+16106127360 (30%) messages=0 >> Apr 15 13:49:32 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=Sent bytes=+16106127360 (30%) messages=0 >> Apr 15 13:49:32 lda(user at domain.com): Debug: Quota warning: >> bytes=48318382080 (90%) messages=0 reverse=no command=quota-warning 90 >> raw mail user Apr 15 13:49:32 lda(user at domain.com): Debug: Quota >> warning: bytes=40265318400 (75%) messages=0 reverse=no >> command=quota-warning 75 raw mail user Apr 15 13:49:32 >> lda(user at domain.com): Debug: Quota grace: root=User quota >> bytes=5368709120 (10%) >> Apr 15 13:49:32 lda(user at domain.com): Debug: none: root=, index=, >> indexpvt=, control=, inbox=, alt= >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file storage: Using >> script storage path: /mail/domain.com/user//sieve >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file storage: >> Relative path to sieve storage in active link: sieve/ >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `Forwards' from `/mail/domain.com/user/sieve/Forwards.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Server_Msg' from >> `/mail/domain.com/user/sieve/File_Server_Msg.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_SRL' from `/mail/domain.com/user/sieve/File_SRL.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_BULK' from `/mail/domain.com/user/sieve/File_BULK.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Commerce' from >> `/mail/domain.com/user/sieve/File_Commerce.sieve' Apr 15 13:49:41 >> lda(user at domain.com): Debug: sieve: file script: Opened script >> `File_Impersonal' from >> `/mail/domain.com/user/sieve/File_Impersonal.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Travel' from `/mail/domain.com/user/sieve/File_Travel.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Tribe' from `/mail/domain.com/user/sieve/File_Tribe.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Info' from `/mail/domain.com/user/sieve/File_Info.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Lists' from `/mail/domain.com/user/sieve/File_Lists.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Trash' from `/mail/domain.com/user/sieve/File_Trash.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Security' from >> `/mail/domain.com/user/sieve/File_Security.sieve' Apr 15 13:49:41 >> lda(user at domain.com): Debug: sieve: file script: Opened script >> `File_Notifications' from >> `/mail/domain.com/user/sieve/File_Notifications.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: file script: Opened >> script `File_Spam' from `/mail/domain.com/user/sieve/File_Spam.sieve' >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: Script binary >> /mail/domain.com/user/.dovecot.svbin successfully loaded >> Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: binary save: not >> saving binary /mail/domain.com/user/.dovecot.svbin, because it is >> already stored Apr 15 13:49:41 lda(user at domain.com): Debug: sieve: >> Executing script from `/mail/domain.com/user/.dovecot.svbin' >> Apr 15 13:49:41 lda(user at domain.com): Debug: Quota root: name=User quota >> backend=maildir args= >> Apr 15 13:49:41 lda(user at domain.com): Debug: Quota rule: root=User quota >> mailbox=* bytes=53687091200 messages=0 >> >> >> >> Apr 15 13:30:31 imap(user at domain.com): Debug: Loading modules from >> directory: /usr/local/lib/dovecot >> Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: >> /usr/local/lib/dovecot/lib10_quota_plugin.so >> Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: >> /usr/local/lib/dovecot/lib11_imap_quota_plugin.so >> Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: >> /usr/local/lib/dovecot/lib15_notify_plugin.so >> Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: >> /usr/local/lib/dovecot/lib20_fts_plugin.so >> Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: >> /usr/local/lib/dovecot/lib20_mail_log_plugin.so >> Apr 15 13:30:31 imap(user at domain.com): Debug: Module loaded: >> /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so >> Apr 15 13:30:31 imap(user at domain.com): Debug: Added userdb setting: >> plugin/quota_rule=*:bytes=0 >> Apr 15 13:30:31 imap(user at domain.com): Debug: Effective uid=5000, >> gid=5000, home=/mail/domain.com/user/ >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota root: name=User >> quota backend=maildir args= >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota rule: root=User >> quota mailbox=* bytes=0 messages=0 >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota rule: root=User >> quota mailbox=Trash bytes=0 (30%) messages=0 >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota rule: root=User >> quota mailbox=Sent bytes=0 (30%) messages=0 >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota warning: bytes=0 >> (90%) messages=0 reverse=no command=quota-warning 90 user at domain.com >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota warning: bytes=0 >> (75%) messages=0 reverse=no command=quota-warning 75 user at domain.com >> Apr 15 13:30:31 imap(user at domain.com): Debug: Quota grace: root=User >> quota bytes=0 (10%) >> Apr 15 13:30:31 imap(user at domain.com): Debug: Namespace inbox: >> type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, >> subscriptions=yes >> location=maildir:~:CONTROL=/var/no-quota/user at domain.com >> Apr 15 13:30:31 imap(user at domain.com): Debug: maildir++: >> root=/mail/domain.com/user/, index=, indexpvt=, >> control=/var/no-quota/user at domain.com, inbox=/mail/domain.com/user/, alt= >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVS9dNnz1H7kL/d9rAQLn8Af/cQ8BSg6cmUFj6qGVcQUglJkI8hjY3CQM > 2MBI/qQbouo4hg3eQNOLX+MOYAGcCV2I+wM8WkOJkqOjPn8vBZACHe5Y860mBbEA > XipvGMML1DJt+4leNo/1jPpiFJEFZ3w9kFiCC+rPcjrTU8XV5g+l9RQDofu8vElZ > jySGQvH3Ml7kP2afTrqiBb3cwoQVLXMYUTsjw4csw0qn3lWB7i3yN/WACsBMFBP6 > H0KnM99UUYbOJ4TMsBJ7aDXIUIvlu6Eo1oGznIsKiX1k6BoCPQtXwlxk4NJ6f8B/ > SaGYf6FPSQmKaePTVwxJfSc8sTBxb+rG7DsZQnGjwZFtGH3ti810eg== > =6hFs > -----END PGP SIGNATURE----- From d.kuhn at heinlein-support.de Thu Apr 16 16:22:25 2015 From: d.kuhn at heinlein-support.de (Dennis Kuhn) Date: Thu, 16 Apr 2015 18:22:25 +0200 Subject: mailbox deletion is not replicated correctly Message-ID: <552FE1C1.4050804@heinlein-support.de> i can't delete several folders at once. I have a folder structure like folder1/folder2/folder3 (we use slash as hierarchy separator). When i delete folder1 server1 executes the command correctly Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2 Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1 but the replica server2 reverses the order: Apr 16 13:44:29 server2 dovecot: dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1 Apr 16 13:44:29 server2 dovecot: dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2 Apr 16 13:44:29 server2 dovecot: dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 This creates the folder INBOX/Trash/folder1/folder2 on server2 again which replicates back to server1. Regards, Dennis Kuhn -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-57 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From emailbuilder88 at yahoo.com Thu Apr 16 17:38:52 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 16 Apr 2015 10:38:52 -0700 Subject: Thunderbird sync time? (reverse quota warning) In-Reply-To: <552F85A6.40102@gedalya.net> Message-ID: <1429205932.82699.YahooMailBasic@web142404.mail.bf1.yahoo.com> > Try to right-click a folder and click "compact". That > should trigger an expunge. > There are additional configuration items under account > settings. You > can make TB expunge on exit, you can turn off local > cache to make it > more "live" a la webmail... > > See more: > http://kb.mozillazine.org/Deleting_messages_in_IMAP_accounts Thank you for the link From gedalya at gedalya.net Thu Apr 16 17:57:42 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Apr 2015 13:57:42 -0400 Subject: quota_over_flag examples? In-Reply-To: <1429176921.37441.YahooMailBasic@web142404.mail.bf1.yahoo.com> References: <1429176921.37441.YahooMailBasic@web142404.mail.bf1.yahoo.com> Message-ID: <552FF816.1030407@gedalya.net> On 04/16/2015 05:35 AM, E.B. wrote: > I can't find any posts on this list for peoples using quota_over_flag > > http://wiki2.dovecot.org/Quota/Configuration#Overquota-flag_.28v2.2.16.2B-.29 > > If my userdb is sql what would be best script to use in terms of performance? > (I mean if over-quota-flag triggers script every time it changes and the script > calls CLI mysql client isn't all this so expensive to spawn a new shell session > which spawns a mysql client?) I have a post-login script updating a "lastlogin" timestamp every time a user logs in. This can happen many times per second in busy hours. The only noticeable load is on the mysql _server_ (namely, some I/O). The shell + mysql client load is not noticeable at all. Don't use bash, of course! Now if we're talking about updating a flag when a user comes back under quota? How frequently is this expected to happen? > > Anyone knows how to use this flag with postfix *making postfix send > special reject* "user over quota" note instead of plain SMTP reject?? > Is an additional database lookup (restriction class?) unavoidable? :( I don't actually use this, but try perhaps: https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ And perhaps search the mailing list for "quota-status" for more info. > TIA1 > > PS Looks like it is tricky almost impossible to make postfix do rejects > based on this flag for aliases. (Special query would be a little messy > for our schema but i dunno at what point postfix resolves aliases?) Tough one. It gets more complicated: What about aliases expanding to multiple recipients? I figure the options are: * Reject (or defer) the RCPT TO because of the one offender who's over quota * Accept, and deliver only to within-quota recipients, silently drop out the over-quota ones * Let a bounce message go out in this case, as necessary I don't know how it's done with postfix, anyway... From tss at iki.fi Thu Apr 16 18:31:30 2015 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Apr 2015 21:31:30 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: On 16 Apr 2015, at 04:45, David Gessel wrote: > > My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. What were you running before Dovecot v2.2.16? An earlier Dovecot? A whole different system? > dovecot.log shows runs of this error: > Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) > > or this error: > Apr 15 10:04:00 indexer-worker(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) .. > The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. These really shouldn't be happening.. From tss at iki.fi Thu Apr 16 18:32:09 2015 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Apr 2015 21:32:09 +0300 Subject: mailbox deletion is not replicated correctly In-Reply-To: <552FE1C1.4050804@heinlein-support.de> References: <552FE1C1.4050804@heinlein-support.de> Message-ID: <4FB37D9A-B0DE-46C8-AC86-461CC5AC24E1@iki.fi> On 16 Apr 2015, at 19:22, Dennis Kuhn wrote: > > i can't delete several folders at once. I have a folder structure like > folder1/folder2/folder3 (we use slash as hierarchy separator). When i > delete folder1 server1 executes the command correctly > > > Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): > Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 > Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): > Mailbox deleted: INBOX/Trash/folder1/folder2 > Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): > Mailbox deleted: INBOX/Trash/folder1 > > > but the replica server2 reverses the order: > > Apr 16 13:44:29 server2 dovecot: > dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: > INBOX/Trash/folder1 > Apr 16 13:44:29 server2 dovecot: > dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: > INBOX/Trash/folder1/folder2 > Apr 16 13:44:29 server2 dovecot: > dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: > INBOX/Trash/folder1/folder2/folder3 > > > This creates the folder INBOX/Trash/folder1/folder2 on server2 again > which replicates back to server1. With what Dovecot version? What mailbox format? From mimicafe at gmail.com Thu Apr 16 20:52:28 2015 From: mimicafe at gmail.com (mimicafe at gmail.com) Date: Thu, 16 Apr 2015 21:52:28 +0100 Subject: Calendar and address book with Dovecot Message-ID: Hi guys Thanks for all your input. I'll feedback later... Mimi From gessel at blackrosetech.com Fri Apr 17 00:30:22 2015 From: gessel at blackrosetech.com (David Gessel) Date: Fri, 17 Apr 2015 03:30:22 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: <5530541E.2020900@blackrosetech.com> Hi Timo, Thank you for the reply. It is very much appreciated. -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Thu Apr 16 2015 21:31:30 GMT+0300 (Arabic Standard Time) > On 16 Apr 2015, at 04:45, David Gessel wrote: >> >> My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. > > What were you running before Dovecot v2.2.16? An earlier Dovecot? A whole different system? I migrated from Cyrus to Dovecot in July of last year on version 2.2.13. The issues started then and haven't really ever mitigated, though my impression (without any real data to back it up) is that it is more of a problem now, particularly mail appear/disappear issues. The first issue I noticed was unexpectedly frequent full resyncs in TB. > >> dovecot.log shows runs of this error: >> Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) >> >> or this error: >> Apr 15 10:04:00 indexer-worker(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) > .. >> The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. > > These really shouldn't be happening.. > I didn't think so. I've contemplated migrating to sdbox, but Maildir shouldn't be a problem, I don't think. Things that strike me as possibly moving my config out of the well-tested regime include (not that anything is unique, but there may not be that many people testing all of the following): FreeBSD 10.1 ZFS mail_location = maildir:~/:CONTROL=/var/no-quota/%u FTS-Lucene Sieve/lmtp Quota Not that anything looks suspicious. The logs don't seem to indicate any reason for the "Expunged message reappeared, giving a new UID" errors. Is there someplace else the cause might be logged? From gessel at blackrosetech.com Fri Apr 17 00:47:29 2015 From: gessel at blackrosetech.com (David Gessel) Date: Fri, 17 Apr 2015 03:47:29 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: <55305821.9010908@blackrosetech.com> scanning the logs for occurrences of "error," I find: # grep error dovecot* dovecot-info.log:Apr 15 17:01:09 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=5887 dovecot-info.log:Apr 16 03:06:48 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<20150416100642.CA9C824764 at host2.localdomain>, size=13237 dovecot-info.log:Apr 16 17:01:18 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=5887 dovecot-info.log.0:Apr 14 13:24:07 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=3033 dovecot-info.log.0:Apr 14 13:24:07 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=32589 dovecot-info.log.0:Apr 14 13:24:07 lda(user2 at domain2.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<23233383_24761373-24761373 at sbe203.redbeanforhealthopen.ninja>, size=6951 dovecot-info.log.0:Apr 14 13:24:07 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<93B38E8FD4B2741936862E3F@[10.0.248.3]>, size=2197 dovecot-info.log.0:Apr 14 13:24:07 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<4A13BE2E2FC7C49B7112BEE5@[10.0.248.3]>, size=4700 dovecot-info.log.0:Apr 14 13:29:07 lda(user2 at domain2.tld): Info: copy from stdin: box=INBOX, uid=952044, msgid=<2361227557511242361114254436978565 at ddxlohivv.errorsinvolved.tld>, size=6891 dovecot-info.log.0:Apr 14 13:34:07 lda(user1 at domain1.tld): Info: copy from stdin: box=Bulkmail, uid=error, msgid=<1120736677264.1115884694416.1417834012.0.291256JL.1002 at scheduler.constantcon..., size=44835 dovecot-info.log.0:Apr 14 13:34:07 lda(user1 at domain1.tld): Info: copy from stdin: box=Bulkmail, uid=error, msgid=, size=42787 dovecot-info.log.0:Apr 14 13:34:07 lda(user2 at domain2.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<63b529fb59de3613763afced1552234b_4334516_4774565 at sbe213.proslimfitbody.ninja>, size=4407 dovecot-info.log.0:Apr 14 13:39:07 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=2941 dovecot-info.log.0:Apr 14 13:59:07 lda(user2 at domain2.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<22304076-63b529fb59de3613763afced1552234b.63b529fb59de3613763afced1552234b at s..., size=4492 dovecot-info.log.0:Apr 14 17:01:08 lda(user1 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=5887 dovecot-info.log.0:Apr 15 17:00:09 lda(user3 at domain1.tld): Info: copy from stdin: box=INBOX, uid=error, msgid=<201504160000.t3G005Eu034535 at brunch.is>, size=1762 dovecot.log.9:Apr 15 11:02:42 imap(user1 at domain1.tld): Error: Log synchronization error at seq=3274,offset=152 for /mail/domain1.tld/user1//dovecot.index: Append with UID 302382, but next_uid = 2419524 Not a lot of errors, but not zero either. -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Thu Apr 16 2015 21:31:30 GMT+0300 (Arabic Standard Time) > On 16 Apr 2015, at 04:45, David Gessel wrote: >> >> My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. > > What were you running before Dovecot v2.2.16? An earlier Dovecot? A whole different system? > >> dovecot.log shows runs of this error: >> Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) >> >> or this error: >> Apr 15 10:04:00 indexer-worker(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) > .. >> The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. > > These really shouldn't be happening.. > From emailbuilder88 at yahoo.com Fri Apr 17 01:07:37 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 16 Apr 2015 18:07:37 -0700 Subject: quota_over_flag examples? In-Reply-To: <552FF816.1030407@gedalya.net> Message-ID: <1429232857.97649.YahooMailBasic@web142401.mail.bf1.yahoo.com> Thanks you so much for your reply-- > > Anyone knows how to use this flag with postfix *making postfix send > > special reject* "user over quota" note instead of plain SMTP reject?? > > Is an additional database lookup (restriction class?) unavoidable? :( > > I don't actually use this, but try perhaps: > https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ > And perhaps search the mailing list for "quota-status" for more info. That's not the same. Strange but I never found quota-status docs on Dovecot wiki nowhere! Anyway, I think quota_over_flag is new and possibly Timo replacing quota-status with this flag now? It's easier I think to use this flag as a smtpd restriction in postfix and not have to do a policy lookup. However, it would be more nice on the postfix side to do only one lookup including the user lookup and the quota_over_flag but I don't know if I can do that and be able to give reject message that is particular to accounts over quota. > > PS Looks like it is tricky almost impossible to make postfix do rejects > > based on this flag for aliases. (Special query would be a little messy > > for our schema but i dunno at what point postfix resolves aliases?) > > Tough one. It gets more complicated: What about aliases expanding to > multiple recipients? Good point!!!!!! Maybe best to let aliases cause bounces like in years before. SMTP reject for real accounts only is still a improvemtn. > I figure the options are: > * Reject (or defer) the RCPT TO because of the one offender who's over quota > * Accept, and deliver only to within-quota recipients, silently drop out > the over-quota ones > * Let a bounce message go out in this case, as necessary > > I don't know how it's done with postfix, anyway... From emailbuilder88 at yahoo.com Fri Apr 17 01:09:06 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 16 Apr 2015 18:09:06 -0700 Subject: Performance impace of spawning shell processes from Dovecot [was: quota_over_flag examples?] In-Reply-To: <552FF816.1030407@gedalya.net> Message-ID: <1429232946.21856.YahooMailBasic@web142402.mail.bf1.yahoo.com> > > I can't find any posts on this list for peoples using quota_over_flag > > > > http://wiki2.dovecot.org/Quota/Configuration#Overquota-flag_.28v2.2.16.2B-.29 > > > > If my userdb is sql what would be best script to use in terms of performance? > > (I mean if over-quota-flag triggers script every time it changes and the script > > calls CLI mysql client isn't all this so expensive to spawn a new shell session > > which spawns a mysql client?) > > I have a post-login script updating a "lastlogin" timestamp every time a > user logs in. This can happen many times per second in busy hours. The > only noticeable load is on the mysql _server_ (namely, some I/O). The > shell + mysql client load is not noticeable at all. Thank you. Is this common for most people === repeatedly spawning shell scripts from Dovecot processes is not impact performance? I thought it's why apps are written as daemons especially for many times a second as you say! > Don't use bash, of course! Hmm well I didn't not know about this. On CentOS-- lrwxrwxrwx. 1 root root 4 Apr 5 10:31 /bin/sh -> bash* Can you state the reasons you say do not use bash so I can google about them? From gedalya at gedalya.net Fri Apr 17 03:53:02 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 16 Apr 2015 23:53:02 -0400 Subject: Performance impace of spawning shell processes from Dovecot [was: quota_over_flag examples?] In-Reply-To: <1429232946.21856.YahooMailBasic@web142402.mail.bf1.yahoo.com> References: <1429232946.21856.YahooMailBasic@web142402.mail.bf1.yahoo.com> Message-ID: <5530839E.8090703@gedalya.net> On 04/16/2015 09:09 PM, E.B. wrote: >> Don't use bash, of course! > Hmm well I didn't not know about this. On CentOS-- > > lrwxrwxrwx. 1 root root 4 Apr 5 10:31 /bin/sh -> bash* > > Can you state the reasons you say do not use bash so I can google about > them? Some random links.. https://wiki.ubuntu.com/DashAsBinSh https://lwn.net/Articles/343924/ http://www.cyberciti.biz/faq/debian-ubuntu-linux-binbash-vs-bindash-vs-binshshell/ My summary: I use Debian. dash is actually a Debian-specific creation. The problem with bash is that it's feature-rich and therefore slow to start and slow to execute. For non-interactive scripts, things like tab-completion or command history are not needed of course. Less-than-bash shells however also do not support more advanced bash syntax. http://mywiki.wooledge.org/Bashism /usr/bin/mysql is of course 3 times bigger than /bin/bash and for that matter is also guilty of being unnecessarily friendly to interactive users (via libreadline) ;-) So I did a very crude test and putting a 'echo select 1 | mysql' in a #!/bin/bash script is only ~20% slower than using #!/bin/sh (which is dash in my case). Oh and it looks like mysql -e blah is a bit faster under bash, but not under dash. I guess the differences are more meaningful when we're talking about more than (hardly even) one line of shell code. From marton.peter at gmail.com Fri Apr 17 08:19:34 2015 From: marton.peter at gmail.com (=?UTF-8?B?UMOpdGVyIE3DoXJ0b24=?=) Date: Fri, 17 Apr 2015 10:19:34 +0200 Subject: userdb username changed Message-ID: Hi! I'm playing with a postfix + dovecot + mysql test setup, and noticed something strange. It seems that despite the "username changed" line, auth returns the original username: Apr 17 09:27:34 imap21 dovecot: quota-status: Debug: Loading modules from directory: /usr/lib64/dovecot (...) Apr 17 09:27:34 imap21 dovecot: auth-worker(27661): Debug: sql(ppp at example.net): SELECT at.userid AS user, at.home AS home, at.uid AS uid, at.gid AS gid, concat('*:storage=', at.quotabytes, 'b:messages=', at.quotamessages) AS quota_rule FROM auth at INNER JOIN mailaddr mt ON at.userid = mt.userid WHERE mt.mailaddress = 'ppp at example.net' OR at.userid = 'ppp at example.net' Apr 17 09:27:34 imap21 dovecot: auth-worker(27661): Debug: sql(ppp at example.net): username changed ppp at example.net -> uppp Apr 17 09:27:34 imap21 dovecot: auth: Debug: userdb out: USER#0111#011ppp at example.net#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024 Apr 17 09:27:34 imap21 dovecot: quota-status: Debug: auth input: ppp at example.net home=/home/ppp uid=500 gid=500 quota_rule=*:storage=3100b:messages=1024 Apr 17 09:27:34 imap21 dovecot: quota-status: Debug: Added userdb setting: plugin/quota_rule=*:storage=3100b:messages=1024 Apr 17 09:27:34 imap21 dovecot: quota-status(ppp at example.net): Debug: Effective uid=500, gid=500, home=/home/ppp Apr 17 09:27:34 imap21 dovecot: quota-status(ppp at example.net): Debug: Quota root: name=User quota backend=dict args=:proxy::quota Apr 17 09:27:34 imap21 dovecot: quota-status(ppp at example.net): Debug: Quota rule: root=User quota mailbox=* bytes=3100 messages=1024 Apr 17 09:27:34 imap21 dovecot: quota-status(ppp at example.net): Debug: Quota grace: root=User quota bytes=310 (10%) Apr 17 09:27:34 imap21 dovecot: quota-status(ppp at example.net): Debug: dict quota: user=ppp at example.net, uri=proxy::quota, noenforcing=0 I've checked this with the LMTP service (i know, normally it wouldn't get mail addresses) and it produces the same: Apr 17 09:30:35 imap21 dovecot: auth-worker(27730): Debug: sql(ppp at example.net,127.0.0.1): SELECT at.userid AS user, at.home AS home, at.uid AS uid, at.gid AS gid, concat('*:storage=', at.quotabytes, 'b:messages=', at.quotamessages) AS quota_rule FROM auth at INNER JOIN mailaddr mt ON at.userid = mt.userid WHERE mt.mailaddress = 'ppp at example.net' OR at.userid = 'ppp at example.net' Apr 17 09:30:35 imap21 dovecot: auth-worker(27730): Debug: sql(ppp at example.net,127.0.0.1): username changed ppp at example.net -> uppp Apr 17 09:30:35 imap21 dovecot: auth: Debug: userdb out: USER#0111#011ppp at example.net#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024 Apr 17 09:30:35 imap21 dovecot: lmtp(27728): Debug: auth input: ppp at example.net home=/home/ppp uid=500 gid=500 quota_rule=*:storage=3100b:messages=1024 Apr 17 09:30:35 imap21 dovecot: lmtp(27728): Debug: Added userdb setting: plugin/quota_rule=*:storage=3100b:messages=1024 Apr 17 09:30:35 imap21 dovecot: lmtp(27728, ppp at example.net): Debug: Effective uid=500, gid=500, home=/home/ppp Passdb works as it should. IMAP test: Apr 17 09:36:21 imap21 dovecot: auth-worker(27849): Debug: sql(ppp at example.net,10.10.128.25): query: SELECT at.userid AS user, at.password AS password, at.home AS userdb_home, at.uid AS userdb_uid, at.gid AS userdb_gid, concat('*:storage=', at.quotabytes, 'b:messages=', at.quotamessages) AS userdb_quota_rule FROM auth at INNER JOIN mailaddr mt ON at.userid = mt.userid WHERE mt.mailaddress = 'ppp at example.net' OR at.userid = 'ppp at example.net' Apr 17 09:36:21 imap21 dovecot: auth-worker(27849): Debug: sql(ppp at example.net,10.10.128.25): username changed ppp at example.net -> uppp Apr 17 09:36:21 imap21 dovecot: auth: Debug: sql(ppp at example.net,10.10.128.25,): username changed ppp at example.net -> uppp Apr 17 09:36:21 imap21 dovecot: auth: Debug: client passdb out: OK#0111#011user=uppp#011original_user=ppp at example.net Apr 17 09:36:21 imap21 dovecot: auth: Debug: master in: REQUEST#0113358588929#01127844#0111#011dbf373ba260f9990e1ea6b688924d513#011session_pid=27850#011request_auth_token Apr 17 09:36:21 imap21 dovecot: auth: Debug: prefetch(uppp,10.10.128.25,): success Apr 17 09:36:21 imap21 dovecot: auth: Debug: master userdb out: USER#0113358588929#011uppp#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024#011auth_token=737d315a5c0e388a0b3dc2bea3c9e333357696d8#011auth_user=ppp at example.net Apr 17 09:36:21 imap21 dovecot: imap-login: Login: user=, method=PLAIN, rip=10.10.128.25, lip=10.10.97.201, mpid=27850, TLS, session= Apr 17 09:36:21 imap21 dovecot: imap: Debug: Loading modules from directory: /usr/lib64/dovecot Apr 17 09:36:21 imap21 dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Apr 17 09:36:21 imap21 dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so Apr 17 09:36:21 imap21 dovecot: imap: Debug: Added userdb setting: plugin/quota_rule=*:storage=3100b:messages=1024 Apr 17 09:36:21 imap21 dovecot: imap(uppp): Debug: Effective uid=500, gid=500, home=/home/ppp Can someone tell what should i do to make this work? Or any idea i could try? It would help if Postfix would be able to run Virtual before the policy check, but thats a problem for the postfix list. :) Thanks! Peter doveconf -n: # 2.2.15: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.6 (3e924b1b6c5c+) # OS: Linux 2.6.32-504.8.1.el6.x86_64 x86_64 CentOS release 6.6 (Final) auth_debug = yes auth_verbose = yes dict { quota = mysql:/etc/dovecot/dict-quota-sql.conf.ext } mail_access_groups = dovecot mail_debug = yes mail_fsync = always mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-example-mysql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_status_nouser = 554 5.5.4 Who the f* is Alice? quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { inet_listener imap { port = 143 } } service lmtp { inet_listener lmtp { address = * port = 25 } } service pop3-login { inet_listener pop3 { port = 110 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 252 } } ssl = required ssl_cert = Looks like the dict-proxy code doesn't currently do escaping newlines properly, but it still accidentally happens to work, because the data is stored in the escaped form. I'm thinking about fixing this, but this might break somebody's existing dict usage. But then again maybe nobody is actually using it now, especially because it hasn't been working exactly as expected. So, can anybody tell me if they're currently using a combination of: - dict proxy (especially to dict sql) - containing values which can contain LFs (or TABs) I guess this mainly means storing Sieve scripts or IMAP METADATA to SQL. Or maybe somebody is using dict (via proxy) for their own purposes?.. From d.kuhn at heinlein-support.de Fri Apr 17 10:07:30 2015 From: d.kuhn at heinlein-support.de (Dennis Kuhn) Date: Fri, 17 Apr 2015 12:07:30 +0200 Subject: mailbox deletion is not replicated correctly In-Reply-To: <4FB37D9A-B0DE-46C8-AC86-461CC5AC24E1@iki.fi> References: <552FE1C1.4050804@heinlein-support.de> <4FB37D9A-B0DE-46C8-AC86-461CC5AC24E1@iki.fi> Message-ID: <5530DB62.9010502@heinlein-support.de> On 16.04.2015 20:32, Timo Sirainen wrote: > On 16 Apr 2015, at 19:22, Dennis Kuhn wrote: >> >> i can't delete several folders at once. I have a folder structure like >> folder1/folder2/folder3 (we use slash as hierarchy separator). When i >> delete folder1 server1 executes the command correctly >> >> >> Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): >> Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 >> Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): >> Mailbox deleted: INBOX/Trash/folder1/folder2 >> Apr 16 13:44:28 server1 dovecot: imap(d.kuhn at heinlein-support.de): >> Mailbox deleted: INBOX/Trash/folder1 >> >> >> but the replica server2 reverses the order: >> >> Apr 16 13:44:29 server2 dovecot: >> dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: >> INBOX/Trash/folder1 >> Apr 16 13:44:29 server2 dovecot: >> dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: >> INBOX/Trash/folder1/folder2 >> Apr 16 13:44:29 server2 dovecot: >> dsync-server(d.kuhn at heinlein-support.de): Mailbox deleted: >> INBOX/Trash/folder1/folder2/folder3 >> >> >> This creates the folder INBOX/Trash/folder1/folder2 on server2 again >> which replicates back to server1. > > With what Dovecot version? What mailbox format? > The mailbox format is mdbox. Server1 is 2.2.15, server2 2.2.16. From trash at skrilnetz.net Fri Apr 17 13:27:37 2015 From: trash at skrilnetz.net (trash at skrilnetz.net) Date: Fri, 17 Apr 2015 13:27:37 +0000 Subject: Replace autocreate after upgrading Message-ID: <20150417132737.Horde.2HfpBXniEZTwCflzImWYkw4@skrilnetz.net> Hi, I just upgraded to 2.2.9 and found out that autocreate should not be used any more. I had a look at http://wiki2.dovecot.org/MailboxSettings and I tried to replace my old config but I had no success. Would somebody be so and help me to change my config? Here is my old config: http://pastebin.com/zFUAQmV3 Thanks, -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-keys Size: 1718 bytes Desc: PGP Public Key URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 473 bytes Desc: PGP Digital Signature URL: From gedalya at gedalya.net Fri Apr 17 20:20:10 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 17 Apr 2015 16:20:10 -0400 Subject: Replace autocreate after upgrading In-Reply-To: <20150417132737.Horde.2HfpBXniEZTwCflzImWYkw4@skrilnetz.net> References: <20150417132737.Horde.2HfpBXniEZTwCflzImWYkw4@skrilnetz.net> Message-ID: <55316AFA.20803@gedalya.net> On 04/17/2015 09:27 AM, trash at skrilnetz.net wrote: > Hi, > > I just upgraded to 2.2.9 and found out that autocreate should not be > used any more. I had a look at > http://wiki2.dovecot.org/MailboxSettings and I tried to replace my old > config but I had no success. Would somebody be so and help me to > change my config? > > Here is my old config: > http://pastebin.com/zFUAQmV3 > > Thanks, See http://wiki2.dovecot.org/MailboxSettings This is in conf.d/10-mail.conf namespace inbox { type = private separator = / inbox = yes } This is in conf.d/15-mailboxes.conf, we're adding more settings into the same namespace namespace inbox { mailbox Trash { auto = subscribe # you probably want: special_use = \Trash } mailbox Sent { auto = subscribe # you probably want: special_use = \Sent } } this you should remove: mail_plugins = autocreate From trash at skrilnetz.net Fri Apr 17 20:21:53 2015 From: trash at skrilnetz.net (trash at skrilnetz.net) Date: Fri, 17 Apr 2015 20:21:53 +0000 Subject: ManageSieve Dovecot v2 listen on localhost only Message-ID: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> Hi, How can I only listen on localhost for ManageSieve? I tried: port = localhost:4190 still listening *: tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN 0 515675 20540/dovecot Would did I not get here? Thanks, -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-keys Size: 1718 bytes Desc: PGP Public Key URL: From gedalya at gedalya.net Fri Apr 17 20:25:47 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 17 Apr 2015 16:25:47 -0400 Subject: ManageSieve Dovecot v2 listen on localhost only In-Reply-To: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> References: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> Message-ID: <55316C4B.7020304@gedalya.net> address = 127.0.0.1 port = 4190 On 04/17/2015 04:21 PM, trash at skrilnetz.net wrote: > > Hi, > > How can I only listen on localhost for ManageSieve? > > I tried: > > port = localhost:4190 > > still listening *: > tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN > 0 515675 20540/dovecot > > Would did I not get here? > > Thanks, From gedalya at gedalya.net Fri Apr 17 20:32:04 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 17 Apr 2015 16:32:04 -0400 Subject: ManageSieve Dovecot v2 listen on localhost only In-Reply-To: <55316C4B.7020304@gedalya.net> References: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> <55316C4B.7020304@gedalya.net> Message-ID: <55316DC4.8000209@gedalya.net> http://wiki2.dovecot.org/Services From trash at skrilnetz.net Fri Apr 17 20:55:43 2015 From: trash at skrilnetz.net (trash at skrilnetz.net) Date: Fri, 17 Apr 2015 20:55:43 +0000 Subject: ManageSieve Dovecot v2 listen on localhost only In-Reply-To: <55316C4B.7020304@gedalya.net> References: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> <55316C4B.7020304@gedalya.net> Message-ID: <20150417205543.Horde.7rOLTr3kdS4FzkAtFm2DyA6@skrilnetz.net> Thanks. I tried that now and added the "address": service managesieve-login { inet_listener sieve { port = 4190 address = 127.0.0.1 } I restarted dovecot but: tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN 0 522413 22288/dovecot Why is this not working? Quoting Gedalya : > address = 127.0.0.1 > port = 4190 > > > On 04/17/2015 04:21 PM, trash at skrilnetz.net wrote: >> >> Hi, >> >> How can I only listen on localhost for ManageSieve? >> >> I tried: >> >> port = localhost:4190 >> >> still listening *: >> tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN >> 0 515675 20540/dovecot >> >> Would did I not get here? >> >> Thanks, -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-keys Size: 1718 bytes Desc: PGP Public Key URL: From gedalya at gedalya.net Fri Apr 17 21:07:24 2015 From: gedalya at gedalya.net (Gedalya) Date: Fri, 17 Apr 2015 17:07:24 -0400 Subject: ManageSieve Dovecot v2 listen on localhost only In-Reply-To: <20150417205543.Horde.7rOLTr3kdS4FzkAtFm2DyA6@skrilnetz.net> References: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> <55316C4B.7020304@gedalya.net> <20150417205543.Horde.7rOLTr3kdS4FzkAtFm2DyA6@skrilnetz.net> Message-ID: <5531760C.9080208@gedalya.net> On 04/17/2015 04:55 PM, trash at skrilnetz.net wrote: > Thanks. I tried that now and added the "address": > > service managesieve-login { > inet_listener sieve { > port = 4190 > address = 127.0.0.1 > } > > I restarted dovecot but: > tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN > 0 522413 22288/dovecot > > Why is this not working? I did it here and here is how it came out in the output of doveconf -n service managesieve-login { inet_listener sieve { address = localhost port = 4190 } } tcp 0 0 127.0.0.1:4190 0.0.0.0:* LISTEN 1859/dovecot tcp6 0 0 ::1:4190 :::* LISTEN 1859/dovecot Check out your doveconf -n. if it doesn't get applied, try to find out why :-) From elyograg at elyograg.org Sat Apr 18 09:36:54 2015 From: elyograg at elyograg.org (Shawn Heisey) Date: Sat, 18 Apr 2015 03:36:54 -0600 Subject: Problem: mail moved by thunderbird script is invisible to mail clients, but in cur directory In-Reply-To: <552D477A.5070902@blackrosetech.com> References: <552D477A.5070902@blackrosetech.com> Message-ID: <553225B6.4040100@elyograg.org> On 4/14/2015 10:59 AM, David Gessel wrote: > Curiously, this directory was created by t-bird, but a simple > > # chmod 740 cur > > and the folder opens correctly. Thank you, Steffen, for the help! I believe you should make those permissions 750, so the execute bit is present on both user and group. This may not be strictly required because the user is likely to always be vmail, but it fits better with POSIX conventions. It's very odd that a directory would be created without the execute bit set wherever read permissions are granted. I hope this is an isolated incident and not a bug. Here is a more verbose explanation of what the execute bit does on a directory: "Execute permission on a directory is sometimes called search permission. If you found a directory that gave you execute permission, but not read permission, you could use any file in that directory. However, you must know the name. You cannot look inside the directory to find out the names of the files. Think of this type of directory as a black box. You can throw filenames at this directory, and sometimes you find a file, sometimes you don't." I found this explanation here: http://www.grymoire.com/Unix/Permissions.html#Execute_permission_on_a_directory Thanks, Shawn From gessel at blackrosetech.com Sat Apr 18 12:02:24 2015 From: gessel at blackrosetech.com (David Gessel) Date: Sat, 18 Apr 2015 15:02:24 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: Message-ID: <553247D0.1020400@blackrosetech.com> -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Thu Apr 16 2015 21:31:30 GMT+0300 (Arabic Standard Time) > On 16 Apr 2015, at 04:45, David Gessel wrote: >> >> My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. > > What were you running before Dovecot v2.2.16? An earlier Dovecot? A whole different system? > >> dovecot.log shows runs of this error: >> Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) >> >> or this error: >> Apr 15 10:04:00 indexer-worker(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) > .. >> The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. > > These really shouldn't be happening.. > One possibility is that there is a scrub/verify routine running that is checking the actual size vs. reported size of messages, and perhaps that routine doesn't know about ZFS compression: zroot/ezjail used 117G - zroot/ezjail compressratio 1.25x - zroot/ezjail compression lz4 local zroot/ezjail logicalused 137G - and is seeing something anomalous and trying to "fix" that, triggering a rescan. A long shot and seems unlikely, but I have no other ideas. I also note from the documentation on the wiki: "Because Dovecot uses its own non-standard locking (dovecot-uidlist.lock dotlock file), other MUAs accessing the maildir don't support it. This means that if another MUA is updating messages' flags or expunging messages, Dovecot might temporarily lose some message. After the next sync when it finds it again, an error message may be written to log and the message will receive a new UID. " ...which are the right symptoms, but seems unlikely to be the right cause. And that: "Maildir format is somewhat compatible with MH format. This is sometimes a problem when people configure their procmail to deliver mails to Maildir/new. This makes procmail create the messages in MH format, which basically means that the file is called msg.inode_number. While this appears to work first, after expunging messages from the maildir the inodes are freed and will be reused later. This means that another file with the same name may come to the maildir, which makes Dovecot think that an expunged file reappeared into the mailbox and an error is logged. " ...which is exactly the error, but the And since I'm using Dovecot LMTP/LDA, it seems odd that errors would be generated. My main.cf config includes: virtual_transport = dovecot dovecot_destination_recipient_limit = 1 home_mailbox = Maildir/ mail_spool_directory = /mail mailbox_command = /usr/local/libexec/dovecot/deliver mailbox_transport = dovecot From tss at iki.fi Sat Apr 18 12:48:28 2015 From: tss at iki.fi (Timo Sirainen) Date: Sat, 18 Apr 2015 15:48:28 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <553247D0.1020400@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> Message-ID: On 18 Apr 2015, at 15:02, David Gessel wrote: > >>> dovecot.log shows runs of this error: >>> Apr 15 09:02:37 imap(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) >>> >>> or this error: >>> Apr 15 10:04:00 indexer-worker(user at domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) > > One possibility is that there is a scrub/verify routine running that is checking the actual size vs. reported size of messages, and perhaps that routine doesn't know about ZFS compression: > > zroot/ezjail used 117G - > zroot/ezjail compressratio 1.25x - > zroot/ezjail compression lz4 local > zroot/ezjail logicalused 137G - > > and is seeing something anomalous and trying to "fix" that, triggering a rescan. A long shot and seems unlikely, but I have no other ideas. No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. From gessel at blackrosetech.com Sat Apr 18 13:00:45 2015 From: gessel at blackrosetech.com (David Gessel) Date: Sat, 18 Apr 2015 16:00:45 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: <553247D0.1020400@blackrosetech.com> Message-ID: <5532557D.10000@blackrosetech.com> -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time) > No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. From edgar at pettijohn-web.com Sat Apr 18 13:30:07 2015 From: edgar at pettijohn-web.com (Edgar Pettijohn III) Date: Sat, 18 Apr 2015 08:30:07 -0500 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <5532557D.10000@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> Message-ID: On Apr 18, 2015, at 8:00 AM, David Gessel wrote: > > > -------- Original Message -------- > Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads > From: Timo Sirainen > To: David Gessel > Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time) > >> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. > > > Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. What is the output for: # zpool status perhaps you have a hardware issue? From gessel at blackrosetech.com Sat Apr 18 14:09:29 2015 From: gessel at blackrosetech.com (David Gessel) Date: Sat, 18 Apr 2015 17:09:29 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> Message-ID: <55326599.7020800@blackrosetech.com> Edgar, thanks for the help! -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Edgar Pettijohn III To: David Gessel Date: Sat Apr 18 2015 16:30:07 GMT+0300 (Arabic Standard Time) > > On Apr 18, 2015, at 8:00 AM, David Gessel wrote: > >> >> >> -------- Original Message -------- >> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads >> From: Timo Sirainen >> To: David Gessel >> Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time) >> >>> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. >> >> >> Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. > > > > What is the output for: > > # zpool status > > perhaps you have a hardware issue? > All good - quite reliable hardware: IBM x3655 dual AMD quad core, 40GB of ECC RAM, 8x IBM 2.5" SAS on battery-backed ServeRAID, RAID 6 and (somewhat pointlessly) ZFS2. All IBM server diagnostics check, full RAM check run without errors, no ECC corrections reported, no uncorrectable errors reported. # zpool status pool: bootpool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM bootpool ONLINE 0 0 0 aacd0s1a ONLINE 0 0 0 errors: No known data errors pool: zroot state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 aacd0s1d.eli ONLINE 0 0 0 errors: No known data errors From edgar at pettijohn-web.com Sat Apr 18 14:20:30 2015 From: edgar at pettijohn-web.com (Edgar Pettijohn III) Date: Sat, 18 Apr 2015 09:20:30 -0500 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <55326599.7020800@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <55326599.7020800@blackrosetech.com> Message-ID: <7F3CF7E0-E6BB-426F-AE90-D5375EEEC091@pettijohn-web.com> On Apr 18, 2015, at 9:09 AM, David Gessel wrote: > Edgar, thanks for the help! > > -------- Original Message -------- > Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads > From: Edgar Pettijohn III > To: David Gessel > Date: Sat Apr 18 2015 16:30:07 GMT+0300 (Arabic Standard Time) > >> >> On Apr 18, 2015, at 8:00 AM, David Gessel wrote: >> >>> >>> >>> -------- Original Message -------- >>> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads >>> From: Timo Sirainen >>> To: David Gessel >>> Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time) >>> >>>> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. >>> >>> >>> Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. >> >> >> >> What is the output for: >> >> # zpool status >> >> perhaps you have a hardware issue? >> > > All good - quite reliable hardware: IBM x3655 dual AMD quad core, 40GB of ECC RAM, 8x IBM 2.5" SAS on battery-backed ServeRAID, RAID 6 and (somewhat pointlessly) ZFS2. All IBM server diagnostics check, full RAM check run without errors, no ECC corrections reported, no uncorrectable errors reported. > > > > # zpool status > pool: bootpool > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > bootpool ONLINE 0 0 0 > aacd0s1a ONLINE 0 0 0 > > errors: No known data errors > > pool: zroot > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > zroot ONLINE 0 0 0 > aacd0s1d.eli ONLINE 0 0 0 > > errors: No known data errors are you using compression? If so which. From tss at iki.fi Sat Apr 18 14:38:02 2015 From: tss at iki.fi (Timo Sirainen) Date: Sat, 18 Apr 2015 17:38:02 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <5532557D.10000@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> Message-ID: <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> On 18 Apr 2015, at 16:00, David Gessel wrote: > >> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. > > > Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. Actually as a workaround you could try maildir_very_dirty_syncs=yes which gets rid of most of the readdir()s. From Harald.Langner at gmx.de Sat Apr 18 17:22:06 2015 From: Harald.Langner at gmx.de (Harald Langner) Date: Sat, 18 Apr 2015 19:22:06 +0200 Subject: Please help: error after upgrade to version 2.1.16 References: Message-ID: Hallo I can not find a forum at dovecot.org and I get a problem I can not solve. After Updating to the version dovecot2? 2.1.16? I can no more get eMails with my eMail-client. All has been working fine before. Server: FreeBSD 10.0-RELEASE-p18, with perl 5, version 18, subversion 4 (v5.18.4) ? It seems it is an authentication problem with my server. The errors are: #cat dovecot.log Apr 17 22:19:37 imap-login: Error: Timeout waiting for handshake from auth server. my pid=41810, input bytes=0 Apr 17 22:19:58 auth: Error: auth: environment corrupt; missing value for DOVECOT_ Apr 17 22:19:58 auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Apr 17 22:19:58 master: Error: service(auth): command startup failed, throttling for 60 secs Apr 17 22:24:04 auth: Error: auth: environment corrupt; missing value for DOVECOT_ Apr 17 22:24:04 auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Apr 17 22:24:04 master: Error: service(auth): command startup failed, throttling for 60 secs I have google and has nothing found about "..environment corrupt; missing value for DOVECOT_" and about "auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address" I have make a reinstall - but doesn't help. I get the same error. I have not forget to create new certs with the dovecote shell-script after installation. I'm using passwd (virtual users). Make a cat on passwd shows that it is not empty. Also the date of the file show that the update installation has it not changed. So I have not create the dovecot users again. ? here are some other logs: #cat dovecot-info.log Apr 17 22:29:03 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 1 secs): user=<>, rip=85.181.222.126, lip=78.47.225.20, TLS handshaking Apr 17 22:29:33 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 30 secs): user=<>, rip=85.181.222.126, lip=78.47.225.20, TLS Apr 17 22:29:33 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 30 secs): user=<>, rip=85.181.222.126, lip=78.47.225.20, TLS #cat dovecot-debug.log Apr 17 22:30:03 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Apr 17 22:30:03 auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Apr 17 22:34:01 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Apr 17 22:34:01 auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Apr 17 22:34:01 imap-login: Debug: SSL: where=0x10, ret=1: before/accept initialization [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: before/accept initialization [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client hello A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server hello A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write certificate A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server done A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 flush data [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client certificate A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] ######################################################################################## My configuration is sendmail(MTA) -> procmail(LDA) -> dovecot(IMAP) with TLS and Maildir (no DB) Authentification been done with dovecot password file (no real user, no OpenLDAP, no other DB-User) #dovecot -n # 2.2.16: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p18 amd64? ufs auth_debug = yes auth_mechanisms = digest-md5 plain login auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot-debug.log default_internal_user = vmail default_login_user = vmail deliver_log_format = msgid=%m: %$ %f %s disable_plaintext_auth = no first_valid_uid = 1000 hostname = swdevil.de info_log_path = /var/log/dovecot-info.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log login_greeting = IMAPd ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mailnull mail_debug = yes mail_location = maildir:/home/vmail/%d/%n/:INBOX=/home/vmail/%d/%n/.INBOX mail_plugins = " virtual" mail_temp_dir = /tmp/mail namespace inbox { ? inbox = yes ? location = ? prefix = } passdb { ? args = scheme=DIGEST-MD5 username_format=%n /usr/local/etc/dovecot/pass ? driver = passwd-file } service auth-worker { ? group = wheel ? user = root } service imap-login { ? group = dovenull ? inet_listener imap { ??? port = 0 ? } ? inet_listener imaps { ??? port = 993 ? } } service imap { ? process_limit = 100 } service pop3-login { ? group = dovenull ? inet_listener pop3 { ??? port = 0 ? } ? inet_listener pop3s { ??? port = 0 ? } } service pop3 { ? process_limit = 100 } ssl = required ssl_cert = Hello, I have been trying to get full-text-search on dovecot. I followed the tutorial on this site:- https://extremeshok.com/6622/enabling-apache-solr-4-10-using-jetty-with-dovecot-2-2-for-fulltext-search-results-on-centos-6-iredmail-compatible/ The instruction on the page here seems wrong:- sed -i -e 's|mail_plugins = quota|mail_plugins = quotann# Enable fts fts_solr plugin globally for Solr Full Text Search Indexingnmail_plugins = $mail_plugins fts fts_solrnnplugin {nfts = solrn#break-imap-search will use solr for indexing TEXT and BODY searches.nfts_solr = break-imap-search url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn}|' /etc/dovecot.conf I would appreciate if someone could help correct the parameters for the dovecot.conf output shown below. Please help. [root at mail tmp]# cat /etc/dovecot/dovecot.conf # Listen addresses. # - '*' means all available IPv4 addresses. # - '[::]' means all available IPv6 addresses. # Listen on all available addresses by default listen = * [::] #base_dir = /var/run/dovecot mail_plugins = quotann# Enable fts fts_solr plugin globally for Solr Full Text Search Indexingnmail_plugins = $mail_plugins fts fts_solrnnplugin {nfts = solrn#break-imap-search will use solr for indexing TEXT and BODY searches.nfts_solr = break-imap-search url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn} acl # Enabled mail protocols. protocols = pop3 imap sieve lmtp # User/group who owns the message files: mail_uid = 2000 mail_gid = 2000 # Assign uid to virtual users. first_valid_uid = 2000 last_valid_uid = 2000 # Logging. Reference: http://wiki2.dovecot.org/Logging log_path = /var/log/dovecot.log mail_debug = no auth_verbose = no auth_debug = no auth_debug_passwords = no # Possible values: no, plain, sha1. auth_verbose_passwords = no # SSL: Global settings. # Refer to wiki site for per protocol, ip, server name SSL settings: # http://wiki2.dovecot.org/SSL/DovecotConfiguration ssl_protocols = !SSLv2 !SSLv3 ssl = required verbose_ssl = no #ssl_ca = References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <55326599.7020800@blackrosetech.com> <7F3CF7E0-E6BB-426F-AE90-D5375EEEC091@pettijohn-web.com> Message-ID: <55329396.6060309@blackrosetech.com> -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Edgar Pettijohn III To: David Gessel Date: Sat Apr 18 2015 17:20:30 GMT+0300 (Arabic Standard Time) > > On Apr 18, 2015, at 9:09 AM, David Gessel wrote: > >> Edgar, thanks for the help! >> >> -------- Original Message -------- >> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads >> From: Edgar Pettijohn III >> To: David Gessel >> Date: Sat Apr 18 2015 16:30:07 GMT+0300 (Arabic Standard Time) >> >>> >>> On Apr 18, 2015, at 8:00 AM, David Gessel wrote: >>> >>>> >>>> >>>> -------- Original Message -------- >>>> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads >>>> From: Timo Sirainen >>>> To: David Gessel >>>> Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time) >>>> >>>>> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. >>>> >>>> >>>> Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. >>> >>> >>> >>> What is the output for: >>> >>> # zpool status >>> >>> perhaps you have a hardware issue? >>> >> >> All good - quite reliable hardware: IBM x3655 dual AMD quad core, 40GB of ECC RAM, 8x IBM 2.5" SAS on battery-backed ServeRAID, RAID 6 and (somewhat pointlessly) ZFS2. All IBM server diagnostics check, full RAM check run without errors, no ECC corrections reported, no uncorrectable errors reported. >> >> >> >> # zpool status >> pool: bootpool >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> bootpool ONLINE 0 0 0 >> aacd0s1a ONLINE 0 0 0 >> >> errors: No known data errors >> >> pool: zroot >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zroot ONLINE 0 0 0 >> aacd0s1d.eli ONLINE 0 0 0 >> >> errors: No known data errors > > > are you using compression? If so which. > Yes, lz4. From gessel at blackrosetech.com Sat Apr 18 17:35:28 2015 From: gessel at blackrosetech.com (David Gessel) Date: Sat, 18 Apr 2015 20:35:28 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> Message-ID: <553295E0.9050106@blackrosetech.com> -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Sat Apr 18 2015 17:38:02 GMT+0300 (Arabic Standard Time) > Actually as a workaround you could try maildir_very_dirty_syncs=yes which gets rid of most of the readdir()s. Enabled. I can't read that option without hearing Bubbles say it. Might this also help: maildir_broken_filename_sizes = yes I was a little suspicious of sizes and had considered running your maildir-size-fix.pl script. They did come from Courier and after 10 years or more of operation, the risk of cruftiness is high. However, I thought it was a long shot as I IMAP-Synced to the new directory so the directory was built by dovecot... right? I mean it wasn't a # mv operation. -David From gessel at blackrosetech.com Sat Apr 18 17:35:40 2015 From: gessel at blackrosetech.com (David Gessel) Date: Sat, 18 Apr 2015 20:35:40 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> Message-ID: <553295EC.8020208@blackrosetech.com> THANKS TIMO! -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Sat Apr 18 2015 17:38:02 GMT+0300 (Arabic Standard Time) > Actually as a workaround you could try maildir_very_dirty_syncs=yes which gets rid of most of the readdir()s. I will try that right now and report any differences in behavior! From ml+dovecot at valo.at Sat Apr 18 17:49:21 2015 From: ml+dovecot at valo.at (Christian Kivalo) Date: Sat, 18 Apr 2015 19:49:21 +0200 Subject: Installing fts-solr on dovecot (centos 6) - [request for help] In-Reply-To: References: Message-ID: On 2015-04-18 19:23, Kevin Laurie wrote: > Hello, Hello, > I have been trying to get full-text-search on dovecot. I followed the > tutorial on this site:- > https://extremeshok.com/6622/enabling-apache-solr-4-10-using-jetty-with-dovecot-2-2-for-fulltext-search-results-on-centos-6-iredmail-compatible/ > > The instruction on the page here seems wrong:- > sed -i -e 's|mail_plugins = quota|mail_plugins = quotann# Enable fts > fts_solr plugin globally for Solr Full Text Search > Indexingnmail_plugins = $mail_plugins fts fts_solrnnplugin {nfts = > solrn#break-imap-search will use solr for indexing TEXT and BODY > searches.nfts_solr = break-imap-search > url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn}|' > /etc/dovecot.conf > it seems the \ is missing in front of some "n"s therefore your missing some newlines... > I would appreciate if someone could help correct the parameters for > the dovecot.conf output shown below. Please help. > > > > [root at mail tmp]# cat /etc/dovecot/dovecot.conf > > # Listen addresses. > # - '*' means all available IPv4 addresses. > # - '[::]' means all available IPv6 addresses. > # Listen on all available addresses by default > listen = * [::] > > #base_dir = /var/run/dovecot > mail_plugins = quotann# Enable fts fts_solr plugin globally for Solr > Full Text Search Indexingnmail_plugins = $mail_plugins fts > fts_solrnnplugin {nfts = solrn#break-imap-search will use solr for > indexing TEXT and BODY searches.nfts_solr = break-imap-search > url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn} acl > the above should read with proper newlines: #base_dir = /var/run/dovecot mail_plugins = quota # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing mail_plugins = $mail_plugins fts fts_solr plugin { fts = solr #break-imap-search will use solr for indexing TEXT and BODY searches. fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ fts_autoindex = yes } acl > > protocol lmtp { > # Log file > info_log_path = /var/log/dovecot-lmtp.log > > # Plugins > mail_plugins = quotann# Enable fts fts_solr plugin globally for > Solr Full Text Search Indexingnmail_plugins = $mail_plugins fts > fts_solrnnplugin {nfts = solrn#break-imap-search will use solr for > indexing TEXT and BODY searches.nfts_solr = break-imap-search > url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn} sieve > postmaster_address = postmaster > > lmtp_save_to_detail_mailbox = yes > recipient_delimiter = + and again correct the above part of your config # Plugins mail_plugins = quota # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing mail_plugins = $mail_plugins fts fts_solr plugin { fts = solr #break-imap-search will use solr for indexing TEXT and BODY searches. fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ fts_autoindex = yes } sieve postmaster_address = postmaster my config looks as above and its working fine. hth -c From superinterstellar at gmail.com Sat Apr 18 18:14:01 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Sun, 19 Apr 2015 01:14:01 +0700 Subject: Installing fts-solr on dovecot (centos 6) - [request for help] In-Reply-To: References: Message-ID: hey Christian, Thanks so much for your feedback. I am still getting an error. [root at mail tmp]# nano /etc/dovecot/dovecot.conf [root at mail tmp]# service dovecot restart Stopping Dovecot Imap: [FAILED] Starting Dovecot Imap: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 19: Expecting '=' doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 19: Expecting '=' [FAILED] Below is the output of dovecot.conf. Cant figure out why. [root at mail tmp]# cat /etc/dovecot/dovecot.conf # Listen addresses. # - '*' means all available IPv4 addresses. # - '[::]' means all available IPv6 addresses. # Listen on all available addresses by default listen = * [::] #base_dir = /var/run/dovecot mail_plugins = quota # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing mail_plugins = $mail_plugins fts fts_solr plugin { fts = solr #break-imap-search will use solr for indexing TEXT and BODY searches. fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ fts_autoindex = yes } acl # Enabled mail protocols. protocols = pop3 imap sieve lmtp # User/group who owns the message files: mail_uid = 2000 mail_gid = 2000 # Assign uid to virtual users. first_valid_uid = 2000 last_valid_uid = 2000 # Logging. Reference: http://wiki2.dovecot.org/Logging log_path = /var/log/dovecot.log mail_debug = no auth_verbose = no auth_debug = no auth_debug_passwords = no # Possible values: no, plain, sha1. auth_verbose_passwords = no # SSL: Global settings. # Refer to wiki site for per protocol, ip, server name SSL settings: # http://wiki2.dovecot.org/SSL/DovecotConfiguration ssl_protocols = !SSLv2 !SSLv3 ssl = required verbose_ssl = no #ssl_ca = wrote: > On 2015-04-18 19:23, Kevin Laurie wrote: >> >> Hello, > > Hello, >> >> I have been trying to get full-text-search on dovecot. I followed the >> tutorial on this site:- >> >> https://extremeshok.com/6622/enabling-apache-solr-4-10-using-jetty-with-dovecot-2-2-for-fulltext-search-results-on-centos-6-iredmail-compatible/ >> >> The instruction on the page here seems wrong:- >> sed -i -e 's|mail_plugins = quota|mail_plugins = quotann# Enable fts >> fts_solr plugin globally for Solr Full Text Search >> Indexingnmail_plugins = $mail_plugins fts fts_solrnnplugin {nfts = >> solrn#break-imap-search will use solr for indexing TEXT and BODY >> searches.nfts_solr = break-imap-search >> url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn}|' >> /etc/dovecot.conf >> > it seems the \ is missing in front of some "n"s therefore your missing some > newlines... > >> I would appreciate if someone could help correct the parameters for >> the dovecot.conf output shown below. Please help. >> >> >> >> [root at mail tmp]# cat /etc/dovecot/dovecot.conf >> >> # Listen addresses. >> # - '*' means all available IPv4 addresses. >> # - '[::]' means all available IPv6 addresses. >> # Listen on all available addresses by default >> listen = * [::] >> >> #base_dir = /var/run/dovecot >> mail_plugins = quotann# Enable fts fts_solr plugin globally for Solr >> Full Text Search Indexingnmail_plugins = $mail_plugins fts >> fts_solrnnplugin {nfts = solrn#break-imap-search will use solr for >> indexing TEXT and BODY searches.nfts_solr = break-imap-search >> url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn} acl >> > the above should read with proper newlines: > #base_dir = /var/run/dovecot > mail_plugins = quota > > # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing > mail_plugins = $mail_plugins fts fts_solr > > plugin { > fts = solr > #break-imap-search will use solr for indexing TEXT and BODY searches. > fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ > fts_autoindex = yes > } acl > >> >> protocol lmtp { >> # Log file >> info_log_path = /var/log/dovecot-lmtp.log >> >> # Plugins >> mail_plugins = quotann# Enable fts fts_solr plugin globally for >> Solr Full Text Search Indexingnmail_plugins = $mail_plugins fts >> fts_solrnnplugin {nfts = solrn#break-imap-search will use solr for >> indexing TEXT and BODY searches.nfts_solr = break-imap-search >> url=http://127.0.0.1:8983/solr/nfts_autoindex = yesn} sieve >> postmaster_address = postmaster >> >> lmtp_save_to_detail_mailbox = yes >> recipient_delimiter = + > > and again correct the above part of your config > > # Plugins > mail_plugins = quota > > # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing > mail_plugins = $mail_plugins fts fts_solr > > plugin { > fts = solr > #break-imap-search will use solr for indexing TEXT and BODY searches. > fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ > fts_autoindex = yes > } sieve > postmaster_address = postmaster > > my config looks as above and its working fine. > > hth > -c From edgar at pettijohn-web.com Sat Apr 18 18:24:08 2015 From: edgar at pettijohn-web.com (Edgar Pettijohn III) Date: Sat, 18 Apr 2015 13:24:08 -0500 Subject: Please help: error after upgrade to version 2.1.16 In-Reply-To: References: Message-ID: <4AD30054-1121-4888-9379-6DCFD2CBD5D0@pettijohn-web.com> I think you may need something similar to: protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = _smtpd mode = 0666 user = _smtpd } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } From ml+dovecot at valo.at Sat Apr 18 18:39:22 2015 From: ml+dovecot at valo.at (Christian Kivalo) Date: Sat, 18 Apr 2015 20:39:22 +0200 Subject: Installing fts-solr on dovecot (centos 6) - [request for help] In-Reply-To: References: Message-ID: <84be0c307854fb1cfc412d27c438e504@valo.at> Am 18. April 2015 20:14:01 MESZ, schrieb Kevin Laurie : > hey Christian, > Thanks so much for your feedback. I am still getting an error. Hi Kevin, You're welcome. > > [root at mail tmp]# nano /etc/dovecot/dovecot.conf > [root at mail tmp]# service dovecot restart > Stopping Dovecot Imap: [FAILED] > Starting Dovecot Imap: doveconf: Fatal: Error in configuration file > /etc/dovecot/dovecot.conf line 19: Expecting '=' > doveconf: Error: managesieve-login: dump-capability process returned 89 > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf > line 19: Expecting '=' > [FAILED] > lets take a look at line 19... > > Below is the output of dovecot.conf. Cant figure out why. > > > [root at mail tmp]# cat /etc/dovecot/dovecot.conf > > # Listen addresses. > # - '*' means all available IPv4 addresses. > # - '[::]' means all available IPv6 addresses. > # Listen on all available addresses by default > listen = * [::] > > #base_dir = /var/run/dovecot > mail_plugins = quota > > # Enable fts fts_solr plugin globally for Solr Full Text Search > Indexing > mail_plugins = $mail_plugins fts fts_solr > > plugin { > fts = solr > #break-imap-search will use solr for indexing TEXT and BODY searches. > fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ > fts_autoindex = yes > } acl remove acl and you should be good. hth - c From Harald.Langner at gmx.de Sat Apr 18 19:16:49 2015 From: Harald.Langner at gmx.de (Harald Langner) Date: Sat, 18 Apr 2015 21:16:49 +0200 Subject: Aw: Re: Please help: error after upgrade to version 2.1.16 In-Reply-To: <4AD30054-1121-4888-9379-6DCFD2CBD5D0@pettijohn-web.com> References: , <4AD30054-1121-4888-9379-6DCFD2CBD5D0@pettijohn-web.com> Message-ID: thanks, but I do not understand was has a new configuration to do with my auth-Problem? My configuration settings has worked before the Update to 2.1.16. I have not see that the update has changed some of my config-files. ? Gesendet:?Samstag, 18. April 2015 um 20:24 Uhr Von:?"Edgar Pettijohn III" An:?"Dovecot Mailing List" Betreff:?Re: Please help: error after upgrade to version 2.1.16 I think you may need something similar to: protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = _smtpd mode = 0666 user = _smtpd } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } From edgar at pettijohn-web.com Sat Apr 18 19:51:27 2015 From: edgar at pettijohn-web.com (Edgar Pettijohn III) Date: Sat, 18 Apr 2015 14:51:27 -0500 Subject: Please help: error after upgrade to version 2.1.16 In-Reply-To: References: , <4AD30054-1121-4888-9379-6DCFD2CBD5D0@pettijohn-web.com> Message-ID: <0FF2AD9B-38C9-40F1-BE39-D5C986CD3DCE@pettijohn-web.com> On Apr 18, 2015, at 2:16 PM, Harald Langner wrote: > > thanks, > but I do not understand was has a new configuration to do with my auth-Problem? > > My configuration settings has worked before the Update to 2.1.16. I have not see that the update has changed some of my config-files. > What version did you upgrade from? > > Gesendet: Samstag, 18. April 2015 um 20:24 Uhr > Von: "Edgar Pettijohn III" > An: "Dovecot Mailing List" > Betreff: Re: Please help: error after upgrade to version 2.1.16 > I think you may need something similar to: > > protocols = imap pop3 lmtp sieve > service auth { > unix_listener auth-userdb { > group = _smtpd > mode = 0666 > user = _smtpd > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > inet_listener sieve_deprecated { > port = 2000 > } > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } From superinterstellar at gmail.com Sat Apr 18 20:02:53 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Sun, 19 Apr 2015 03:02:53 +0700 Subject: Installing fts-solr on dovecot (centos 6) - [request for help] In-Reply-To: <84be0c307854fb1cfc412d27c438e504@valo.at> References: <84be0c307854fb1cfc412d27c438e504@valo.at> Message-ID: Dear Christian, I guess its working now. Now I have to test it. *fingers crossed* Appreciate your help Thanks once again Kevin On Sun, Apr 19, 2015 at 1:39 AM, Christian Kivalo wrote: > Am 18. April 2015 20:14:01 MESZ, schrieb Kevin Laurie > : >> >> hey Christian, >> Thanks so much for your feedback. I am still getting an error. > > > Hi Kevin, > > You're welcome. > >> >> [root at mail tmp]# nano /etc/dovecot/dovecot.conf >> [root at mail tmp]# service dovecot restart >> Stopping Dovecot Imap: [FAILED] >> Starting Dovecot Imap: doveconf: Fatal: Error in configuration file >> /etc/dovecot/dovecot.conf line 19: Expecting '=' >> doveconf: Error: managesieve-login: dump-capability process returned 89 >> doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf >> line 19: Expecting '=' >> [FAILED] >> > > lets take a look at line 19... > >> >> Below is the output of dovecot.conf. Cant figure out why. >> >> >> [root at mail tmp]# cat /etc/dovecot/dovecot.conf >> >> # Listen addresses. >> # - '*' means all available IPv4 addresses. >> # - '[::]' means all available IPv6 addresses. >> # Listen on all available addresses by default >> listen = * [::] >> >> #base_dir = /var/run/dovecot >> mail_plugins = quota >> >> # Enable fts fts_solr plugin globally for Solr Full Text Search >> Indexing >> mail_plugins = $mail_plugins fts fts_solr >> >> plugin { >> fts = solr >> #break-imap-search will use solr for indexing TEXT and BODY searches. >> fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ >> fts_autoindex = yes >> } acl > > > remove acl and you should be good. > > hth > - c From superinterstellar at gmail.com Sat Apr 18 20:05:01 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Sun, 19 Apr 2015 03:05:01 +0700 Subject: Authentication Error with Dovecot Message-ID: Hello, I have some email authentication error with dovecot. Could someone tell me what is the problem that is indicated below? Is it due to some plugin? Apr 18 21:56:35 auth-worker(2057): Info: mysql(127.0.0.1): Connected to database vmail Apr 18 21:56:35 imap-login: Info: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=2058, secured, session= Apr 18 21:56:35 imap: Error: Can't load plugin imap_acl_plugin: Plugin acl must be loaded also (you must set: mail_plugins=$mail_plugins acl) Apr 18 21:56:35 imap: Fatal: Couldn't load required plugins Apr 18 21:56:53 imap-login: Info: Disconnected (auth failed, 1 attempts in 2 secs): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured, session= Apr 18 21:57:05 imap-login: Info: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=2065, secured, session=<5tmoGQUUjQB/AAAB> Apr 18 21:57:05 imap: Error: Can't load plugin imap_acl_plugin: Plugin acl must be loaded also (you must set: mail_plugins=$mail_plugins acl) Apr 18 21:57:05 imap: Fatal: Couldn't load required plugins From ml+dovecot at valo.at Sat Apr 18 20:11:26 2015 From: ml+dovecot at valo.at (Christian Kivalo) Date: Sat, 18 Apr 2015 22:11:26 +0200 Subject: Authentication Error with Dovecot In-Reply-To: References: Message-ID: <0CCDDD12-0BC9-4148-914D-DB8E4B784668@valo.at> Am 18. April 2015 22:05:01 MESZ, schrieb Kevin Laurie : >Hello, >I have some email authentication error with dovecot. >Could someone tell me what is the problem that is indicated below? >Is it due to some plugin? > yes as the log says > >Apr 18 21:56:35 auth-worker(2057): Info: mysql(127.0.0.1): Connected >to database vmail >Apr 18 21:56:35 imap-login: Info: Login: user=, >method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=2058, secured, >session= >Apr 18 21:56:35 imap: Error: Can't load plugin imap_acl_plugin: Plugin >acl must be loaded also (you must set: mail_plugins=$mail_plugins acl) you should load the acl plugin... seems the "acl" entry from your last mail is now missing. -c From superinterstellar at gmail.com Sat Apr 18 20:22:07 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Sun, 19 Apr 2015 03:22:07 +0700 Subject: Authentication Error with Dovecot In-Reply-To: <0CCDDD12-0BC9-4148-914D-DB8E4B784668@valo.at> References: <0CCDDD12-0BC9-4148-914D-DB8E4B784668@valo.at> Message-ID: Hi Christian, I tried to amend the acl the last time but it kept giving me error stating "=" was needed. Could you please just help me amend the file below with where you have the acl plugin appended . Thanks Kevin # Listen addresses. # - '*' means all available IPv4 addresses. # - '[::]' means all available IPv6 addresses. # Listen on all available addresses by default listen = * [::] #base_dir = /var/run/dovecot mail_plugins = quota # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing mail_plugins = $mail_plugins fts fts_solr plugin { fts = solr #break-imap-search will use solr for indexing TEXT and BODY searches. fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ fts_autoindex = yes } # Enabled mail protocols. protocols = pop3 imap sieve lmtp # User/group who owns the message files: mail_uid = 2000 mail_gid = 2000 # Assign uid to virtual users. first_valid_uid = 2000 last_valid_uid = 2000 # Logging. Reference: http://wiki2.dovecot.org/Logging log_path = /var/log/dovecot.log mail_debug = no auth_verbose = no auth_debug = no auth_debug_passwords = no # Possible values: no, plain, sha1. auth_verbose_passwords = no # SSL: Global settings. # Refer to wiki site for per protocol, ip, server name SSL settings: # http://wiki2.dovecot.org/SSL/DovecotConfiguration ssl_protocols = !SSLv2 !SSLv3 ssl = required verbose_ssl = no #ssl_ca = wrote: > > > Am 18. April 2015 22:05:01 MESZ, schrieb Kevin Laurie : >>Hello, >>I have some email authentication error with dovecot. >>Could someone tell me what is the problem that is indicated below? >>Is it due to some plugin? >> > yes as the log says > >> >>Apr 18 21:56:35 auth-worker(2057): Info: mysql(127.0.0.1): Connected >>to database vmail >>Apr 18 21:56:35 imap-login: Info: Login: user=, >>method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=2058, secured, >>session= >>Apr 18 21:56:35 imap: Error: Can't load plugin imap_acl_plugin: Plugin >>acl must be loaded also (you must set: mail_plugins=$mail_plugins acl) > you should load the acl plugin... seems the "acl" entry from your last mail is now missing. > > -c From ml+dovecot at valo.at Sat Apr 18 20:45:30 2015 From: ml+dovecot at valo.at (Christian Kivalo) Date: Sat, 18 Apr 2015 22:45:30 +0200 Subject: Authentication Error with Dovecot In-Reply-To: References: <0CCDDD12-0BC9-4148-914D-DB8E4B784668@valo.at> Message-ID: Am 18. April 2015 22:22:07 MESZ, schrieb Kevin Laurie : >Hi Christian, Hi Kevin, >I tried to amend the acl the last time but it kept giving me error >stating "=" was needed. Could you please just help me amend the file >below with where you have the acl plugin appended . i will try to help but i dont use the acl plugin. >Thanks >Kevin > see http://wiki2.dovecot.org/ACL > > > ># Listen addresses. ># - '*' means all available IPv4 addresses. ># - '[::]' means all available IPv6 addresses. ># Listen on all available addresses by default >listen = * [::] > >#base_dir = /var/run/dovecot >mail_plugins = quota you should probably add acl after the quota hth -c From superinterstellar at gmail.com Sat Apr 18 20:52:03 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Sun, 19 Apr 2015 03:52:03 +0700 Subject: Authentication Error with Dovecot In-Reply-To: References: <0CCDDD12-0BC9-4148-914D-DB8E4B784668@valo.at> Message-ID: Dear Christian, Yes. It works now. Thanks a bunch. Kevin On Sun, Apr 19, 2015 at 3:45 AM, Christian Kivalo wrote: > > > Am 18. April 2015 22:22:07 MESZ, schrieb Kevin Laurie : >>Hi Christian, > Hi Kevin, > >>I tried to amend the acl the last time but it kept giving me error >>stating "=" was needed. Could you please just help me amend the file >>below with where you have the acl plugin appended . > > i will try to help but i dont use the acl plugin. > >>Thanks >>Kevin >> > see http://wiki2.dovecot.org/ACL > >> >> >> >># Listen addresses. >># - '*' means all available IPv4 addresses. >># - '[::]' means all available IPv6 addresses. >># Listen on all available addresses by default >>listen = * [::] >> >>#base_dir = /var/run/dovecot >>mail_plugins = quota > you should probably add acl after the quota > > hth > -c From gessel at blackrosetech.com Sun Apr 19 02:34:06 2015 From: gessel at blackrosetech.com (David Gessel) Date: Sun, 19 Apr 2015 05:34:06 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <553295EC.8020208@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> <553295EC.8020208@blackrosetech.com> Message-ID: <5533141E.80503@blackrosetech.com> -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: David Gessel To: Timo Sirainen Date: Sat Apr 18 2015 20:35:40 GMT+0300 (Arabic Standard Time) > THANKS TIMO! > > -------- Original Message -------- > Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads > From: Timo Sirainen > To: David Gessel > Date: Sat Apr 18 2015 17:38:02 GMT+0300 (Arabic Standard Time) > >> Actually as a workaround you could try maildir_very_dirty_syncs=yes which gets rid of most of the readdir()s. > > I will try that right now and report any differences in behavior! > Alas, it hasn't solved the problem - still getting duplicate messages in thunderbird. So far it appears that mulberry is a little happier, but I find some messages are missing - such as the archive of the dovecot mailing list jumping from 2015-03-21 to 2015-04-14. I tried # rm -r dovecot.id* Would "maildir_broken_filename_sizes = yes" have any impact? If it does, then I'd think your fix sizes script would be worth a try. If all that fails - is there any reason to think that sdbox will be better behaved? -David From CMarcus at Media-Brokers.com Sun Apr 19 13:00:47 2015 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 19 Apr 2015 09:00:47 -0400 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <5533141E.80503@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> <553295EC.8020208@blackrosetech.com> <5533141E.80503@blackrosetech.com> Message-ID: <5533A6FF.4030401@Media-Brokers.com> Since you have confirmed that someone else you know is using it on FreeBSD+ZFS without these problems, have you tried asking on the FreeBSD support list(s)? Seems like that may be your best bet, since it is certainly not a generic dovecot problem (but may indeed be one or more of the settings you are using)... You could also go ahead and post the diff of your config and your friends (I'm fairly sure this list is small attachment friendly, but I recommend pasted it in the email body anyway) and see if anything jumps out at anyone/Timo... On 4/18/2015 10:34 PM, David Gessel wrote: > > -------- Original Message -------- > Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads > From: David Gessel > To: Timo Sirainen > Date: Sat Apr 18 2015 20:35:40 GMT+0300 (Arabic Standard Time) > >> THANKS TIMO! >> >> -------- Original Message -------- >> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads >> From: Timo Sirainen >> To: David Gessel >> Date: Sat Apr 18 2015 17:38:02 GMT+0300 (Arabic Standard Time) >> >>> Actually as a workaround you could try maildir_very_dirty_syncs=yes which gets rid of most of the readdir()s. >> I will try that right now and report any differences in behavior! >> > Alas, it hasn't solved the problem - still getting duplicate messages in thunderbird. So far it appears that mulberry is a little happier, but I find some messages are missing - such as the archive of the dovecot mailing list jumping from 2015-03-21 to 2015-04-14. > > I tried # rm -r dovecot.id* > > Would "maildir_broken_filename_sizes = yes" have any impact? If it does, then I'd think your fix sizes script would be worth a try. > > If all that fails - is there any reason to think that sdbox will be better behaved? > > -David > From marton.peter at gmail.com Mon Apr 20 08:53:21 2015 From: marton.peter at gmail.com (=?UTF-8?B?UMOpdGVyIE3DoXJ0b24=?=) Date: Mon, 20 Apr 2015 10:53:21 +0200 Subject: userdb username changed In-Reply-To: References: Message-ID: > something strange. It seems that despite the "username changed" line, > auth returns the original username: > sql(ppp at example.net): username changed ppp at example.net -> uppp > Apr 17 09:27:34 imap21 dovecot: auth: Debug: userdb out: > USER#0111#011ppp at example.net#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024 > # 2.2.15: /etc/dovecot/dovecot.conf Hi! 2.2.16 produces the same. :( Regards, Peter From marton.peter at gmail.com Mon Apr 20 13:09:43 2015 From: marton.peter at gmail.com (=?UTF-8?B?UMOpdGVyIE3DoXJ0b24=?=) Date: Mon, 20 Apr 2015 15:09:43 +0200 Subject: userdb username change ignored when using (My)SQL was: Re: userdb username changed Message-ID: Hi! It works when using LDAP. I've duplicated the "username change" debug line, just to see that the variables are really updated: Apr 20 14:30:27 imap21 dovecot: auth-worker(27127): Debug: sql(ppp at example.net): username changed ppp at example.net -> uppp Apr 20 14:30:27 imap21 dovecot: auth-worker(27127): Debug: sql(uppp): username changed uppp -> uppp Apr 20 14:30:27 imap21 dovecot: auth: Debug: userdb out: USER#0111#011ppp at example.net#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024 And the answer is of course yes. Just the userdb out string has the wrong value. The right value is lost somewhere. But where? Regards, Peter Log of the (for me unusable) LDAP query: Apr 20 14:28:07 imap21 dovecot: auth: Debug: master in: USER#0111#011m2500j6#011service=doveadm Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(m2500j6): user search: base=ou=Users,ou=Mail,dc=bnet,dc=at scope=subtree filter=(uid=m2500j6) fields=mailHost Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(m2500j6): result: mailHost=localhost; mailHost unused Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(m2500j6): username changed m2500j6 -> localhost Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(localhost): username changed localhost -> localhost Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(localhost): result: mailHost=localhost Apr 20 14:28:07 imap21 dovecot: auth: Debug: userdb out: USER#0111#011localhost#011 From d.kuhn at heinlein-support.de Mon Apr 20 16:10:43 2015 From: d.kuhn at heinlein-support.de (Dennis Kuhn) Date: Mon, 20 Apr 2015 18:10:43 +0200 Subject: doveadm-server hangs with 100% cpu usage Message-ID: <55352503.5020703@heinlein-support.de> we have some replication issues. From time to time a doveadm-server process takes 100% cpu in the state recv_mailbox_tree_deletes on the replica. The process runs forever until it is manually killed. Strace on this process doesn't show anything. Sometimes we have several doveadm-server processes in this state, all for the same account, all with 100% CPU Load. The logfile on the master says: Error: Timeout during state=recv_mailbox_tree Error: dsync(dobby5.heinlein-support.de): I/O has stalled, no activity for 600 seconds My workaround is to delete the user directory on the replica so that the whole account is replicated again. This solves the problem for this specific account. The dovecot version is 2.2.15 on the master and 2.2.16 on the replica. Dennis Kuhn -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-57 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From d.kuhn at heinlein-support.de Mon Apr 20 16:19:23 2015 From: d.kuhn at heinlein-support.de (Dennis Kuhn) Date: Mon, 20 Apr 2015 18:19:23 +0200 Subject: doveadm-server hangs with 100% cpu usage In-Reply-To: <55352503.5020703@heinlein-support.de> References: <55352503.5020703@heinlein-support.de> Message-ID: <5535270B.9020400@heinlein-support.de> On 20.04.2015 18:10, Dennis Kuhn wrote: > > The dovecot version is 2.2.15 on the master and 2.2.16 on the replica. > we had the same problems when both servers were on version 2.2.15. From gessel at blackrosetech.com Mon Apr 20 18:29:44 2015 From: gessel at blackrosetech.com (David Gessel) Date: Mon, 20 Apr 2015 21:29:44 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <5533A6FF.4030401@Media-Brokers.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> <553295EC.8020208@blackrosetech.com> <5533141E.80503@blackrosetech.com> <5533A6FF.4030401@Media-Brokers.com> Message-ID: <55354598.6060005@blackrosetech.com> Charles, Thank you for your kind offer. I've sent a message with both the standard diff and an HTML attachment comparison that I find a lot easier to read. It awaits moderator approval due to size. -David From superinterstellar at gmail.com Tue Apr 21 04:35:49 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Tue, 21 Apr 2015 11:35:49 +0700 Subject: cant see all users - need to create symlink between mailboxes [request for help] Message-ID: Hi, I need to create a symlink to share mailboxes. I tried to check at : cd /var/mail/ but I cant see all the mailboxes. Could someone advise how to do this? I am trying to achieve as showing in tutorial here:- http://wiki.dovecot.org/SharedMailboxes/Symlinks Below is the details of my dovecot.conf Appreciate if anyone can help. # Listen addresses. # - '*' means all available IPv4 addresses. # - '[::]' means all available IPv6 addresses. # Listen on all available addresses by default listen = * [::] #base_dir = /var/run/dovecot mail_plugins = quota acl # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing mail_plugins = $mail_plugins fts fts_solr plugin { fts = solr #break-imap-search will use solr for indexing TEXT and BODY searches. fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ fts_autoindex = yes } # Enabled mail protocols. protocols = pop3 imap sieve lmtp # User/group who owns the message files: mail_uid = 2000 mail_gid = 2000 # Assign uid to virtual users. first_valid_uid = 2000 last_valid_uid = 2000 # Logging. Reference: http://wiki2.dovecot.org/Logging log_path = /var/log/dovecot.log mail_debug = no auth_verbose = no auth_debug = no auth_debug_passwords = no # Possible values: no, plain, sha1. auth_verbose_passwords = no # SSL: Global settings. # Refer to wiki site for per protocol, ip, server name SSL settings: # http://wiki2.dovecot.org/SSL/DovecotConfiguration ssl_protocols = !SSLv2 !SSLv3 ssl = required verbose_ssl = no #ssl_ca = References: Message-ID: <5535F409.2070407@whyscream.net> On 20-04-15 15:09, P?ter M?rton wrote: > Hi! > > It works when using LDAP. > I've duplicated the "username change" debug line, just to see that the > variables are really updated: > > Apr 20 14:30:27 imap21 dovecot: auth-worker(27127): Debug: > sql(ppp at example.net): username changed ppp at example.net -> uppp > Apr 20 14:30:27 imap21 dovecot: auth-worker(27127): Debug: sql(uppp): > username changed uppp -> uppp > Apr 20 14:30:27 imap21 dovecot: auth: Debug: userdb out: > USER#0111#011ppp at example.net#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024 > > And the answer is of course yes. Just the userdb out string has the wrong value. > The right value is lost somewhere. But where? Your messages to this list seem to miss a feature that is very welcome on this kind of mailing lists: an actual problem or an issue you want to fix. When users can login and the username change is intended (as can be concluded from your comments), then what is the problem you're reporting? Are you trying to reporting the fact that the auth debug output has the wrong username value? If not, what is it you're to tell us? :) > > Regards, > > Peter > > > Log of the (for me unusable) LDAP query: > > Apr 20 14:28:07 imap21 dovecot: auth: Debug: master in: > USER#0111#011m2500j6#011service=doveadm > Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(m2500j6): user > search: base=ou=Users,ou=Mail,dc=bnet,dc=at scope=subtree > filter=(uid=m2500j6) fields=mailHost > Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(m2500j6): result: > mailHost=localhost; mailHost unused > Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(m2500j6): username > changed m2500j6 -> localhost > Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(localhost): username > changed localhost -> localhost > Apr 20 14:28:07 imap21 dovecot: auth: Debug: ldap(localhost): result: > mailHost=localhost > Apr 20 14:28:07 imap21 dovecot: auth: Debug: userdb out: > USER#0111#011localhost#011 > From marton.peter at gmail.com Tue Apr 21 08:20:40 2015 From: marton.peter at gmail.com (=?UTF-8?B?UMOpdGVyIE3DoXJ0b24=?=) Date: Tue, 21 Apr 2015 10:20:40 +0200 Subject: userdb username change ignored when using (My)SQL was: Re: userdb username changed In-Reply-To: <5535F409.2070407@whyscream.net> References: <5535F409.2070407@whyscream.net> Message-ID: >> And the answer is of course yes. Just the userdb out string has the wrong value. >> The right value is lost somewhere. But where? > > Your messages to this list seem to miss a feature that is very welcome > on this kind of mailing lists: an actual problem or an issue you want to > fix. I'm sorry that i wasn't able to formulate my problem correctly. :) I try to elaborate: If you read the config in my original message, and read the logs (line by line), then you will notice the following facts: 1. The username change is intended. 2. The log says, that the username change is happening as it should. 3. The log says, that the "userdb out" contains the original (not changed) username. 4. With passdb it works correctly: "passdb out" contains the right (changed) username. Outcome 1.: Fact 3 means, that any service which calls for userdb lookup will get a wrong username. Wrong means here that it's not the username intended for userdb lookup callers. Outcome 2.: For me, fact 4 says that it was the developers intention to be able to change the username. Eg.: to give *db lookup callers a changed username, not the original as entered by the user. But outcome 1. and 2. contradicts each other. That gave me three possible conclusions: a. I made some mistake b. my assumption(s) was/were wrong c. Someone else made a mistake (it's a bug) But i couldn't find out which is the correct, soooo i sent my original message to the list. And while i tried to confute "conclusion b." i tried the whole process with LDAP. With success. LDAP userdb lookup returns the changed username. Here we are now. :) Thank you, if you read it until here. My only excuse for not writing all that in my original message is that i wanted to keep my problem description clean and simple. In my 23 years of history on technical electronic messaging boards, i've been told many many times that i write irrelevant informations in my messages. (like this) :) And i assumed i couldn't change... :) > > When users can login and the username change is intended (as can be > concluded from your comments), then what is the problem you're reporting? > > Are you trying to reporting the fact that the auth debug output has the > wrong username value? If not, what is it you're to tell us? :) I hope that the debug output is a trustful source of information. But who knows? It would be my third assumption proved wrong - today. And all my struggle just to be able to use quota-status service with postfix. With unauthenticated senders, postfix only sends the recipient address (beside many irrelevant data) to the policy service (quota-status). So userdb has to use the email address to lookup up the quota rule, and to give a username to quota-dict for lookup. My usernames are sadly not email addresses, thats why i had to make query which resolves addresses to usernames. The whole problem started here. Regards, Peter From bluewind at xinu.at Tue Apr 21 09:24:55 2015 From: bluewind at xinu.at (Florian Pritz) Date: Tue, 21 Apr 2015 11:24:55 +0200 Subject: [BUG] imap-login segfault when running nmap -sV Message-ID: <55361767.1040900@xinu.at> Hi, I've noticed that nmap crashes my imap-login (also pop3-login) and narrowed it down to `nmap -sV -p 993 $host`. I've noticed that if I remove "ssl_protocols = !SSLv2 !SSLv3" from my config or enable SSLv3 rather than disabling it the segfault disappears. I'm running on Arch Linux with dovecot 2.2.16-1 and openssl 1.0.2.a-1. I've also attached a network capture, but since it's SSL this probably won't help all that much. I hope this is enough information to reproduce the issue. If necessary I can recompile dovecot with debug symbols for a better backtrace. Thanks, Florian dovecot.conf https://paste.xinu.at/PUsJ/ syslog: > Apr 21 10:52:16 karif dovecot[7849]: imap-login: Disconnected (no auth attempts in 6 secs): user=<>, rip=81.217.47.122, lip=78.46.56.141, TLS handshaking: SSL_accept() failed: error:1407609C:SSL routines:SSL23_GET_CLIENT_HELLO:http request > Apr 21 10:52:16 karif dovecot[7849]: imap-login: Fatal: master: service(imap-login): child 7879 killed with signal 11 (core not dumped - add -D parameter to service imap-login { executable } [last ip=81.217.47.122] > Apr 21 10:52:16 karif kernel: imap-login[7879] segfault at f0 ip 00007fb2b8b1360b sp 00007fff926ffd50 error 4 in libssl.so.1.0.0[7fb2b8af3000+6f000] backtrace: > #0 0x00007f120100260b in ssl3_get_client_hello () from /usr/lib/libssl.so.1.0.0 > #1 0x00007f120100738f in ssl3_accept () from /usr/lib/libssl.so.1.0.0 > #2 0x00007f1201012b36 in ssl3_write_bytes () from /usr/lib/libssl.so.1.0.0 > #3 0x00007f1201906200 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > #4 0x00007f12019062d8 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > #5 0x00007f1201905f72 in ssl_proxy_destroy () from /usr/lib/dovecot/libdovecot-login.so.0 > #6 0x00007f12019060e4 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > #7 0x00007f1201906671 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > #8 0x00007f1201902efa in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > #9 0x00007f120162d503 in ?? () from /usr/lib/dovecot/libdovecot.so.0 > #10 0x00007f120168d62c in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 > #11 0x00007f120168e665 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 > #12 0x00007f120168d699 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 > #13 0x00007f120168d718 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 > #14 0x00007f120162cb23 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 > #15 0x00007f1201903788 in login_binary_run () from /usr/lib/dovecot/libdovecot-login.so.0 > #16 0x00007f120127d800 in __libc_start_main () from /usr/lib/libc.so.6 > #17 0x0000000000402909 in _start () nmap output: >> nmap -sV --packet-trace -p 993 karif > > Starting Nmap 6.47 ( http://nmap.org ) at 2015-04-21 10:52 CEST > CONN (0.0426s) TCP localhost > 78.46.56.141:80 => Operation now in progress > CONN (0.0427s) TCP localhost > 78.46.56.141:443 => Operation now in progress > NSOCK INFO [0.0650s] nsi_new2(): nsi_new (IOD #1) > NSOCK INFO [0.0650s] nsock_connect_udp(): UDP connection requested to 192.168.4.1:53 (IOD #1) EID 8 > NSOCK INFO [0.0650s] nsock_read(): Read request from IOD #1 [192.168.4.1:53] (timeout: -1ms) EID 18 > NSOCK INFO [0.0650s] nsock_trace_handler_callback(): Callback: CONNECT SUCCESS for EID 8 [192.168.4.1:53] > NSOCK INFO [0.0650s] nsock_trace_handler_callback(): Callback: WRITE SUCCESS for EID 27 [192.168.4.1:53] > NSOCK INFO [0.0650s] nsock_trace_handler_callback(): Callback: READ SUCCESS for EID 18 [192.168.4.1:53] (79 bytes): .............141.56.46.78.in-addr.arpa..................karif.server-speed.net. > NSOCK INFO [0.0650s] nsock_read(): Read request from IOD #1 [192.168.4.1:53] (timeout: -1ms) EID 34 > NSOCK INFO [0.0650s] nsi_delete(): nsi_delete (IOD #1) > NSOCK INFO [0.0650s] msevent_cancel(): msevent_cancel on event #34 (type READ) > CONN (0.0656s) TCP localhost > 78.46.56.141:993 => Operation now in progress > NSOCK INFO [0.1320s] nsi_new2(): nsi_new (IOD #1) > NSOCK INFO [0.1330s] nsock_connect_tcp(): TCP connection requested to 78.46.56.141:993 (IOD #1) EID 8 > NSOCK INFO [0.1550s] nsock_trace_handler_callback(): Callback: CONNECT SUCCESS for EID 8 [78.46.56.141:993] > Service scan sending probe NULL to 78.46.56.141:993 (tcp) > NSOCK INFO [0.1550s] nsock_read(): Read request from IOD #1 [78.46.56.141:993] (timeout: 6000ms) EID 18 > NSOCK INFO [6.1610s] nsock_trace_handler_callback(): Callback: READ TIMEOUT for EID 18 [78.46.56.141:993] > Service scan sending probe GetRequest to 78.46.56.141:993 (tcp) > NSOCK INFO [6.1610s] nsock_read(): Read request from IOD #1 [78.46.56.141:993] (timeout: 5000ms) EID 34 > NSOCK INFO [6.1610s] nsock_trace_handler_callback(): Callback: WRITE SUCCESS for EID 27 [78.46.56.141:993] > NSOCK INFO [6.1840s] nsock_trace_handler_callback(): Callback: READ ERROR [Connection reset by peer (104)] for EID 34 [78.46.56.141:993] > NSOCK INFO [6.1840s] nsi_delete(): nsi_delete (IOD #1) > NSOCK INFO [6.1840s] nsi_new2(): nsi_new (IOD #2) > NSOCK INFO [6.1840s] nsock_connect_tcp(): TCP connection requested to 78.46.56.141:993 (IOD #2) EID 40 > NSOCK INFO [6.2050s] nsock_trace_handler_callback(): Callback: CONNECT SUCCESS for EID 40 [78.46.56.141:993] > Service scan sending probe SSLSessionReq to 78.46.56.141:993 (tcp) > NSOCK INFO [6.2060s] nsock_read(): Read request from IOD #2 [78.46.56.141:993] (timeout: 5000ms) EID 58 > NSOCK INFO [6.2060s] nsock_trace_handler_callback(): Callback: WRITE SUCCESS for EID 51 [78.46.56.141:993] > NSOCK INFO [6.2280s] nsock_trace_handler_callback(): Callback: READ SUCCESS for EID 58 [78.46.56.141:993] (7 bytes): ......( > Service scan match (Probe SSLSessionReq matched with SSLSessionReq line 10443): 78.46.56.141:993 is ssl. Version: |TLSv1||| > NSOCK INFO [6.2280s] nsi_delete(): nsi_delete (IOD #2) > NSOCK INFO [6.2280s] nsi_new2(): nsi_new (IOD #3) > NSOCK INFO [6.2280s] nsock_connect_ssl(): SSL connection requested to 78.46.56.141:993/tcp (IOD #3) EID 65 > NSOCK INFO [6.3370s] nsock_trace_handler_callback(): Callback: SSL-CONNECT SUCCESS for EID 65 [78.46.56.141:993] > Service scan sending probe NULL to 78.46.56.141:993 (tcp) > NSOCK INFO [6.3370s] nsock_read(): Read request from IOD #3 [78.46.56.141:993] (timeout: 6000ms) EID 74 > NSOCK INFO [6.3960s] nsock_trace_handler_callback(): Callback: READ SUCCESS for EID 74 [78.46.56.141:993] (114 bytes) > Service scan match (Probe NULL matched with NULL line 1312): 78.46.56.141:993 is SSL/imap. Version: |Dovecot imapd||| > NSOCK INFO [6.3960s] nsi_delete(): nsi_delete (IOD #3) > Nmap scan report for karif (78.46.56.141) > Host is up (0.023s latency). > rDNS record for 78.46.56.141: karif.server-speed.net > PORT STATE SERVICE VERSION > 993/tcp open ssl/imap Dovecot imapd > > Service detection performed. Please report any incorrect results at http://nmap.org/submit/ . > Nmap done: 1 IP address (1 host up) scanned in 6.40 seconds -------------- next part -------------- A non-text attachment was scrubbed... Name: imap-login-crash.pcapng.gz Type: application/gzip Size: 7625 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 801 bytes Desc: OpenPGP digital signature URL: From skdovecot at smail.inf.fh-brs.de Tue Apr 21 10:27:48 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 21 Apr 2015 12:27:48 +0200 (CEST) Subject: cant see all users - need to create symlink between mailboxes [request for help] In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 21 Apr 2015, Kevin Laurie wrote: > I need to create a symlink to share mailboxes. > I tried to check at : cd /var/mail/ but I cant see all the mailboxes. > Could someone advise how to do this? you are on Dovecot v1? What mail field is returned by your mysql driver? > > I am trying to achieve as showing in tutorial here:- > http://wiki.dovecot.org/SharedMailboxes/Symlinks > > Below is the details of my dovecot.conf > Appreciate if anyone can help. > > > > # Listen addresses. > # - '*' means all available IPv4 addresses. > # - '[::]' means all available IPv6 addresses. > # Listen on all available addresses by default > listen = * [::] > > #base_dir = /var/run/dovecot > mail_plugins = quota acl > > # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing > mail_plugins = $mail_plugins fts fts_solr > > plugin { > fts = solr > #break-imap-search will use solr for indexing TEXT and BODY searches. > fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ > fts_autoindex = yes > } > > > # Enabled mail protocols. > protocols = pop3 imap sieve lmtp > > # User/group who owns the message files: > mail_uid = 2000 > mail_gid = 2000 > > # Assign uid to virtual users. > first_valid_uid = 2000 > last_valid_uid = 2000 > > # Logging. Reference: http://wiki2.dovecot.org/Logging > log_path = /var/log/dovecot.log > mail_debug = no > auth_verbose = no > auth_debug = no > auth_debug_passwords = no > # Possible values: no, plain, sha1. > auth_verbose_passwords = no > > # SSL: Global settings. > # Refer to wiki site for per protocol, ip, server name SSL settings: > # http://wiki2.dovecot.org/SSL/DovecotConfiguration > ssl_protocols = !SSLv2 !SSLv3 > ssl = required > verbose_ssl = no > #ssl_ca = ssl_cert = ssl_key = > # With disable_plaintext_auth=yes AND ssl=required, STARTTLS is mandatory. > # Set disable_plaintext_auth=no AND ssl=yes to allow plain password transmitted > # insecurely. > disable_plaintext_auth = yes > # Allow plain text password per IP address/net > #remote 192.168.0.0/24 { > # disable_plaintext_auth = no > #} > > # Mail location and mailbox format. > mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ > > # Authentication related settings. > # Append this domain name if client gives empty realm. > auth_default_realm = > > # Authentication mechanisms. > auth_mechanisms = PLAIN LOGIN > > # Limits the number of users that can be logging in at the same time. > # Default is 100. > # Note: this value can be overrided by "process_limit =" in service protocol. > # e.g. > # protocol imap-login { > # ... > # process_limit = 500 > # } > #default_process_limit = 100 > > service auth { > unix_listener /var/spool/postfix/private/dovecot-auth { > user = postfix > group = postfix > mode = 0666 > } > unix_listener auth-master { > user = vmail > group = vmail > mode = 0666 > } > unix_listener auth-userdb { > user = vmail > group = vmail > mode = 0660 > } > } > > # LMTP server (Local Mail Transfer Protocol). > # Reference: http://wiki2.dovecot.org/LMTP > service lmtp { > user = vmail > > # For higher volume sites, it may be desirable to increase the number of > # active listener processes. A range of 5 to 20 is probably good for most > # sites. > process_min_avail = 5 > > # Logging. > # Require 'info_log_path =' in 'protocol lmtp {}' block. > executable = lmtp -L > > # Listening on socket file and TCP > unix_listener /var/spool/postfix/private/dovecot-lmtp { > user = postfix > group = postfix > mode = 0600 > } > > inet_listener lmtp { > #address = 192.168.0.24 127.0.0.1 ::1 > port = 24 > } > } > > # Virtual mail accounts. > userdb { > args = /etc/dovecot/dovecot-mysql.conf > driver = sql > } > passdb { > args = /etc/dovecot/dovecot-mysql.conf > driver = sql > } > > # Master user. > # Master users are able to log in as other users. It's also possible to > # directly log in as any user using a master password, although this isn't > # recommended. > # Reference: http://wiki2.dovecot.org/Authentication/MasterUsers > auth_master_user_separator = * > passdb { > driver = passwd-file > args = /etc/dovecot/dovecot-master-users > master = yes > } > > plugin { > auth_socket_path = /var/run/dovecot/auth-master > > quota = dict:user::proxy::quotadict > quota_rule = *:storage=1G > #quota_rule2 = *:messages=0 > #quota_rule3 = Trash:storage=1G > #quota_rule4 = Junk:ignore > > # Quota warning. > # If user suddenly receives a huge mail and the quota jumps from > # 85% to 95%, only the 95% script is executed. > quota_warning = storage=85%% quota-warning 85 %u > quota_warning2 = storage=90%% quota-warning 90 %u > quota_warning3 = storage=95%% quota-warning 95 %u > > # Plugin: autocreate. Create and subscribe to default IMAP folders. > autocreate = INBOX > autocreate2 = Sent > autocreate3 = Trash > autocreate4 = Drafts > autocreate5 = Junk > autosubscribe = INBOX > autosubscribe2 = Sent > autosubscribe3 = Trash > autosubscribe4 = Drafts > autosubscribe5 = Junk > > # Plugin: expire. > #expire = Trash 7 Trash/* 7 Junk 30 > #expire_dict = proxy::expire > > # ACL and share folder > acl = vfile > acl_shared_dict = proxy::acl > > # By default Dovecot doesn't allow using the IMAP "anyone" or > # "authenticated" identifier, because it would be an easy way to spam > # other users in the system. If you wish to allow it, > #acl_anyone = allow > > # Pigeonhole managesieve service. > # Reference: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration > # Per-user sieve settings. > sieve_dir = /%Lh/sieve > sieve = /%Lh/sieve/dovecot.sieve > > # Global sieve settings. > sieve_global_dir = /var/vmail/sieve > # Note: if user has personal sieve script, global sieve rules defined in > # sieve_default will be ignored. Please use sieve_before or > # sieve_after instead. > #sieve_default = > > sieve_before = /var/vmail/sieve/dovecot.sieve > #sieve_after = > > # The maximum number of redirect actions that can be performed during a > # single script execution. The meaning of 0 differs based on your version. > # For versions v0.3.0 and beyond this means that redirect is prohibited. > # For older versions, however, this means that the number of redirects is > # unlimited, so be careful. > #sieve_max_redirects = 4 > } > > service quota-warning { > executable = script /usr/local/bin/dovecot-quota-warning.sh > unix_listener quota-warning { > user = vmail > group = vmail > mode = 0660 > } > } > > service dict { > unix_listener dict { > mode = 0660 > user = vmail > group = vmail > } > } > > dict { > #expire = db:/var/lib/dovecot/expire/expire.db > quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf > acl = mysql:/etc/dovecot/dovecot-share-folder.conf > } > > protocol lda { > # Reference: http://wiki2.dovecot.org/LDA > mail_plugins = $mail_plugins sieve autocreate > auth_socket_path = /var/run/dovecot/auth-master > log_path = /var/log/dovecot-sieve.log > lda_mailbox_autocreate = yes > postmaster_address = root > } > > protocol lmtp { > # Log file > info_log_path = /var/log/dovecot-lmtp.log > > # Plugins > mail_plugins = quota > # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing > mail_plugins = $mail_plugins fts fts_solr > > plugin { > fts = solr > #break-imap-search will use solr for indexing TEXT and BODY searches. > fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ > fts_autoindex = yes > } > postmaster_address = postmaster > > lmtp_save_to_detail_mailbox = yes > recipient_delimiter = + > } > > protocol imap { > mail_plugins = $mail_plugins imap_quota autocreate imap_acl > imap_client_workarounds = tb-extra-mailbox-sep > > # Maximum number of IMAP connections allowed for a user from each > IP address. > # NOTE: The username is compared case-sensitively. > # Default is 10. > # Increase it to avoid issue like below: > # "Maximum number of concurrent IMAP connections exceeded" > mail_max_userip_connections = 20 > } > protocol pop3 { > mail_plugins = $mail_plugins > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > > # Maximum number of IMAP connections allowed for a user from each > IP address. > # NOTE: The username is compared case-sensitively. > # Default is 10. > mail_max_userip_connections = 20 > } > > # Login processes. Refer to Dovecot wiki for more details: > # http://wiki2.dovecot.org/LoginProcess > service imap-login { > service_count = 1 > > # To avoid startup latency for new client connections, set process_min_avail > # to higher than zero. That many idling processes are always kept around > # waiting for new connections. > #process_min_avail = 0 > > # number of simultaneous IMAP connections > #process_limit = $default_process_limit > process_limit = 500 > > # vsz_limit should be fine at its default 64MB value > #vsz_limit = 64M > } > service pop3-login { > service_count = 1 > > # number of simultaneous POP3 connections > #process_limit = 500 > } > > namespace { > type = private > separator = / > prefix = > #location defaults to mail_location. > inbox = yes > } > > namespace { > type = shared > separator = / > prefix = Shared/%%u/ > location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u > # this namespace should handle its own subscriptions or not. > subscriptions = yes > list = children > } > > # Public mailboxes. > # Refer to Dovecot wiki page for more details: > # http://wiki2.dovecot.org/SharedMailboxes/Public > #namespace { > # type = public > # separator = / > # prefix = Public/ > # > # # CONTROL=: Mark this public folder as read-only mailbox > # # INDEX=: Per-user \Seen flag > # location = > maildir:/var/vmail/public/:CONTROL=~/Maildir/public:INDEX=~/Maildir/public > # > # # Allow users to subscribe to the public folders. > # subscriptions = yes > #} > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVTYmJHz1H7kL/d9rAQIgcQgAl9ylCSScWzGB8XbGx1vXv8yg/HhkCgZJ 8e2lBeVPhCXkEjkyo/sQLIxgGqOAFzAc1GgtUap53kJG6Twz2qHlzpvynGR/1JbW GUszsUBiECFKC3C+612o2dvkf8qUtPCe/5O4Omp8reaHoiLoVJawkdb5oSXTq9uN kzN++5meq5iwhqoPAPzIgN8ssHgfxP1++mUGlLU9rtoWBmMDo6rdx9FLiMa/0Gyw zxsIyLefkzkxiFGHs3TZcWw/JSURUbPlzRtmFbpbGBx5yUBQVs/x/Vlo8oaoUqeI 5w8C3sMAHgVOiQoHeyFCGqfcYRNhs4QcaKM/Bm2ElFEzZJQ6lCWjTw== =gn9M -----END PGP SIGNATURE----- From kremels at kreme.com Tue Apr 21 11:49:03 2015 From: kremels at kreme.com (@lbutlr) Date: Tue, 21 Apr 2015 05:49:03 -0600 Subject: Moving a local domain to sql Message-ID: <94612233-1617-40B9-BC27-09FC351202A1@kreme.com> I have a domain that current maps to local users that I want to move into the mysql maps with all the other domains, but I am unsure of the best way to proceed with this. For example, my mail server is covisp.net and my personal domain is kreme.com, and currently kremels at kreme.com maps to the local user kremels. I want it to map to the existing mysql database as ?kernels at kreme.com?. (For example only, I?m not moving kreme.com, I am too dependent on procmail for all my list processing). Once I setup the user account in the mysql database do I just move the Maildir from /home/kremels to /usr/local/virtual/kremels at kreme.com/ and reload dovecot? -- I leave symbols to the symbol-minded - George Carlin From darix at opensu.se Tue Apr 21 15:10:58 2015 From: darix at opensu.se (Marcus Rueckert) Date: Tue, 21 Apr 2015 17:10:58 +0200 Subject: [BUG] imap-login segfault when running nmap -sV In-Reply-To: <55361767.1040900@xinu.at> References: <55361767.1040900@xinu.at> Message-ID: <20150421151058.GK3438@nordisch.org> On 2015-04-21 11:24:55 +0200, Florian Pritz wrote: > dovecot.conf > https://paste.xinu.at/PUsJ/ > > syslog: > > Apr 21 10:52:16 karif dovecot[7849]: imap-login: Disconnected (no auth attempts in 6 secs): user=<>, rip=81.217.47.122, lip=78.46.56.141, TLS handshaking: SSL_accept() failed: error:1407609C:SSL routines:SSL23_GET_CLIENT_HELLO:http request > > Apr 21 10:52:16 karif dovecot[7849]: imap-login: Fatal: master: service(imap-login): child 7879 killed with signal 11 (core not dumped - add -D parameter to service imap-login { executable } [last ip=81.217.47.122] > > Apr 21 10:52:16 karif kernel: imap-login[7879] segfault at f0 ip 00007fb2b8b1360b sp 00007fff926ffd50 error 4 in libssl.so.1.0.0[7fb2b8af3000+6f000] > > > backtrace: > > #0 0x00007f120100260b in ssl3_get_client_hello () from /usr/lib/libssl.so.1.0.0 > > #1 0x00007f120100738f in ssl3_accept () from /usr/lib/libssl.so.1.0.0 > > #2 0x00007f1201012b36 in ssl3_write_bytes () from /usr/lib/libssl.so.1.0.0 > > #3 0x00007f1201906200 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > > #4 0x00007f12019062d8 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > > #5 0x00007f1201905f72 in ssl_proxy_destroy () from /usr/lib/dovecot/libdovecot-login.so.0 > > #6 0x00007f12019060e4 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > > #7 0x00007f1201906671 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > > #8 0x00007f1201902efa in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 > > #9 0x00007f120162d503 in ?? () from /usr/lib/dovecot/libdovecot.so.0 > > #10 0x00007f120168d62c in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 > > #11 0x00007f120168e665 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 > > #12 0x00007f120168d699 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 > > #13 0x00007f120168d718 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 > > #14 0x00007f120162cb23 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 > > #15 0x00007f1201903788 in login_binary_run () from /usr/lib/dovecot/libdovecot-login.so.0 > > #16 0x00007f120127d800 in __libc_start_main () from /usr/lib/libc.so.6 > > #17 0x0000000000402909 in _start () looks more like a crash in openssl. darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org From superinterstellar at gmail.com Tue Apr 21 16:11:55 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Tue, 21 Apr 2015 23:11:55 +0700 Subject: cant see all users - need to create symlink between mailboxes [request for help] In-Reply-To: References: Message-ID: Hi, Its okay now. I decided to use ACL. Apparently the "Sent" mailbox cannot be viewed by dave. Any idea why? When I do GETACL for Sent, the message I get is shown below:- * ACL "Sent" "dave at mydomain.net" ilr "help at mydomain.net" lrwstipekxacd On Tue, Apr 21, 2015 at 5:27 PM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 21 Apr 2015, Kevin Laurie wrote: > >> I need to create a symlink to share mailboxes. >> I tried to check at : cd /var/mail/ but I cant see all the mailboxes. >> Could someone advise how to do this? > > > you are on Dovecot v1? > > What mail field is returned by your mysql driver? > > >> >> I am trying to achieve as showing in tutorial here:- >> http://wiki.dovecot.org/SharedMailboxes/Symlinks >> >> Below is the details of my dovecot.conf >> Appreciate if anyone can help. >> >> >> >> # Listen addresses. >> # - '*' means all available IPv4 addresses. >> # - '[::]' means all available IPv6 addresses. >> # Listen on all available addresses by default >> listen = * [::] >> >> #base_dir = /var/run/dovecot >> mail_plugins = quota acl >> >> # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing >> mail_plugins = $mail_plugins fts fts_solr >> >> plugin { >> fts = solr >> #break-imap-search will use solr for indexing TEXT and BODY searches. >> fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ >> fts_autoindex = yes >> } >> >> >> # Enabled mail protocols. >> protocols = pop3 imap sieve lmtp >> >> # User/group who owns the message files: >> mail_uid = 2000 >> mail_gid = 2000 >> >> # Assign uid to virtual users. >> first_valid_uid = 2000 >> last_valid_uid = 2000 >> >> # Logging. Reference: http://wiki2.dovecot.org/Logging >> log_path = /var/log/dovecot.log >> mail_debug = no >> auth_verbose = no >> auth_debug = no >> auth_debug_passwords = no >> # Possible values: no, plain, sha1. >> auth_verbose_passwords = no >> >> # SSL: Global settings. >> # Refer to wiki site for per protocol, ip, server name SSL settings: >> # http://wiki2.dovecot.org/SSL/DovecotConfiguration >> ssl_protocols = !SSLv2 !SSLv3 >> ssl = required >> verbose_ssl = no >> #ssl_ca => ssl_cert = > ssl_key = > >> # With disable_plaintext_auth=yes AND ssl=required, STARTTLS is mandatory. >> # Set disable_plaintext_auth=no AND ssl=yes to allow plain password >> transmitted >> # insecurely. >> disable_plaintext_auth = yes >> # Allow plain text password per IP address/net >> #remote 192.168.0.0/24 { >> # disable_plaintext_auth = no >> #} >> >> # Mail location and mailbox format. >> mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ >> >> # Authentication related settings. >> # Append this domain name if client gives empty realm. >> auth_default_realm = >> >> # Authentication mechanisms. >> auth_mechanisms = PLAIN LOGIN >> >> # Limits the number of users that can be logging in at the same time. >> # Default is 100. >> # Note: this value can be overrided by "process_limit =" in service >> protocol. >> # e.g. >> # protocol imap-login { >> # ... >> # process_limit = 500 >> # } >> #default_process_limit = 100 >> >> service auth { >> unix_listener /var/spool/postfix/private/dovecot-auth { >> user = postfix >> group = postfix >> mode = 0666 >> } >> unix_listener auth-master { >> user = vmail >> group = vmail >> mode = 0666 >> } >> unix_listener auth-userdb { >> user = vmail >> group = vmail >> mode = 0660 >> } >> } >> >> # LMTP server (Local Mail Transfer Protocol). >> # Reference: http://wiki2.dovecot.org/LMTP >> service lmtp { >> user = vmail >> >> # For higher volume sites, it may be desirable to increase the number >> of >> # active listener processes. A range of 5 to 20 is probably good for >> most >> # sites. >> process_min_avail = 5 >> >> # Logging. >> # Require 'info_log_path =' in 'protocol lmtp {}' block. >> executable = lmtp -L >> >> # Listening on socket file and TCP >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> user = postfix >> group = postfix >> mode = 0600 >> } >> >> inet_listener lmtp { >> #address = 192.168.0.24 127.0.0.1 ::1 >> port = 24 >> } >> } >> >> # Virtual mail accounts. >> userdb { >> args = /etc/dovecot/dovecot-mysql.conf >> driver = sql >> } >> passdb { >> args = /etc/dovecot/dovecot-mysql.conf >> driver = sql >> } >> >> # Master user. >> # Master users are able to log in as other users. It's also possible to >> # directly log in as any user using a master password, although this isn't >> # recommended. >> # Reference: http://wiki2.dovecot.org/Authentication/MasterUsers >> auth_master_user_separator = * >> passdb { >> driver = passwd-file >> args = /etc/dovecot/dovecot-master-users >> master = yes >> } >> >> plugin { >> auth_socket_path = /var/run/dovecot/auth-master >> >> quota = dict:user::proxy::quotadict >> quota_rule = *:storage=1G >> #quota_rule2 = *:messages=0 >> #quota_rule3 = Trash:storage=1G >> #quota_rule4 = Junk:ignore >> >> # Quota warning. >> # If user suddenly receives a huge mail and the quota jumps from >> # 85% to 95%, only the 95% script is executed. >> quota_warning = storage=85%% quota-warning 85 %u >> quota_warning2 = storage=90%% quota-warning 90 %u >> quota_warning3 = storage=95%% quota-warning 95 %u >> >> # Plugin: autocreate. Create and subscribe to default IMAP folders. >> autocreate = INBOX >> autocreate2 = Sent >> autocreate3 = Trash >> autocreate4 = Drafts >> autocreate5 = Junk >> autosubscribe = INBOX >> autosubscribe2 = Sent >> autosubscribe3 = Trash >> autosubscribe4 = Drafts >> autosubscribe5 = Junk >> >> # Plugin: expire. >> #expire = Trash 7 Trash/* 7 Junk 30 >> #expire_dict = proxy::expire >> >> # ACL and share folder >> acl = vfile >> acl_shared_dict = proxy::acl >> >> # By default Dovecot doesn't allow using the IMAP "anyone" or >> # "authenticated" identifier, because it would be an easy way to spam >> # other users in the system. If you wish to allow it, >> #acl_anyone = allow >> >> # Pigeonhole managesieve service. >> # Reference: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration >> # Per-user sieve settings. >> sieve_dir = /%Lh/sieve >> sieve = /%Lh/sieve/dovecot.sieve >> >> # Global sieve settings. >> sieve_global_dir = /var/vmail/sieve >> # Note: if user has personal sieve script, global sieve rules defined >> in >> # sieve_default will be ignored. Please use sieve_before or >> # sieve_after instead. >> #sieve_default = >> >> sieve_before = /var/vmail/sieve/dovecot.sieve >> #sieve_after = >> >> # The maximum number of redirect actions that can be performed during a >> # single script execution. The meaning of 0 differs based on your >> version. >> # For versions v0.3.0 and beyond this means that redirect is >> prohibited. >> # For older versions, however, this means that the number of redirects >> is >> # unlimited, so be careful. >> #sieve_max_redirects = 4 >> } >> >> service quota-warning { >> executable = script /usr/local/bin/dovecot-quota-warning.sh >> unix_listener quota-warning { >> user = vmail >> group = vmail >> mode = 0660 >> } >> } >> >> service dict { >> unix_listener dict { >> mode = 0660 >> user = vmail >> group = vmail >> } >> } >> >> dict { >> #expire = db:/var/lib/dovecot/expire/expire.db >> quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf >> acl = mysql:/etc/dovecot/dovecot-share-folder.conf >> } >> >> protocol lda { >> # Reference: http://wiki2.dovecot.org/LDA >> mail_plugins = $mail_plugins sieve autocreate >> auth_socket_path = /var/run/dovecot/auth-master >> log_path = /var/log/dovecot-sieve.log >> lda_mailbox_autocreate = yes >> postmaster_address = root >> } >> >> protocol lmtp { >> # Log file >> info_log_path = /var/log/dovecot-lmtp.log >> >> # Plugins >> mail_plugins = quota >> # Enable fts fts_solr plugin globally for Solr Full Text Search Indexing >> mail_plugins = $mail_plugins fts fts_solr >> >> plugin { >> fts = solr >> #break-imap-search will use solr for indexing TEXT and BODY searches. >> fts_solr = break-imap-search url=http://127.0.0.1:8983/solr/ >> fts_autoindex = yes >> } >> postmaster_address = postmaster >> >> lmtp_save_to_detail_mailbox = yes >> recipient_delimiter = + >> } >> >> protocol imap { >> mail_plugins = $mail_plugins imap_quota autocreate imap_acl >> imap_client_workarounds = tb-extra-mailbox-sep >> >> # Maximum number of IMAP connections allowed for a user from each >> IP address. >> # NOTE: The username is compared case-sensitively. >> # Default is 10. >> # Increase it to avoid issue like below: >> # "Maximum number of concurrent IMAP connections exceeded" >> mail_max_userip_connections = 20 >> } >> protocol pop3 { >> mail_plugins = $mail_plugins >> pop3_client_workarounds = outlook-no-nuls oe-ns-eoh >> pop3_uidl_format = %08Xu%08Xv >> >> # Maximum number of IMAP connections allowed for a user from each >> IP address. >> # NOTE: The username is compared case-sensitively. >> # Default is 10. >> mail_max_userip_connections = 20 >> } >> >> # Login processes. Refer to Dovecot wiki for more details: >> # http://wiki2.dovecot.org/LoginProcess >> service imap-login { >> service_count = 1 >> >> # To avoid startup latency for new client connections, set >> process_min_avail >> # to higher than zero. That many idling processes are always kept >> around >> # waiting for new connections. >> #process_min_avail = 0 >> >> # number of simultaneous IMAP connections >> #process_limit = $default_process_limit >> process_limit = 500 >> >> # vsz_limit should be fine at its default 64MB value >> #vsz_limit = 64M >> } >> service pop3-login { >> service_count = 1 >> >> # number of simultaneous POP3 connections >> #process_limit = 500 >> } >> >> namespace { >> type = private >> separator = / >> prefix = >> #location defaults to mail_location. >> inbox = yes >> } >> >> namespace { >> type = shared >> separator = / >> prefix = Shared/%%u/ >> location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u >> # this namespace should handle its own subscriptions or not. >> subscriptions = yes >> list = children >> } >> >> # Public mailboxes. >> # Refer to Dovecot wiki page for more details: >> # http://wiki2.dovecot.org/SharedMailboxes/Public >> #namespace { >> # type = public >> # separator = / >> # prefix = Public/ >> # >> # # CONTROL=: Mark this public folder as read-only mailbox >> # # INDEX=: Per-user \Seen flag >> # location = >> maildir:/var/vmail/public/:CONTROL=~/Maildir/public:INDEX=~/Maildir/public >> # >> # # Allow users to subscribe to the public folders. >> # subscriptions = yes >> #} >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVTYmJHz1H7kL/d9rAQIgcQgAl9ylCSScWzGB8XbGx1vXv8yg/HhkCgZJ > 8e2lBeVPhCXkEjkyo/sQLIxgGqOAFzAc1GgtUap53kJG6Twz2qHlzpvynGR/1JbW > GUszsUBiECFKC3C+612o2dvkf8qUtPCe/5O4Omp8reaHoiLoVJawkdb5oSXTq9uN > kzN++5meq5iwhqoPAPzIgN8ssHgfxP1++mUGlLU9rtoWBmMDo6rdx9FLiMa/0Gyw > zxsIyLefkzkxiFGHs3TZcWw/JSURUbPlzRtmFbpbGBx5yUBQVs/x/Vlo8oaoUqeI > 5w8C3sMAHgVOiQoHeyFCGqfcYRNhs4QcaKM/Bm2ElFEzZJQ6lCWjTw== > =gn9M > -----END PGP SIGNATURE----- From superinterstellar at gmail.com Tue Apr 21 17:00:18 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Wed, 22 Apr 2015 00:00:18 +0700 Subject: Cant See Sent Mailbox despite GETACL [request for help] Message-ID: Hi, Apparently the "Sent" mailbox cannot be viewed by Dave(the user). Any idea why? When I do GETACL for Sent, the message I get is shown below:- * ACL "Sent" "dave at mydomain.net" ilr "help at mydomain.net" lrwstipekxacd From tss at iki.fi Tue Apr 21 19:42:09 2015 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Apr 2015 22:42:09 +0300 Subject: Cant See Sent Mailbox despite GETACL [request for help] In-Reply-To: References: Message-ID: On 21 Apr 2015, at 20:00, Kevin Laurie wrote: > > Hi, > Apparently the "Sent" mailbox cannot be viewed by Dave(the user). Any idea why? > > When I do GETACL for Sent, the message I get is shown below:- > > * ACL "Sent" "dave at mydomain.net" ilr "help at mydomain.net" lrwstipekxacd doveadm acl debug -u dave at mydomain.net Shared/help at mydomain.net/Sent From tss at iki.fi Tue Apr 21 19:50:22 2015 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Apr 2015 22:50:22 +0300 Subject: doveadm-server hangs with 100% cpu usage In-Reply-To: <55352503.5020703@heinlein-support.de> References: <55352503.5020703@heinlein-support.de> Message-ID: On 20 Apr 2015, at 19:10, Dennis Kuhn wrote: > > we have some replication issues. From time to time a doveadm-server > process takes 100% cpu in the state recv_mailbox_tree_deletes on the > replica. The process runs forever until it is manually killed. Strace on > this process doesn't show anything. > Sometimes we have several doveadm-server processes in this state, all > for the same account, all with 100% CPU Load. Some bug, but there would need to be a way to reproduce it or otherwise it's pretty much impossible to find what the bug is and get it fixed. > My workaround is to delete the user directory on the replica so that > the whole account is replicated again. This solves the problem for this > specific account. So killing the doveadm-server process will cause it to hang again for the same user? That's good, since it means it can be reproduced by taking a copy of the mailboxes and trying to run "doveadm sync" manually on them locally, e.g.: doveadm -D -o mail=mdbox:/tmp/mdbox1 sync mdbox:/tmp/mdbox2 Does that hang? If yes, we can get further with it. The -D parameter is also helpful here - v2.2.16 logs much more useful debug logging with dsync that can also help catch these kind of hangs. Even if you can't reproduce the hang the above way, having mail_debug=yes for dsync and getting the debug logs from a hanging session would be useful. (But it may also mean that a hang might start flooding your logs with debug messages and eat up all the disk space.) From shouddy at enet.cu Wed Apr 22 03:15:13 2015 From: shouddy at enet.cu (shouddy at enet.cu) Date: Tue, 21 Apr 2015 23:15:13 -0400 Subject: dovecot efficient use of resources Message-ID: <20150421231513.Horde.7p-NLPz59P1VNxJBwLv2OBA@webmail.enet.cu> I just started a heavy load imap service and everything fitted OK in functional terms. The problem comes whith stress tests, I have no problem in the directors line. But my doubt comes whether the backends are using efficiently the resources assigned or not. The main goal is to maximize the concurrency without affect the integrity of operations. My question is: Is there a rule for relating the amount of computing resources (RAM, Processor) with the number of simultaneous connections to an IMAP/POP3 server running dovecot? I had made all the adjustmens for high performance in dovecot according to the docs and O.S specs Backend's hardware Processor: AMD Opteron(tm) Processor 6136 RAM: 16 GB HDD: Enought for testing I'm confident the NFS layer is not making noise (yet). Comparing the results, the output of tests are giving consistent numbers using local file systems (all of them properly tuned) I have run the tests with imaptest but even with 100 clients I'm having system's max load of 46 stable. I have the sense that memory is not using properly (2GB at most from 16GB). Thank you so much in advance, would be grateful for any help Conf below Dovecot version 2.2.10 doveconf -n # OS: Linux 3.10.0-123.20.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.0 (Maipo) nfs4 auth_mechanisms = plain login default_client_limit = 4000 disable_plaintext_auth = no listen = * mail_fsync = always mail_gid = 500 mail_location = maildir:/var/vmail/mailboxes/%d/%8n/%n:INDEX=MEMORY mail_nfs_index = yes mail_nfs_storage = yes mail_uid = 500 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { client_limit = 14400 service_count = 0 unix_listener auth-userdb { group = vmail mode = 0640 user = vmail } } service doveadm { inet_listener { port = 24245 } } service imap-login { client_limit = 1000 process_limit = 100 process_min_avail = 16 service_count = 0 vsz_limit = 512 M } service imap { process_limit = 7000 service_count = 0 } service pop3-login { client_limit = 1000 process_limit = 100 process_min_avail = 16 service_count = 0 } service pop3 { process_limit = 7000 service_count = 0 } ssl_cert = Hello! When I fetch certain emails from my Dovecot 2.2.16 server using Trojita 0.5, dovecot/imap will crash reproducibly. Please find config and backtrace from coredump attached. Best regards, Dennis -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-imap-core-1179.gdb.log Type: text/x-log Size: 4905 bytes Desc: not available URL: -------------- next part -------------- # 2.2.16: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.7 # OS: Linux 3.19.5-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_mechanisms = plain login auth_username_format = %Ln dict { acl_shared = file:/var/lib/dovecot/shared-acl expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext mail_attribute = file:/var/lib/dovecot/mail-attribute quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } imap_metadata = yes import_environment = LD_LIBRARY_PATH=/usr/lib/dovecot mail_attribute_dict = proxy::mail_attribute mail_location = mdbox:/var/mail/user/%u mail_plugins = expire virtual zlib mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate spamtest mdbox_preallocate_space = yes namespace ns_default { location = mailbox drafts { auto = subscribe special_use = \Drafts } mailbox sent { auto = subscribe special_use = \Sent } mailbox spam { auto = subscribe special_use = \Junk } mailbox spam/ham { auto = subscribe } mailbox spam/unsure { auto = subscribe } mailbox trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } namespace ns_virtual { inbox = yes list = children location = virtual:/var/mail/virtual:INDEX=/var/mail/user-virtual/%u:CONTROL=/var/mail/user-virtual/%u prefix = [virtual]/ separator = / type = private } passdb { args = * driver = pam } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl_shared antispam_backend = dspam antispam_dspam_args = --client;--user;%Lu;--source=error;--signature=%%s antispam_dspam_binary = /usr/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = spam antispam_trash = trash antispam_unsure = spam/unsure expire = spam expire2 = spam/ham expire_dict = proxy::expire sieve = file:/var/mail/user-sieve/%u;active=/var/mail/user-sieve/%u.sieve sieve_after = /var/mail/sieve/after.d sieve_before = /var/mail/sieve/before.d sieve_extensions = +spamtest sieve_global = /var/mail/sieve/global sieve_spamtest_max_value = 1.0 sieve_spamtest_status_header = x-dspam-probability: ([[:digit:]]+.[[:digit:]]+) sieve_spamtest_status_type = score zlib_save = lz4 } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mailusers mode = 0660 } } service dict { unix_listener dict { group = mailusers mode = 0660 } } service lmtp { unix_listener /var/spool/dspam/dovecot-lmtp { group = dspam mode = 0660 user = dspam } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl = required ssl_cert = References: <94612233-1617-40B9-BC27-09FC351202A1@kreme.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 21 Apr 2015, @lbutlr wrote: > I have a domain that current maps to local users that I want to move > into the mysql maps with all the other domains, but I am unsure of the > best way to proceed with this. > > For example, my mail server is covisp.net and my personal domain is > kreme.com, and currently kremels at kreme.com maps to the local user > kremels. I want it to map to the existing mysql database as > ?kernels at kreme.com?. (For example only, I?m not moving kreme.com, I am > too dependent on procmail for all my list processing). > > Once I setup the user account in the mysql database do I just move the > Maildir from /home/kremels to /usr/local/virtual/kremels at kreme.com/ and > reload dovecot? an userdb may overwrite anything, so you could configure your SQL userdb to return exactly the same results you got for your local user. It also is a question, which username kremels is going to use to login and how the LMTP/LDA (if you use it) work. If you use procmail, you probably need to configure procmail as well. Access permissions might kick in, e.g. moving from system users to virtual users. In fact, you offered to few information to answer the question. I moved my system users to LDAP with Dovecot v1, when moving to Dovecot v2 I moved them to virtual users and one or three system users. Noone noticed the change. You need not reload Dovecot, but run doveadm auth cache flush to remove cached userdb information. Also, while you migrate an user, kick the user from Dovecot and make sure the user stays offline while the during process, e.g. using a special userdb { deny = yes } . - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVTc2eHz1H7kL/d9rAQKV5Af/Qe1R6kqN+CJrkl/9PILIi6f1/n1jJUYH 4Ms0OZHSVxFdk2ePG7lf/m5Fl/bpe5joroUFjeTxIWQjuUpDJa4fXW45UkfQ84yo AEK3UBxNOBCNWkjSgF6GivQUMGmj6EUIRJBC0s9jOAy0ZyZ0wYdA8vEPzs6P8aBz 5j7Vwm+81i9uWOdEtxojhbEo6ZtWpyFlYFz/UvnAzb5CWckLEXe9c62s52/IvUmG LbQJLAWVEzzUXSXhXl3+V59aHokdCC0/XdIvYoZUGRXZTCcoXzKDKqOovq4EPte/ KXl1h9ephGn0hI7MtxHbYZ/Hx7Bv3hwF013qK5arCI0hXA9bAnuwWQ== =3tL0 -----END PGP SIGNATURE----- From devurandom at gmx.net Wed Apr 22 09:20:56 2015 From: devurandom at gmx.net (Dennis Schridde) Date: Wed, 22 Apr 2015 09:20:56 +0000 Subject: Dovecot 2.2.16 crashes when fetching mails with Trojita 0.5 In-Reply-To: <1850489.9yPDusbyyE@talib> References: <1850489.9yPDusbyyE@talib> Message-ID: P.S: The same message loads fine with Roundcube 1.1.1 (without crashing the server). From marton.peter at gmail.com Wed Apr 22 11:41:56 2015 From: marton.peter at gmail.com (=?UTF-8?B?UMOpdGVyIE3DoXJ0b24=?=) Date: Wed, 22 Apr 2015 13:41:56 +0200 Subject: userdb username change ignored when using (My)SQL was: Re: userdb username changed In-Reply-To: References: Message-ID: Hi! Can someone please tell me what is the difference between "auth" and "auth-worker"? I mean the entries in the log. For me it looks like "auth" would be a master process for authdb and userdb lookups. But quota-status, and even lmtp are calling auth-worker directly. Or? Imap auth with mysql: Apr 22 12:35:16 imap21 dovecot: auth-worker(21529): Debug: sql(ppp at example.net,195.202.128.25): username changed ppp at example.net -> uppp Apr 22 12:35:16 imap21 dovecot: auth: Debug: sql(ppp at example.net,195.202.128.25,): username changed ppp at example.net -> uppp Both processes(?) loop through the returned variables (with request.c auth_request_set_userdb_field) , but only "auth" sets the "username" successfully. Imap auth with ldap: Apr 22 13:17:55 imap21 dovecot: auth: Debug: ldap(m2500j6,127.0.0.1,): username changed m2500j6 -> uppp Apr 22 13:17:55 imap21 dovecot: auth: Debug: ldap(uppp,127.0.0.1,): result: gidNumber=168 homeDirectory=/tmp mailHost=uppp Only "auth", and username is successfully changed. quota-status with mysql: Apr 22 12:35:59 imap21 dovecot: auth-worker(21529): Debug: sql(ppp at kabsi.at): username changed ppp at kabsi.at -> uppp Apr 22 12:35:59 imap21 dovecot: auth: Debug: userdb out: USER#0111#011ppp at kabsi.at#011home=/home/ppp#011uid=500#011gid=500#011quota_rule=*:storage=3100b:messages=1024#011login_user=uppp Apr 22 12:35:59 imap21 dovecot: quota-status(ppp at kabsi.at): Debug: auth input: ppp at kabsi.at home=/home/ppp uid=500 gid=500 quota_rule=*:storage=3100b:messages=1024 login_user=uppp Only auth-worker is looping through the returned fields (single "username changed" entry), and the username isn't changed. quota-status with ldap: Apr 22 13:25:14 imap21 dovecot: auth: Debug: ldap(m2500j6): user search: base=ou=Users,ou=Mail,dc=bnet,dc=at scope=subtree filter=(uid=m2500j6) fields=mailHost,gidNumber,homeDirectory Apr 22 13:25:14 imap21 dovecot: auth: Debug: ldap(m2500j6): result: gidNumber=168 homeDirectory=/tmp mailHost=uppp; homeDirectory,mailHost,gidNumber unused Apr 22 13:25:14 imap21 dovecot: auth: Debug: ldap(m2500j6): username changed m2500j6 -> uppp Apr 22 13:25:14 imap21 dovecot: auth: Debug: ldap(localhost): result: gidNumber=168 homeDirectory=/tmp mailHost=uppp Apr 22 13:25:14 imap21 dovecot: auth: Debug: userdb out: USER#0111#011localhost#011gid=168#011home=/tmp Apr 22 13:25:14 imap21 dovecot: quota-status(m2500j6): Debug: auth input: uppp gid=168 home=/tmp Apr 22 13:25:14 imap21 dovecot: quota-status(m2500j6): Debug: changed username to uppp Again! Only "auth", but username is changed. Even quota-status logs the username change. Thanks! Peter From bernd.kuhls at t-online.de Wed Apr 22 19:19:16 2015 From: bernd.kuhls at t-online.de (Bernd Kuhls) Date: Wed, 22 Apr 2015 21:19:16 +0200 Subject: SQLite does not depend on zlib, was: Re: [PATCH] Split sql drivers from lib-sql to plugins References: Message-ID: Bernd Kuhls wrote in news:XnsA3DF68DCAEF69berndkuhlsPkbjNfxxIA at bernd-kuhls.de: > Tomas Janousek wrote in news:20070413132731.GA8281 > @redhat.com: > >> - SQL_LIBS="$SQL_LIBS -lsqlite3 -lz" >> + SQLITE_LIBS="$SQLITE_LIBS -lsqlite3 -lz" > > Hi, > > this patch fixes a build error during cross compilation to a system without > the libz target package: > > --- dovecot-2.2.15.org/configure.ac 2014-10-25 05:57:08.000000000 +0200 > +++ dovecot-2.2.15/configure.ac 2014-11-08 10:06:23.015570150 +0100 > @@ -2293,7 +2293,7 @@ > if test $want_sqlite != no; then > AC_CHECK_LIB(sqlite3, sqlite3_open, [ > AC_CHECK_HEADER(sqlite3.h, [ > - SQLITE_LIBS="$SQLITE_LIBS -lsqlite3 -lz" > + SQLITE_LIBS="$SQLITE_LIBS -lsqlite3" > > AC_DEFINE(HAVE_SQLITE,, Build with SQLite3 support) > found_sql_drivers="$found_sql_drivers sqlite" > > Regards, Bernd > > ping ;) From tss at iki.fi Thu Apr 23 10:29:18 2015 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Apr 2015 13:29:18 +0300 Subject: Dovecot 2.2.16 crashes when fetching mails with Trojita 0.5 In-Reply-To: <1850489.9yPDusbyyE@talib> References: <1850489.9yPDusbyyE@talib> Message-ID: On 22 Apr 2015, at 08:25, Dennis Schridde wrote: > > Hello! > > When I fetch certain emails from my Dovecot 2.2.16 server using Trojita 0.5, > dovecot/imap will crash reproducibly. Please find config and backtrace from > coredump attached. I can't figure out how to reproduce this. But does http://hg.dovecot.org/dovecot-2.2/raw-rev/de2023e630cb happen to help? If not, it would be useful to know what is the IMAP command that Trojita sends that causes it and also one mail that causes the crash (if it doesn't crash with all mails). From Ralf.Hildebrandt at charite.de Thu Apr 23 14:34:24 2015 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Thu, 23 Apr 2015 16:34:24 +0200 Subject: Crash in dovecot/auth with backtrace Message-ID: <20150423143424.GO2252@charite.de> I'm seeing this odd crash with "USER\t531\t*@liquid-scan.de\tservice=quota-status" Which looks like something is being tested against our quota-status -- but I fail to see why an NON LOCAL address is being tested.... GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/local/dovecot-2.2/libexec/dovecot/auth...done. [New LWP 2289] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Core was generated by `dovecot/auth'. Program terminated with signal 6, Aborted. #0 0xb7724424 in __kernel_vsyscall () #0 0xb7724424 in __kernel_vsyscall () No symbol table info available. #1 0xb74a0661 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = pid = -1218617356 selftid = 2289 #2 0xb74a3a92 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0xbfd1c924, sa_sigaction = 0xbfd1c924}, sa_mask = {__val = {3077760610, 3218196756, 3076712520, 3218196744, 3077843556, 0, 3074764848, 1, 0, 1, 3077716256, 145215752, 1097, 3077184659, 3, 145244200, 1, 128, 0, 3218196816, 3218196744, 3218196756, 3218196764, 3077716256, 0, 3077194863, 145215720, 3076749582, 3077199789, 3077686824, 1097, 3077686824}}, sa_flags = 0, sa_restorer = 0xb76a5c2f } sigs = {__val = {32, 0 }} #3 0xb76a624e in default_fatal_finish (type=, status=status at entry=0) at failures.c:202 backtrace = 0x8a7c8d8 "/usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(+0x7825e) [0xb76a625e] -> /usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(+0x782e1) [0xb76a62e1] -> /usr/local/dovecot-2.2/lib/dovecot/libdovecot."... #4 0xb76a62e1 in i_internal_fatal_handler (ctx=0xbfd1c9f0, format=0x807a0c4 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfd1ca14 "\257j\a\b\371\004") at failures.c:671 status = 0 #5 0xb76a6e5f in i_panic ( format=format at entry=0x807a0c4 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:276 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0xbfd1ca14 "\257j\a\b\371\004" #6 0x0805873a in auth_request_set_login_username (request=0x8a945d8, username=0x8a7c548 "", error_r=0xbfd1cad4) at auth-request.c:1273 master_passdb = __FUNCTION__ = "auth_request_set_login_username" #7 0x08054c44 in master_input_auth_request (conn=conn at entry=0x8aa18b8, args=args at entry=0x8a941c1 "531\t*@liquid-scan.de\tservice=quota-status", cmd=cmd at entry=0x8076925 "USER", request_r=request_r at entry=0xbfd1cad0, error_r=error_r at entry=0xbfd1cad4) at auth-master-connection.c:209 auth_request = 0x8a945d8 list = 0x8a7c53c name = arg = username = 0x8a7c504 "*@liquid-scan.de" id = 531 #8 0x0805539c in master_input_user ( args=0x8a941c1 "531\t*@liquid-scan.de\tservice=quota-status", conn=0x8aa18b8) at auth-master-connection.c:306 auth_request = 0x8a92e70 error = 0x8ab8e81 "31298" ret = #9 auth_master_input_line ( line=0x8a941bc "USER\t531\t*@liquid-scan.de\tservice=quota-status", conn=0x8aa18b8) at auth-master-connection.c:615 No locals. #10 master_input (conn=0x8aa18b8) at auth-master-connection.c:679 _data_stack_cur_id = 3 line = ret = 40 #11 0xb76baf8b in io_loop_call_io (io=0x8a92ba8) at ioloop.c:501 ioloop = 0x8a844e8 t_id = 2 __FUNCTION__ = "io_loop_call_io" #12 0xb76bc272 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x8a844e8) at ioloop-epoll.c:220 ctx = 0x8a8b500 events = 0x8f1 event = 0x8a8b558 list = 0x8a92be0 io = tv = {tv_sec = 0, tv_usec = 999856} events_count = msecs = ret = 3 i = j = call = __FUNCTION__ = "io_loop_handler_run_internal" #13 0xb76bb01c in io_loop_handler_run (ioloop=ioloop at entry=0x8a844e8) at ioloop.c:548 No locals. #14 0xb76bb0a8 in io_loop_run (ioloop=0x8a844e8) at ioloop.c:525 __FUNCTION__ = "io_loop_run" #15 0xb76527ae in master_service_run (service=0x8a84418, callback=0x8063df0 ) at master-service.c:569 No locals. #16 0x08064490 in main (argc=1, argv=0x8a841e0) at main.c:393 c = -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From gessel at blackrosetech.com Thu Apr 23 14:39:02 2015 From: gessel at blackrosetech.com (David Gessel) Date: Thu, 23 Apr 2015 17:39:02 +0300 Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> Message-ID: <55390406.9070701@blackrosetech.com> very_dirty_syncs helped a lot - the problems still happen but only about every 30 minutes. It seems this flag prevents re-indexing on whatever was constantly inducing it (with every client-check, if there was a change written to the directory, is my best guess watching the logs go). I still get all the same symptoms, but far less frequently. I'm inclined to believe, as trivial as it may be to enumerate, that: Something is triggering dovecot to believe the indexes need to be rebuilt. When checking mail during the rebuild, clients get confused by UIDs in transition. Today I had to quit TB and restart because duplicates filled my preview pane. Mulberry has been better, when it gets confused now, it is usually sufficient to initiate a manual check or expunge to get the list to update. I would think that sdbox would alleviate these issues, no? -------- Original Message -------- Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads From: Timo Sirainen To: David Gessel Date: Sat Apr 18 2015 17:38:02 GMT+0300 (Arabic Standard Time) > On 18 Apr 2015, at 16:00, David Gessel wrote: >> >>> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving the way Dovecot wants filesystems to behave (readdir() sometimes skipping over files). I don't have any other suggestion than trying a different filesystem or OS. I haven't heard ZFS having these problems before though. >> >> >> Or migrating to sdbox. Absent any further suggestions, that will be my next step. My commitment to Maildir is far lower than my commitment to FreeBSD/ZFS. It is just a historical preference coming from a decade+ of courier IMAP. > > Actually as a workaround you could try maildir_very_dirty_syncs=yes which gets rid of most of the readdir()s. > From d.kuhn at heinlein-support.de Thu Apr 23 15:32:27 2015 From: d.kuhn at heinlein-support.de (Dennis Kuhn) Date: Thu, 23 Apr 2015 17:32:27 +0200 Subject: doveadm-server hangs with 100% cpu usage In-Reply-To: References: <55352503.5020703@heinlein-support.de> Message-ID: <5539108B.3060401@heinlein-support.de> On 21.04.2015 21:50, Timo Sirainen wrote: > On 20 Apr 2015, at 19:10, Dennis Kuhn wrote: >> My workaround is to delete the user directory on the replica so that >> the whole account is replicated again. This solves the problem for this >> specific account. > > So killing the doveadm-server process will cause it to hang again for the same user? That's good, since it means it can be reproduced by taking a copy of the mailboxes and trying to run "doveadm sync" manually on them locally, e.g.: > > doveadm -D -o mail=mdbox:/tmp/mdbox1 sync mdbox:/tmp/mdbox2 > > Does that hang? If yes, we can get further with it. The -D parameter is also helpful here - v2.2.16 logs much more useful debug logging with dsync that can also help catch these kind of hangs. Even if you can't reproduce the hang the above way, having mail_debug=yes for dsync and getting the debug logs from a hanging session would be useful. (But it may also mean that a hang might start flooding your logs with debug messages and eat up all the disk space.) > i will produce a debug log when the problem occurs next time. For the last few days everything is working fine. From tss at iki.fi Thu Apr 23 18:27:52 2015 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Apr 2015 21:27:52 +0300 Subject: Crash in dovecot/auth with backtrace In-Reply-To: <20150423143424.GO2252@charite.de> References: <20150423143424.GO2252@charite.de> Message-ID: <7680860F-8CF4-49BB-869D-0C346CE72752@iki.fi> On 23 Apr 2015, at 17:34, Ralf Hildebrandt wrote: > > I'm seeing this odd crash with "USER\t531\t*@liquid-scan.de\tservice=quota-status" > Which looks like something is being tested against our quota-status -- > but I fail to see why an NON LOCAL address is being tested.... Oh, that's not very good. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/65f825a8cd0b From torsten at tributh.net Thu Apr 23 22:16:39 2015 From: torsten at tributh.net (T.Tributh) Date: Fri, 24 Apr 2015 00:16:39 +0200 Subject: doveadm problem Message-ID: <55396F47.7030603@tributh.net> Hi, since several versions i have the following problem: Actually i am using: dovecot --version 2.2.16 (de2023e630cb) When i try to use doveadm i see the following error: doveadm pw -t {SSHA512}cywDi7p60qc1K0mK4zAC2NrnK86hntGgbQcAh3H9U3WEpZMFk1hj/MYQ81hJouP1FOsF/Jasc1BjzdaPeUU5fYLitEzV -p 1234 Fatal: Couldn't load required plugin /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: dlopen() failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: command_unregister I recognized that these lines in my main dovecot.conf are responsible: mail_plugins = quota imap_quota When i change it to mail_plugins = quota The command is working like expected: doveadm pw -t {SSHA512}cywDi7p60qc1K0mK4zAC2NrnK86hntGgbQcAh3H9U3WEpZMFk1hj/MYQ81hJouP1FOsF/Jasc1BjzdaPeUU5fYLitEzV -p 1234 {SSHA512}cywDi7p60qc1K0mK4zAC2NrnK86hntGgbQcAh3H9U3WEpZMFk1hj/MYQ81hJouP1FOsF/Jasc1BjzdaPeUU5fYLitEzV (verified) ....but than my thunderbird-client is not longer able to recognize to mailbox-size. Regards Torsten Tributh -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From user+dovecot at localhost.localdomain.org Thu Apr 23 22:39:18 2015 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 23 Apr 2015 22:39:18 +0000 Subject: Quota configuration issue [was: doveadm problem] In-Reply-To: <55396F47.7030603@tributh.net> References: <55396F47.7030603@tributh.net> Message-ID: <55397496.6070909@localhost.localdomain.org> On 04/23/2015 10:16 PM, T.Tributh wrote: > Hi, > since several versions i have the following problem: > Actually i am using: > > dovecot --version > 2.2.16 (de2023e630cb) > > When i try to use doveadm i see the following error: > > doveadm pw -t > {SSHA512}cywDi7p60qc1K0mK4zAC2NrnK86hntGgbQcAh3H9U3WEpZMFk1hj/MYQ81hJouP1FOsF/Jasc1BjzdaPeUU5fYLitEzV > -p 1234 > Fatal: Couldn't load required plugin > /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: dlopen() failed: > /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: > command_unregister > > I recognized that these lines in my main dovecot.conf are responsible: > > mail_plugins = quota imap_quota That's wrong for the global mail_plugins setting > > When i change it to > > mail_plugins = quota > ... > ....but than my thunderbird-client is not longer able to recognize to > mailbox-size. See http://wiki2.dovecot.org/Quota#Enabling_quota_plugins Regards, Pascal -- The trapper recommends today: decade.1511400 at localdomain.org From torsten at tributh.net Thu Apr 23 22:51:32 2015 From: torsten at tributh.net (T.Tributh) Date: Fri, 24 Apr 2015 00:51:32 +0200 Subject: Quota configuration issue [was: doveadm problem] In-Reply-To: <55397496.6070909@localhost.localdomain.org> References: <55396F47.7030603@tributh.net> <55397496.6070909@localhost.localdomain.org> Message-ID: <55397774.5070209@tributh.net> Thank you. That hint solved my issue. Perfect. Regards Torsten On 04/24/2015 12:39 AM, Pascal Volk wrote: > On 04/23/2015 10:16 PM, T.Tributh wrote: >> Hi, >> since several versions i have the following problem: >> Actually i am using: >> >> dovecot --version >> 2.2.16 (de2023e630cb) >> >> When i try to use doveadm i see the following error: >> >> doveadm pw -t >> {SSHA512}cywDi7p60qc1K0mK4zAC2NrnK86hntGgbQcAh3H9U3WEpZMFk1hj/MYQ81hJouP1FOsF/Jasc1BjzdaPeUU5fYLitEzV >> -p 1234 >> Fatal: Couldn't load required plugin >> /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: dlopen() failed: >> /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: >> command_unregister >> >> I recognized that these lines in my main dovecot.conf are responsible: >> >> mail_plugins = quota imap_quota > That's wrong for the global mail_plugins setting > >> When i change it to >> >> mail_plugins = quota >> ... >> ....but than my thunderbird-client is not longer able to recognize to >> mailbox-size. > See http://wiki2.dovecot.org/Quota#Enabling_quota_plugins > > > Regards, > Pascal -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From skdovecot at smail.inf.fh-brs.de Fri Apr 24 07:29:46 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 24 Apr 2015 09:29:46 +0200 (CEST) Subject: Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads In-Reply-To: <55390406.9070701@blackrosetech.com> References: <553247D0.1020400@blackrosetech.com> <5532557D.10000@blackrosetech.com> <3C3A4690-1FB3-4972-92E3-B2E1B554ECB6@iki.fi> <55390406.9070701@blackrosetech.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 23 Apr 2015, David Gessel wrote: > I'm inclined to believe, as trivial as it may be to enumerate, that: > > Something is triggering dovecot to believe the indexes need to be rebuilt. > When checking mail during the rebuild, clients get confused by UIDs in transition. > > I would think that sdbox would alleviate these issues, no? The real problem is that you do not know _why_ "Something is triggering dovecot to believe the indexes need to be rebuilt". This is the same for sdbox and mdbox, IMHO. That's why I asked about if some external process is trying to change the mail storage. Is there something except Dovecot that changes the mtime of the directories "new", "cur" or Maildir base? Do you deliver messages without Dovecot LDA/LMTP? Do you store different information in the Maildir? Do you (not) have separate mail storage and user home directories? Do you run a virus checker on file system level? Do you run two Dovecot instances on the same server, maybe as left over from some testing or crash? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVTnw6nz1H7kL/d9rAQKz+AgAuD0pyVOSQILqA6kLYgGOcUU0Wa8ca91H 3UB2t18AxVXx3/elCguTdNFpd0AB2dMfjkWaob/9ywr60i8wjNIZPQcWAI4hmeoV 2YHm+YJ8ndfSdYKQ6mN34mDBmD1+K69h8v5GVfQ5jOakcwPSqemBWY8RjfLtmSpU wgfRZtkG209BZxaAi3fj2J6xrpgE4BYG0g3KwafVRGLZMcBFujO0UJgPqeMmEMJY NwSgSgRoU1Aau+nTQGYrFzsSgtuG8R2LnF2l4nYWTL12PAiiqgbuAQCQ/WXf3jzQ OWtzcKM7laO9nc5iXuaAiO59TrV9VtevcTrE8usK2FdJke2C2bEVWw== =3KjE -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Fri Apr 24 07:32:08 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 24 Apr 2015 09:32:08 +0200 (CEST) Subject: doveadm problem In-Reply-To: <55396F47.7030603@tributh.net> References: <55396F47.7030603@tributh.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 24 Apr 2015, T.Tributh wrote: > doveadm pw -t > {SSHA512}cywDi7p60qc1K0mK4zAC2NrnK86hntGgbQcAh3H9U3WEpZMFk1hj/MYQ81hJouP1FOsF/Jasc1BjzdaPeUU5fYLitEzV > -p 1234 > Fatal: Couldn't load required plugin > /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: dlopen() failed: > /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: > command_unregister > > I recognized that these lines in my main dovecot.conf are responsible: > > mail_plugins = quota imap_quota is this line part of the imap section? If it is globally, remove imap_quota and add it to the mail_plugins in the imap section only. Verify by running doveconf -n . - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVTnxeHz1H7kL/d9rAQJ2iQf/WGhuu4+sDzH1IbjxRY81sU52/qhl93LU vgVMEsqPaTEWwWS4hzccDoF+AzDUkStH+wf4/B6eHDFx1WNmRzmXG3CUvu+lsJeC bNvz2dXHhlThDsii9gwdJ9cnVMMgJzR7y1Uj472to2yVUwxJaIU0h3xG/5PKkhC3 5OsL5J4ykOaWFVtFOS7qxxPV+VGBo+ioDA6XEhPfQ1F9KvB2J/9gPxADnzln1L7Y PyOrhmALuKzH8ilYEII2k9819SIbsmquLK6XW7Sd0XdB/UfUzBtyWELIK/gq7Bik JDbHtAqKcwAu2e8n/IM1Eih3dz73HCmJDYZIu9sXBi79Thd9gvwZ5g== =Ix7k -----END PGP SIGNATURE----- From paolo.cravero at csi.it Fri Apr 24 07:59:05 2015 From: paolo.cravero at csi.it (Paolo Cravero) Date: Fri, 24 Apr 2015 09:59:05 +0200 (CEST) Subject: acl and lazy_expunge plugins are incompatible? In-Reply-To: <1684658858.809710.1425396997470.JavaMail.open-xchange@comunica.csi.it> References: <1684658858.809710.1425396997470.JavaMail.open-xchange@comunica.csi.it> Message-ID: <870686407.254652.1429862345467.JavaMail.open-xchange@comunica.csi.it> Hello. Before going into deep testing of 2.2.16 (clean install tbd), I would like to know if someone is using succesfully both ACL and Lazy_expunge plugins. Perhaps I had a config error? Thanks, Paolo > Il 3 marzo 2015 alle 16.36 Paolo Cravero ha > scritto: > > > Hello list. > Following two previous unanswered requests > (http://www.dovecot.org/list/dovecot/2014-August/097449.html and > http://www.dovecot.org/list/dovecot/2014-May/096261.html), I fell into the > same problem: ACL and lazy_expunge plugins do not work together. > > I had lazy_expunge enabled working OK. Then I activated ACL plugin, and > gave > dovecot.2 visibily over paolo.cravero's Inbox: the IMAP connection fails > on > server-side. Relevant debug log is: > > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: Quota > grace: root=User quota bytes=576716800 (10%) > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: dict > quota: user=paolo.cravero at csi.it, > uri=file:/maildata1/home/csi.it/p/paolo.cravero/dovecot-quota, > noenforcing=0 > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: fs: > root=/maildata1/main/csi.it/p/paolo.cravero, > index=/maildata1/indexes/csi.it/p/paolo.cravero, indexpvt=, control=, > inbox=, alt=/maildata1/altstorage/csi.it/p/paolo.cravero > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl: > initializing backend with data: vfile > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl: acl > username = paolo.cravero at csi.it > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl: > owner > = 1 > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl > vfile: > Global ACLs disabled > Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Fatal: > lazy_expunge: Unknown namespace: '.EXPUNGED/' > > > Removing the lazy_expunge, ACLs do work as expected and I can > add/remove/use > them. > > > Is there a known compatibility issue? Or there's something wrong in my > config and someone else is running with both plugins enabled? > > Thanks, > Paolo > > PS: output of dovecot -n: > > # 2.2.15: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.el6.x86_64 x86_64 Red Hat Enterprise Linux Server > release 6.5 (Santiago) ext3 > auth_mechanisms = plain login > disable_plaintext_auth = no > imap_client_workarounds = tb-extra-mailbox-sep > lmtp_save_to_detail_mailbox = yes > mail_attachment_dir = /maildata1/attachments > mail_attachment_hash = %{sha256} > mail_debug = yes > mail_gid = 500 > mail_location = > mdbox:/maildata1/main/%d/%1n/%n:ALT=/maildata1/altstorage/%d/%1n/%n:INDEX=/maildata1/indexes/%d/%1n/%n > mail_plugins = quota mail_log notify lazy_expunge acl > mail_uid = 500 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date ihave > duplicate > mbox_write_locks = fcntl > mdbox_rotate_size = 50 M > namespace { > hidden = no > list = yes > location = > mdbox:/maildata1/main/%d/%1n/%n:INDEX=/maildata1/indexes/%d/%1n/%n:MAILBOXDIR=expunged > prefix = .EXPUNGED/ > subscriptions = no > } > namespace { > list = children > location = > mdbox:/maildata1/main/%%d/%%1n/%%n:ALT=/maildata1/altstorage/%%d/%%1n/%%n:INDEX=/maildata1/indexes/%%d/%%1n/%%n > prefix = user/%%u/ > separator = / > type = shared > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > acl = vfile > acl_shared_dict = file:/maildata1/db/shared-mailboxes.db > lazy_expunge = .EXPUNGED/ > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename flag_change append > mail_log_fields = uid box msgid size flags vsize > quota = dict:User quota::file:%h/dovecot-quota > quota_grace = 10%% > quota_rule = *:storage=10G > quota_rule2 = Trash:storage=+100M > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > } > protocols = imap pop3 lmtp sieve > service auth { > unix_listener auth-userdb { > group = vmail > user = vmail > } > } > service lmtp { > inet_listener lmtp { > address = 10.102.42.114 > port = 24 > } > process_min_avail = 2 > user = vmail > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lmtp { > mail_plugins = quota mail_log notify lazy_expunge acl sieve > } > protocol lda { > mail_plugins = quota mail_log notify lazy_expunge acl sieve > } > protocol imap { > mail_plugins = quota mail_log notify lazy_expunge acl imap_quota imap_acl > } > From r at sys4.de Fri Apr 24 10:31:20 2015 From: r at sys4.de (Ralf Hildebrandt) Date: Fri, 24 Apr 2015 12:31:20 +0200 Subject: Crash in dovecot/auth with backtrace In-Reply-To: <7680860F-8CF4-49BB-869D-0C346CE72752@iki.fi> References: <20150423143424.GO2252@charite.de> <7680860F-8CF4-49BB-869D-0C346CE72752@iki.fi> Message-ID: <20150424103120.GC2779@sys4.de> * Timo Sirainen : > On 23 Apr 2015, at 17:34, Ralf Hildebrandt wrote: > > > > I'm seeing this odd crash with "USER\t531\t*@liquid-scan.de\tservice=quota-status" > > Which looks like something is being tested against our quota-status -- > > but I fail to see why an NON LOCAL address is being tested.... > > Oh, that's not very good. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/65f825a8cd0b Thanks a lot :) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From r at sys4.de Fri Apr 24 10:50:06 2015 From: r at sys4.de (Ralf Hildebrandt) Date: Fri, 24 Apr 2015 12:50:06 +0200 Subject: fts_languages setting is missing - disabling? Message-ID: <20150424105006.GD2779@sys4.de> I don't find "fts_languages" in the documentation... What should I add there anbd where? doveadm(restore): Error: fts-dovecot: fts_languages setting is missing - disabling -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From r at sys4.de Fri Apr 24 10:54:04 2015 From: r at sys4.de (Ralf Hildebrandt) Date: Fri, 24 Apr 2015 12:54:04 +0200 Subject: fts_languages setting is missing - disabling? In-Reply-To: <20150424105006.GD2779@sys4.de> References: <20150424105006.GD2779@sys4.de> Message-ID: <20150424105404.GE2779@sys4.de> * Ralf Hildebrandt : > I don't find "fts_languages" in the documentation... What should I add > there anbd where? fts_languages = de,en seems to do the trick. But I wonder if there's something like "all" and what exactly this setting does. -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Fri Apr 24 10:56:30 2015 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Apr 2015 13:56:30 +0300 Subject: fts_languages setting is missing - disabling? In-Reply-To: <20150424105404.GE2779@sys4.de> References: <20150424105006.GD2779@sys4.de> <20150424105404.GE2779@sys4.de> Message-ID: <491827CC-627F-4681-B224-A4933E849425@iki.fi> On 24 Apr 2015, at 13:54, Ralf Hildebrandt wrote: > > * Ralf Hildebrandt : >> I don't find "fts_languages" in the documentation... What should I add >> there anbd where? > > fts_languages = de,en > seems to do the trick. But I wonder if there's something like "all" > and what exactly this setting does. That code shouldn't have run at all (unless you had configured fts_lucene = use_libfts). It's still work in progress. I'll get rid of the errors. From r at sys4.de Fri Apr 24 11:00:55 2015 From: r at sys4.de (Ralf Hildebrandt) Date: Fri, 24 Apr 2015 13:00:55 +0200 Subject: fts_languages setting is missing - disabling? In-Reply-To: <491827CC-627F-4681-B224-A4933E849425@iki.fi> References: <20150424105006.GD2779@sys4.de> <20150424105404.GE2779@sys4.de> <491827CC-627F-4681-B224-A4933E849425@iki.fi> Message-ID: <20150424110055.GF2779@sys4.de> * Timo Sirainen : > On 24 Apr 2015, at 13:54, Ralf Hildebrandt wrote: > > > > * Ralf Hildebrandt : > >> I don't find "fts_languages" in the documentation... What should I add > >> there anbd where? > > > > fts_languages = de,en > > seems to do the trick. But I wonder if there's something like "all" > > and what exactly this setting does. > > That code shouldn't have run at all (unless you had configured fts_lucene = use_libfts). It's still work in progress. I'll get rid of the errors. oops :) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From dominik at dominikbreu.de Fri Apr 24 11:10:22 2015 From: dominik at dominikbreu.de (Dominik Breu) Date: Fri, 24 Apr 2015 13:10:22 +0200 Subject: fts_languages setting is missing - disabling? In-Reply-To: <20150424110055.GF2779@sys4.de> References: <20150424105006.GD2779@sys4.de> <20150424105404.GE2779@sys4.de> <491827CC-627F-4681-B224-A4933E849425@iki.fi> <20150424110055.GF2779@sys4.de> Message-ID: <1429873822.17050.1.camel@dominikbreu.de> Hello Ralf and Timo, i got the same warning but my fts is configured to use solr and not lucene. applied the same quick fix as Ralf did maybe there is more to look at when fixing it. greets, dominik Am Freitag, den 24.04.2015, 13:00 +0200 schrieb Ralf Hildebrandt: > * Timo Sirainen : > > On 24 Apr 2015, at 13:54, Ralf Hildebrandt wrote: > > > > > > * Ralf Hildebrandt : > > >> I don't find "fts_languages" in the documentation... What should I add > > >> there anbd where? > > > > > > fts_languages = de,en > > > seems to do the trick. But I wonder if there's something like "all" > > > and what exactly this setting does. > > > > That code shouldn't have run at all (unless you had configured fts_lucene = use_libfts). It's still work in progress. I'll get rid of the errors. > > oops :) > From absolutely_free at libero.it Fri Apr 24 11:26:11 2015 From: absolutely_free at libero.it (absolutely_free at libero.it) Date: Fri, 24 Apr 2015 13:26:11 +0200 (CEST) Subject: Performance Message-ID: <1933591414.3360091429874771117.JavaMail.httpd@webmail-39.iol.local> Hi, at moment I have this environment: CentOS nginx + phpfpm Dovecot, with Maildir format Postfix Roundcube MySQL backend about 10000 mailusers dual core Intel(R) Pentium(R) D CPU 3.00GHz 8 GB RAM network storage device (Coraid), ext4 file system I have no performance issue now, but I need to move to a different server: FreeBSD 10.1-RELEASE nginx + phpfpm Dovecot Postfix Roundcube dual core Intel(R) Xeon(R) CPU 5120 @ 1.86GHz 16 GB RAM local storage with zfs file system My question is: is better to use SQLite instead of MySQL? Should I prefer dbox format? Thank you in advance for your opinion! From roland at micite.net Fri Apr 24 12:42:11 2015 From: roland at micite.net (Roland van Laar) Date: Fri, 24 Apr 2015 14:42:11 +0200 Subject: Performance In-Reply-To: <1933591414.3360091429874771117.JavaMail.httpd@webmail-39.iol.local> References: <1933591414.3360091429874771117.JavaMail.httpd@webmail-39.iol.local> Message-ID: <553A3A23.6040209@micite.net> On 24-04-15 13:26, absolutely_free at libero.it wrote: > Hi, > > at moment I have this environment: > > CentOS > nginx + phpfpm > Dovecot, with Maildir format > Postfix > Roundcube > MySQL backend > about 10000 mailusers > dual core Intel(R) Pentium(R) D CPU 3.00GHz > 8 GB RAM > network storage device (Coraid), ext4 file system > > I have no performance issue now, but I need to move to a different server: > > FreeBSD 10.1-RELEASE > nginx + phpfpm > Dovecot > Postfix > Roundcube > dual core Intel(R) Xeon(R) CPU 5120 @ 1.86GHz > 16 GB RAM > local storage with zfs file system > > My question is: is better to use SQLite instead of MySQL? Do you have a lot of writes? With SQLite you can run into locking issues: https://www.sqlite.org/lockingv3.html Or use the Write-Ahead Logging: https://www.sqlite.org/wal.html Regards, Roland > Should I prefer dbox format? > > Thank you in advance for your opinion! From giedrius at liubavicius.lt Fri Apr 24 13:19:45 2015 From: giedrius at liubavicius.lt (=?UTF-8?B?R2llZHJpdXMgTGl1YmF2acSNaXVz?=) Date: Fri, 24 Apr 2015 16:19:45 +0300 Subject: acl and lazy_expunge plugins are incompatible? In-Reply-To: <870686407.254652.1429862345467.JavaMail.open-xchange@comunica.csi.it> References: <1684658858.809710.1425396997470.JavaMail.open-xchange@comunica.csi.it> <870686407.254652.1429862345467.JavaMail.open-xchange@comunica.csi.it> Message-ID: <553A42F1.5020903@liubavicius.lt> Hello, as i've already sent it few times: it works....... but with minor patching (dirty patch bellow) Keep in mind, that for using this patch to work, you should add *lazy_expunge_ignore_namespace_not_found* parameter to your configuration. My own configuration below: > plugin { > lazy_expunge = .EXPUNGED/ > lazy_expunge_ignore_namespace_not_found = TRUE > } Patch: > diff -C3 -d -p -r -xMakefile -x.deps -x.libs -x.lo -x.o > ../dovecot/src/plugins/lazy-expunge/lazy-expunge-plugin.c > ./src/plugins/lazy-expunge/lazy-expunge-plugin.c > *** ../dovecot/src/plugins/lazy-expunge/lazy-expunge-plugin.c > 2014-04-15 18:11:56.000000000 +0300 > --- ./src/plugins/lazy-expunge/lazy-expunge-plugin.c 2014-06-28 > 19:05:59.269530965 +0300 > *************** struct lazy_expunge_mail_user { > *** 34,39 **** > --- 34,40 ---- > struct mail_namespace *lazy_ns; > const char *env; > bool copy_only_last_instance; > + bool ignore_namespace_notfound; > }; > > struct lazy_expunge_mailbox_list { > *************** lazy_expunge_mail_namespaces_created(str > *** 420,428 **** > if (luser == NULL) > return; > > luser->lazy_ns = mail_namespace_find_prefix(namespaces, > luser->env); > ! if (luser->lazy_ns == NULL) > ! i_fatal("lazy_expunge: Unknown namespace: '%s'", > luser->env); > mail_namespace_ref(luser->lazy_ns); > > /* we don't want to override this namespace's expunge > operation. */ > --- 421,447 ---- > if (luser == NULL) > return; > > + if (namespaces->user && namespaces->user->mail_debug){ > + struct mail_namespace *ns; > + int envl = strlen(luser->env); > + for(ns = namespaces; ns != NULL; ns=ns->next){ > + i_warning("LAZY_EXPUNGE[%u|%s]: p%u|%s[%u], u(%s;%s) > o(%s;%s)", > + envl, luser->env, > + ns->prefix_len, ns->prefix, ns->type, > + ns->user->username, ns->user->_home, > + ns->owner?ns->owner->username:NULL, > ns->owner?ns->owner->_home:NULL > + ); > + } > + i_warning("LAZY_EXPUNGE[%u|%s]: _________________________ > LIST ENDS __________________________", envl, luser->env); > + } > luser->lazy_ns = mail_namespace_find_prefix(namespaces, > luser->env); > ! if (luser->lazy_ns == NULL){ > ! if (luser->ignore_namespace_notfound){ > ! i_warning("lazy_expunge: Unknown namespace: '%s'", > luser->env); > ! return; > ! }else > ! i_fatal("lazy_expunge: Unknown namespace: '%s'", > luser->env); > ! } > mail_namespace_ref(luser->lazy_ns); > > /* we don't want to override this namespace's expunge > operation. */ > *************** static void lazy_expunge_mail_user_creat > *** 455,460 **** > --- 474,481 ---- > luser->env = env; > luser->copy_only_last_instance = > mail_user_plugin_getenv(user, > "lazy_expunge_only_last_instance") != NULL; > + luser->ignore_namespace_notfound = > + mail_user_plugin_getenv(user, > "lazy_expunge_ignore_namespace_not_found") != NULL; > > MODULE_CONTEXT_SET(user, > lazy_expunge_mail_user_module, luser); > } else if (user->mail_debug) { 2015.04.24 10:59, Paolo Cravero ra??: > Hello. > > Before going into deep testing of 2.2.16 (clean install tbd), I would like > to know if someone is using succesfully both ACL and Lazy_expunge plugins. > Perhaps I had a config error? > > Thanks, > Paolo > >> Il 3 marzo 2015 alle 16.36 Paolo Cravero ha >> scritto: >> >> >> Hello list. >> Following two previous unanswered requests >> (http://www.dovecot.org/list/dovecot/2014-August/097449.html and >> http://www.dovecot.org/list/dovecot/2014-May/096261.html), I fell into the >> same problem: ACL and lazy_expunge plugins do not work together. >> >> I had lazy_expunge enabled working OK. Then I activated ACL plugin, and >> gave >> dovecot.2 visibily over paolo.cravero's Inbox: the IMAP connection fails >> on >> server-side. Relevant debug log is: >> >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: Quota >> grace: root=User quota bytes=576716800 (10%) >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: dict >> quota: user=paolo.cravero at csi.it, >> uri=file:/maildata1/home/csi.it/p/paolo.cravero/dovecot-quota, >> noenforcing=0 >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: fs: >> root=/maildata1/main/csi.it/p/paolo.cravero, >> index=/maildata1/indexes/csi.it/p/paolo.cravero, indexpvt=, control=, >> inbox=, alt=/maildata1/altstorage/csi.it/p/paolo.cravero >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl: >> initializing backend with data: vfile >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl: acl >> username = paolo.cravero at csi.it >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl: >> owner >> = 1 >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Debug: acl >> vfile: >> Global ACLs disabled >> Mar 3 15:59:02 tst-msg03 dovecot: imap(dovecot.2 at csi.it): Fatal: >> lazy_expunge: Unknown namespace: '.EXPUNGED/' >> >> >> Removing the lazy_expunge, ACLs do work as expected and I can >> add/remove/use >> them. >> >> >> Is there a known compatibility issue? Or there's something wrong in my >> config and someone else is running with both plugins enabled? >> >> Thanks, >> Paolo >> >> PS: output of dovecot -n: >> >> # 2.2.15: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-431.el6.x86_64 x86_64 Red Hat Enterprise Linux Server >> release 6.5 (Santiago) ext3 >> auth_mechanisms = plain login >> disable_plaintext_auth = no >> imap_client_workarounds = tb-extra-mailbox-sep >> lmtp_save_to_detail_mailbox = yes >> mail_attachment_dir = /maildata1/attachments >> mail_attachment_hash = %{sha256} >> mail_debug = yes >> mail_gid = 500 >> mail_location = >> mdbox:/maildata1/main/%d/%1n/%n:ALT=/maildata1/altstorage/%d/%1n/%n:INDEX=/maildata1/indexes/%d/%1n/%n >> mail_plugins = quota mail_log notify lazy_expunge acl >> mail_uid = 500 >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope encoded-character >> vacation subaddress comparator-i;ascii-numeric relational regex imap4flags >> copy include variables body enotify environment mailbox date ihave >> duplicate >> mbox_write_locks = fcntl >> mdbox_rotate_size = 50 M >> namespace { >> hidden = no >> list = yes >> location = >> mdbox:/maildata1/main/%d/%1n/%n:INDEX=/maildata1/indexes/%d/%1n/%n:MAILBOXDIR=expunged >> prefix = .EXPUNGED/ >> subscriptions = no >> } >> namespace { >> list = children >> location = >> mdbox:/maildata1/main/%%d/%%1n/%%n:ALT=/maildata1/altstorage/%%d/%%1n/%%n:INDEX=/maildata1/indexes/%%d/%%1n/%%n >> prefix = user/%%u/ >> separator = / >> type = shared >> } >> namespace inbox { >> inbox = yes >> location = >> mailbox Drafts { >> auto = subscribe >> special_use = \Drafts >> } >> mailbox Junk { >> auto = subscribe >> special_use = \Junk >> } >> mailbox Sent { >> auto = subscribe >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> auto = subscribe >> special_use = \Trash >> } >> prefix = >> type = private >> } >> passdb { >> args = /etc/dovecot/dovecot-ldap.conf.ext >> driver = ldap >> } >> plugin { >> acl = vfile >> acl_shared_dict = file:/maildata1/db/shared-mailboxes.db >> lazy_expunge = .EXPUNGED/ >> mail_log_events = delete undelete expunge copy mailbox_delete >> mailbox_rename flag_change append >> mail_log_fields = uid box msgid size flags vsize >> quota = dict:User quota::file:%h/dovecot-quota >> quota_grace = 10%% >> quota_rule = *:storage=10G >> quota_rule2 = Trash:storage=+100M >> quota_warning = storage=95%% quota-warning 95 %u >> quota_warning2 = storage=80%% quota-warning 80 %u >> } >> protocols = imap pop3 lmtp sieve >> service auth { >> unix_listener auth-userdb { >> group = vmail >> user = vmail >> } >> } >> service lmtp { >> inet_listener lmtp { >> address = 10.102.42.114 >> port = 24 >> } >> process_min_avail = 2 >> user = vmail >> } >> ssl_cert = > ssl_key = > userdb { >> args = /etc/dovecot/dovecot-ldap.conf.ext >> driver = ldap >> } >> protocol lmtp { >> mail_plugins = quota mail_log notify lazy_expunge acl sieve >> } >> protocol lda { >> mail_plugins = quota mail_log notify lazy_expunge acl sieve >> } >> protocol imap { >> mail_plugins = quota mail_log notify lazy_expunge acl imap_quota imap_acl >> } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: OpenPGP digital signature URL: From superinterstellar at gmail.com Fri Apr 24 13:43:33 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Fri, 24 Apr 2015 20:43:33 +0700 Subject: No subject Message-ID: From superinterstellar at gmail.com Fri Apr 24 13:45:53 2015 From: superinterstellar at gmail.com (Kevin Laurie) Date: Fri, 24 Apr 2015 20:45:53 +0700 Subject: Using Identities to send Emails, question on Email Storage Message-ID: hi, i was wondering that when sending mail with a different identity(bob at mydomain.com using help at mydomain.com identity), why does it not copy the message to help at mydomain.com(Sent box). instead it only shows it on bob at mydomain.com(Sent box). appreciate if someone could advise. could someone advise how to fix this as i would like to see the message in help at mydomain.com(SentBox) too. thanks kevin From srguglielmo at gmail.com Fri Apr 24 15:55:00 2015 From: srguglielmo at gmail.com (Stephen R Guglielmo) Date: Fri, 24 Apr 2015 11:55:00 -0400 Subject: Auth-worker, Unknown User Message-ID: <20150424115500.04afc3aa@lapsdeb> Hi list, I'm running Debian Jessie (8). I have Postfix and Dovecot working successfully. I attempted to setup LMTP in order to enable sieve support, but it seems I was not successful. Dovecot version 2.2.13. Postfix accepts an incoming test mail I sent, then tries to deliver it to Dovecot via LMTP: dovecot: lmtp(13493): Connect from local dovecot: auth-worker(13495): pam(srg at example.com): unknown user dovecot: lmtp(13493): Disconnect from local: Successful quit Postfix then bounces my mail with a "550 User doesn't exist." It seems that Dovecot is trying to lookup my whole address (srg at example.com) in PAM instead of just the username ("srg"), which does exist. What can I do to avoid this? I have searched the internet about this and found a few references to "args = %s" and "args = username_format=%n" for passdb and/or userdb, but I have tried both (restarting Dovecot) to no avail. Thank you! `doveconf -n` below: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab103.6 x86_64 Debian 8.0 auth_verbose = yes first_valid_uid = 1000 last_valid_uid = 1000 listen = 167.114.96.243, 2607:5300:100:200::fce lmtp_save_to_detail_mailbox = yes mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = From bluewind at xinu.at Fri Apr 24 16:50:28 2015 From: bluewind at xinu.at (Florian Pritz) Date: Fri, 24 Apr 2015 18:50:28 +0200 Subject: [BUG] imap-login segfault when running nmap -sV In-Reply-To: <20150421151058.GK3438@nordisch.org> References: <55361767.1040900@xinu.at> <20150421151058.GK3438@nordisch.org> Message-ID: <553A7454.4000505@xinu.at> On 21.04.2015 17:10, Marcus Rueckert wrote: >> > #0 0x00007f120100260b in ssl3_get_client_hello () from /usr/lib/libssl.so.1.0.0 >> > #1 0x00007f120100738f in ssl3_accept () from /usr/lib/libssl.so.1.0.0 >> > #2 0x00007f1201012b36 in ssl3_write_bytes () from /usr/lib/libssl.so.1.0.0 >> > #3 0x00007f1201906200 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #4 0x00007f12019062d8 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #5 0x00007f1201905f72 in ssl_proxy_destroy () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #6 0x00007f12019060e4 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #7 0x00007f1201906671 in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #8 0x00007f1201902efa in ?? () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #9 0x00007f120162d503 in ?? () from /usr/lib/dovecot/libdovecot.so.0 >> > #10 0x00007f120168d62c in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 >> > #11 0x00007f120168e665 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 >> > #12 0x00007f120168d699 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 >> > #13 0x00007f120168d718 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 >> > #14 0x00007f120162cb23 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 >> > #15 0x00007f1201903788 in login_binary_run () from /usr/lib/dovecot/libdovecot-login.so.0 >> > #16 0x00007f120127d800 in __libc_start_main () from /usr/lib/libc.so.6 >> > #17 0x0000000000402909 in _start () > > looks more like a crash in openssl. It is indeed crashing in openssl, but apparently because dovecot ignores an earlier returned error and the ssl object is not properly set up. There is a patch that works around this, but I don't yet know if it will be included in openssl. Anyway, this should (also) be fixed in dovecot. More details: https://rt.openssl.org/Ticket/Display.html?id=3818 Florian -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 801 bytes Desc: OpenPGP digital signature URL: From bluewind at xinu.at Fri Apr 24 16:53:24 2015 From: bluewind at xinu.at (Florian Pritz) Date: Fri, 24 Apr 2015 18:53:24 +0200 Subject: [BUG] imap-login segfault when running nmap -sV In-Reply-To: <553A7454.4000505@xinu.at> References: <55361767.1040900@xinu.at> <20150421151058.GK3438@nordisch.org> <553A7454.4000505@xinu.at> Message-ID: <553A7504.90603@xinu.at> On 24.04.2015 18:50, Florian Pritz wrote: > More details: https://rt.openssl.org/Ticket/Display.html?id=3818 login is guest/guest -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 801 bytes Desc: OpenPGP digital signature URL: From user+dovecot at localhost.localdomain.org Fri Apr 24 18:54:55 2015 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Fri, 24 Apr 2015 18:54:55 +0000 Subject: Auth-worker, Unknown User In-Reply-To: <20150424115500.04afc3aa@lapsdeb> References: <20150424115500.04afc3aa@lapsdeb> Message-ID: <553A917F.6080504@localhost.localdomain.org> On 04/24/2015 03:55 PM, Stephen R Guglielmo wrote: > Hi list, > > I'm running Debian Jessie (8). I have Postfix and Dovecot working > successfully. I attempted to setup LMTP in order to enable sieve > support, but it seems I was not successful. Dovecot version 2.2.13. > > Postfix accepts an incoming test mail I sent, then tries to deliver it > to Dovecot via LMTP: > > dovecot: lmtp(13493): Connect from local > dovecot: auth-worker(13495): pam(srg at example.com): unknown user > dovecot: lmtp(13493): Disconnect from local: Successful quit > > Postfix then bounces my mail with a "550 User doesn't exist." It seems > that Dovecot is trying to lookup my whole address (srg at example.com) in > PAM instead of just the username ("srg"), which does exist. What can I > do to avoid this? > > I have searched the internet about this and found a few references to > "args = %s" and "args = username_format=%n" for passdb and/or userdb, > but I have tried both (restarting Dovecot) to no avail. > > Thank you! > > `doveconf -n` below: > > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-042stab103.6 x86_64 Debian 8.0 > auth_verbose = yes > ... > passdb { > driver = pam > } > ... > userdb { > driver = passwd > } > ... Since you only have local (system) users, you should be able to solve the problem by setting: auth_username_format = %Ln in your /etc/dovecot/conf.d/10-auth.conf Regards, Pascal -- The trapper recommends today: c01dcofe.1511401 at localdomain.org From trashcan at odo.in-berlin.de Fri Apr 24 19:00:09 2015 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Fri, 24 Apr 2015 21:00:09 +0200 Subject: FYI: dovecot (008632bdfd2c) compilation woes, and minor glitch regarding update-version.sh Message-ID: Hi ? 1) I'm trying to compile a recent hg dovecot version (008632bdfd2c) at a FBSD10-STABLE system without success: libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -I/usr/local/include -DUDHRDIR=\"../../src/lib-fts\" -DDATADIR=\"/usr/local/share/dovecot\" -DTEST_STOPWORDS_DIR=\"../../src/lib-fts\" -I/usr/local/include -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -I/usr/local/include -MT fts-tokenizer-generic.lo -MD -MP -MF .deps/fts-tokenizer-generic.Tpo -c fts-tokenizer-generic.c -fPIC -DPIC -o .libs/fts-tokenizer-generic.o fts-tokenizer-generic.c:111:18: error: use of undeclared identifier 'White_Space' if (uint32_find(White_Space, N_ELEMENTS(White_Space), c, &idx)) ^ fts-tokenizer-generic.c:113:18: error: use of undeclared identifier 'Dash' if (uint32_find(Dash, N_ELEMENTS(Dash), c, &idx)) ^ [?] fts-tokenizer-generic.c:212:18: error: use of undeclared identifier 'MidLetter' if (uint32_find(MidLetter, N_ELEMENTS(MidLetter), c, &idx)) ^ fts-tokenizer-generic.c:214:18: error: use of undeclared identifier 'MidNum' if (uint32_find(MidNum, N_ELEMENTS(MidNum), c, &idx)) ^ fatal error: too many errors emitted, stopping now [-ferror-limit=] 20 errors generated. Makefile:591: recipe for target 'fts-tokenizer-generic.lo' failed gmake[4]: *** [fts-tokenizer-generic.lo] Error 1 gmake[4]: Leaving directory '/usr/local/etc/dovecot/SOURCE/dovecot-2.2/src/lib-fts' 2) I don't have a python binary installed, only a python2 link to the python27 binary (FBSD, and python27 from ports). Thus, update-version.sh will fail to evaluate hg's changeset. As a quick fix I needed to create a link: python -> python2 Regards, Michael From leolistas at solutti.com.br Fri Apr 24 19:50:26 2015 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Fri, 24 Apr 2015 16:50:26 -0300 Subject: Performance In-Reply-To: <1933591414.3360091429874771117.JavaMail.httpd@webmail-39.iol.local> References: <1933591414.3360091429874771117.JavaMail.httpd@webmail-39.iol.local> Message-ID: <553A9E82.4060402@solutti.com.br> On 24/04/15 08:26, absolutely_free at libero.it wrote: > My question is: is better to use SQLite instead of MySQL? > Should I prefer dbox format? > > Thank you in advance for your opinion! While 10k accounts is not a few accounts, i wouldn't call that a LOT of accounts neither. Assuming that the query cache is active on MySQL, probably almost all your queries are being answered directly from the cache and, if not that, your tables shouldnt be that big and after a few queries should be all in cache memory of the Linux system. Your I/O costs on the MySQL should be very very very low, o i really doubt that MySQL is being part of your problem here. Unless, of course, that you have other heavy databases running on the MySQL instance your mail system is using... -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From hanno at hboeck.de Fri Apr 24 21:17:20 2015 From: hanno at hboeck.de (Hanno =?UTF-8?B?QsO2Y2s=?=) Date: Fri, 24 Apr 2015 23:17:20 +0200 Subject: [patch] TLS Handshake failures can crash imap-login Message-ID: <20150424231720.09350797@pc1.fritz.box> Hi, I tracked down a tricky bug in dovecot that can cause the imap-login and pop3-login processes to crash on handshake failures. This can be tested by disabling SSLv3 in the dovecot config (ssl_protocols = !SSLv2 !SSLv3) and trying to connect with openssl and forced sslv3 (openssl s_client -ssl3 -connect localhost:995). This would cause a crash. What was going on is this: In ssl-proxy-openssl.c in line 545 in the function ssl_step() the function ssl_handshake() is called. There SSL_accept() is called. If SSL_accept failes - because a client sent an invalid packet or something the server doesn't support or any other reason - ssl_handle_error() will be called. ssl_handle_error() will call ssl_proxy_destroy(). ssl_proxy_destroy() will then call ssl_proxy_flush(). And ssl_proxy_flush will call ssl_step() again. Here we have a loop. Now when SSL_accept() gets called again on the same context this is an invalid state for OpenSSL and it crashes. What to do? In essence, if ssl_proxy_destroy is called it shouldn't try to finish the handshake if the handshake hasn't even started due to an error. This can be done by a simple if check, see attached patch. I think this should do it. I have seen that a bug that is probably rootet in this has been posted here before regarding ssl3-disabled configs: http://dovecot.org/pipermail/dovecot/2015-March/100188.html cu, -- Hanno B?ck http://hboeck.de/ mail/jabber: hanno at hboeck.de GPG: BBB51E42 -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-dont-crash-on-ssl-handshake-failure.diff Type: text/x-patch Size: 421 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From srguglielmo at gmail.com Fri Apr 24 21:22:49 2015 From: srguglielmo at gmail.com (Stephen R Guglielmo) Date: Fri, 24 Apr 2015 17:22:49 -0400 Subject: Auth-worker, Unknown User In-Reply-To: <553A917F.6080504@localhost.localdomain.org> References: <20150424115500.04afc3aa@lapsdeb> <553A917F.6080504@localhost.localdomain.org> Message-ID: <20150424172249.0d458af9@lapsdeb> On Fri, 24 Apr 2015 18:54:55 +0000 Pascal Volk wrote: > On 04/24/2015 03:55 PM, Stephen R Guglielmo wrote: > > Hi list, > > > > I'm running Debian Jessie (8). I have Postfix and Dovecot working > > successfully. I attempted to setup LMTP in order to enable sieve > > support, but it seems I was not successful. Dovecot version 2.2.13. > > > > Postfix accepts an incoming test mail I sent, then tries to deliver > > it to Dovecot via LMTP: > > > > dovecot: lmtp(13493): Connect from local > > dovecot: auth-worker(13495): pam(srg at example.com): unknown user > > dovecot: lmtp(13493): Disconnect from local: Successful quit > > > > Postfix then bounces my mail with a "550 User doesn't exist." It > > seems that Dovecot is trying to lookup my whole address > > (srg at example.com) in PAM instead of just the username ("srg"), > > which does exist. What can I do to avoid this? > > > > I have searched the internet about this and found a few references > > to "args = %s" and "args = username_format=%n" for passdb and/or > > userdb, but I have tried both (restarting Dovecot) to no avail. > > > > Thank you! > > > > `doveconf -n` below: > > > > # 2.2.13: /etc/dovecot/dovecot.conf > > # OS: Linux 2.6.32-042stab103.6 x86_64 Debian 8.0 > > auth_verbose = yes > > ... > > passdb { > > driver = pam > > } > > ... > > userdb { > > driver = passwd > > } > > ... > > Since you only have local (system) users, you should be able to solve > the problem by setting: > > auth_username_format = %Ln > > in your /etc/dovecot/conf.d/10-auth.conf > > > Regards, > Pascal That was the solution! Thank you very much, Pascal! -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 801 bytes Desc: OpenPGP digital signature URL: From leolistas at solutti.com.br Sat Apr 25 00:38:45 2015 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Fri, 24 Apr 2015 21:38:45 -0300 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <20150424231720.09350797@pc1.fritz.box> References: <20150424231720.09350797@pc1.fritz.box> Message-ID: <553AE215.2090707@solutti.com.br> On 24/04/15 18:17, Hanno B?ck wrote: > Hi, > > I tracked down a tricky bug in dovecot that can cause the imap-login > and pop3-login processes to crash on handshake failures. > This can be tested by disabling SSLv3 in the dovecot config > (ssl_protocols = !SSLv2 !SSLv3) and trying to connect with openssl and > forced sslv3 (openssl s_client -ssl3 -connect localhost:995). This > would cause a crash. > > I couldnt reproduce that on a fully patched CentOS 6.6 box [root at correio ~]# cat /etc/redhat-release CentOS release 6.6 (Final) [root at correio ~]# openssl version OpenSSL 1.0.1e-fips 11 Feb 2013 [root at correio ~]# dovecot --version 2.2.16 (compiled from sources, not from any binary package) [root at correio ~]# grep ssl_proto /etc/dovecot/extras/10-ssl.conf ssl_protocols = !SSLv2 !SSLv3 from dovecot logs when running the openssl command: Apr 24 21:36:38 correio dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, TLS handshaking: Disconnected dont know if it matters, but i'm running signed certificated from RapidSSL, not self-signed ones The openssl command returns an error but i see no crash at all [root at correio ~]# openssl s_client -ssl3 -connect localhost:995 CONNECTED(00000003) 140022021363528:error:14094410:SSL routines:SSL3_READ_BYTES:sslv3 alert handshake failure:s3_pkt.c:1259:SSL alert number 40 140022021363528:error:1409E0E5:SSL routines:SSL3_WRITE_BYTES:ssl handshake failure:s3_pkt.c:598: --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 7 bytes and written 0 bytes --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE SSL-Session: Protocol : SSLv3 Cipher : 0000 Session-ID: Session-ID-ctx: Master-Key: Key-Arg : None Krb5 Principal: None PSK identity: None PSK identity hint: None Start Time: 1429922121 Timeout : 7200 (sec) Verify return code: 0 (ok) --- [root at correio ~]# -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From lista at xdrv.co.uk Sat Apr 25 08:55:50 2015 From: lista at xdrv.co.uk (James) Date: Sat, 25 Apr 2015 09:55:50 +0100 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <20150424231720.09350797@pc1.fritz.box> References: <20150424231720.09350797@pc1.fritz.box> Message-ID: <553B5696.6040000@xdrv.co.uk> On 24/04/2015 22:17, Hanno B?ck wrote: Hello, > I tracked down a tricky bug in dovecot that can cause the imap-login > and pop3-login processes to crash on handshake failures. > This can be tested by disabling SSLv3 in the dovecot config > (ssl_protocols = !SSLv2 !SSLv3) and trying to connect with openssl and > forced sslv3 (openssl s_client -ssl3 -connect localhost:995). This > would cause a crash. Thank you for your work on this. > I have seen that a bug that is probably rootet in this has been posted > here before regarding ssl3-disabled configs: > http://dovecot.org/pipermail/dovecot/2015-March/100188.html I made that earlier report. Here is another similar report: http://dovecot.org/pipermail/dovecot/2015-April/100576.html James. From teemu.huovila at dovecot.fi Sat Apr 25 18:36:25 2015 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Sat, 25 Apr 2015 21:36:25 +0300 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <553B5696.6040000@xdrv.co.uk> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> Message-ID: <553BDEA9.4070000@dovecot.fi> On 04/25/2015 11:55 AM, James wrote: > On 24/04/2015 22:17, Hanno B?ck wrote: > > Hello, > >> I tracked down a tricky bug in dovecot that can cause the imap-login >> and pop3-login processes to crash on handshake failures. >> This can be tested by disabling SSLv3 in the dovecot config >> (ssl_protocols = !SSLv2 !SSLv3) and trying to connect with openssl and >> forced sslv3 (openssl s_client -ssl3 -connect localhost:995). This >> would cause a crash. > > Thank you for your work on this. > > >> I have seen that a bug that is probably rootet in this has been posted >> here before regarding ssl3-disabled configs: >> http://dovecot.org/pipermail/dovecot/2015-March/100188.html > > I made that earlier report. Here is another similar report: > > http://dovecot.org/pipermail/dovecot/2015-April/100576.html I was unable to reproduce this nor the first report. Could you describe your environment in more detail? What version of openssl do you have? What is the crash message you are seeing? br, Teemu Huovila From niyalevi at gmail.com Sun Apr 26 09:32:38 2015 From: niyalevi at gmail.com (shadrock uhuru) Date: Sun, 26 Apr 2015 10:32:38 +0100 Subject: seeking sasl configuration example Message-ID: <553CB0B6.5040102@gmail.com> hi everyone could someone show me there sasl configuration section in their dovecot.conf, i have postfix and dovecot setup for virtual users (no system users) everything works fine including tls, i have tried various examples off the web for sasl but they either have obsolete parameters or are for a setup with system users, i would prefer to use dovecots sasl implementation. dovecot --version = 2.1.7 cat dovecot.conf ###################### ###################### disable_plaintext_auth = no mail_privileged_group = mail log_path = /var/log/dovecot.log # auth_verbose=yes # auth_debug=yes # auth_debug_passwords=yes mail_debug=yes # verbose_ssl=yes passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = "pop3 imap lmtp" protocol imap { mail_plugins = " autocreate" } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = junk autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = junk } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } protocol lmtp { postmaster_address=postmaster at mydomain.com hostname=niya.mydomain.com } ssl_cert = References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> Message-ID: <20150426123932.3c8204a7@pc1.fritz.box> On Sat, 25 Apr 2015 21:36:25 +0300 Teemu Huovila wrote: > I was unable to reproduce this nor the first report. Could you > describe your environment in more detail? What version of openssl do > you have? What is the crash message you are seeing? both openssl and dovecot latest (1.0.2a, 2.2.16) on a Gentoo. Please note that it's not dovecot itself that's crashing but pop3-login/imap-login. You don't note these if you haven't some kind of segfault reporting. -- Hanno B?ck http://hboeck.de/ mail/jabber: hanno at hboeck.de GPG: BBB51E42 -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From bluewind at xinu.at Sun Apr 26 13:07:03 2015 From: bluewind at xinu.at (Florian Pritz) Date: Sun, 26 Apr 2015 15:07:03 +0200 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <553BDEA9.4070000@dovecot.fi> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> Message-ID: <553CE2F7.70405@xinu.at> On 25.04.2015 20:36, Teemu Huovila wrote: >> [..] http://dovecot.org/pipermail/dovecot/2015-April/100576.html > I was unable to reproduce this nor the first report. Could you > describe your environment in more detail? What version of openssl do > you have? What is the crash message you are seeing? Since there are three people involved I kindly ask you to be more specific as to who should provide which (exact) information. Given you ask for it right after quoting my link all I can tell you is that I provide all the information you ask for (openssl version, crash message) in the link you quoted. Where (openssl, distro, dovecot version) did you try reproducing it? I've asked a friend using debian or centos (don't know which) and he was unable to reproduce so as always they might be patching something, it might not affect old software or they don't link with openssl. I also provide a link to an openssl dev explaining why this happens later in my thread. Here's the openssl bug report about this issue: . Login for the openssl tracker is guest/guest. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 801 bytes Desc: OpenPGP digital signature URL: From edgar at pettijohn-web.com Sun Apr 26 14:22:12 2015 From: edgar at pettijohn-web.com (Edgar Pettijohn III) Date: Sun, 26 Apr 2015 09:22:12 -0500 Subject: seeking sasl configuration example In-Reply-To: <553CB0B6.5040102@gmail.com> References: <553CB0B6.5040102@gmail.com> Message-ID: <118C4DF2-A7B0-4801-899C-27B98652E10D@pettijohn-web.com> On Apr 26, 2015, at 4:32 AM, shadrock uhuru wrote: > hi everyone > could someone show me there sasl configuration section in their > dovecot.conf, > i have postfix and dovecot setup for virtual users (no system users) > everything works fine including tls, > i have tried various examples off the web for sasl but they either have > obsolete parameters > or are for a setup with system users, > i would prefer to use dovecots sasl implementation. > > dovecot --version = 2.1.7 > > cat dovecot.conf > > ###################### > ###################### > > disable_plaintext_auth = no > mail_privileged_group = mail > > log_path = /var/log/dovecot.log > # auth_verbose=yes > # auth_debug=yes > # auth_debug_passwords=yes > mail_debug=yes > # verbose_ssl=yes > > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > > > protocols = "pop3 imap lmtp" > > protocol imap { > mail_plugins = " autocreate" > } > > plugin { > autocreate = Trash > autocreate2 = Sent > autocreate3 = junk > autosubscribe = Trash > autosubscribe2 = Sent > autosubscribe3 = junk > } > > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > That should do it. You just need to make sure postfix is set up correctly. http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL > > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > protocol lmtp { > postmaster_address=postmaster at mydomain.com > hostname=niya.mydomain.com > } > > ssl_cert = ssl_key = > ###################### > ###################### > > > thanks > shadrock From hector.jacas at etecsa.cu Sun Apr 26 18:11:40 2015 From: hector.jacas at etecsa.cu (Hector M. Jacas) Date: Sun, 26 Apr 2015 14:11:40 -0400 Subject: prefetch not working (for me) on ldap user backend Message-ID: <553D2A5C.3090000@etecsa.cu> Dear Sir, I'm having problems with the implementation of prefetch userdb. Following the directives from the site (http://wiki2.dovecot.org/UserDatabase/Prefetch), I am unable to avoid the second search to the user backend (ldap). Could give me any advice or tips to achieve my goal? Thanks a lot, Hector M. Jacas My ldap has the following structure: search base: ou=Domains,dc=test,dc=local ******************************* domains tree: domain2.com: dc=domain2.com,ou=Domains,dc=test,dc=local Definition of mailuser1 on domail2.com: dn: uid=mailuser1,dc=domain2.com,ou=Domains,dc=test,dc=local uid: mailuser1 cn: User mailuser1 sn: User 1 displayName: User mailuser1 objectClass: inetOrgPerson objectClass: organizationalPerson objectClass: person objectClass: top mail: mailuser1 at domain2.com ************************************* domain1.com: dc=domain1.com,ou=Domains,dc=test,dc=local Definition of mailuser1 on domain1.com: dn: uid=mailuser1,dc=domain1.com,ou=Domains,dc=test,dc=local uid: mailuser1 cn: User mailuser1 sn: User 1 displayName: User mailuser1 objectClass: inetOrgPerson objectClass: organizationalPerson objectClass: person objectClass: top mail: mailuser1 at domain1.com ************************************* /etc/dovecot/dovecot-ldap.conf.ext content: hosts = ldapserver auth_bind = yes ldap_version = 3 tls = no base = ou=Domains,dc=test,dc=local scope = subtree user_filter = (&(objectclass=inetOrgPerson)(mail=%u)) user_attrs = =home=/var/vmail/mailboxes/%Ld/%Ln/%Ln,=uid=500,=gid=500 default_pass_scheme = CRYPT pass_filter = (&(objectclass=inetOrgPerson)(mail=%u)) pass_attrs = uid=user,password=userPassword,=userdb_home=/var/vmail/mailboxes/%Ld/%8Ln/%Ln, \ =userdb_uid=500,=userdb_gid=500 iterate_attrs = mail=user iterate_filter = (objectclass=inetOrgPerson) ************************************ auth test result for mailuser1 at domain2.com: # doveadm mailuser1 at domain2.com password auth test passdb: mailuser1 at domain2.com auth succeeded Extra fields: user=mailuser1 And in /var/log/maillog (enabled debug auth options): Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: auth client connected (pid=0) Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: client in: AUTH 1 PLAIN service=doveadm resp= Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: ldap(mailuser1 at domain2.com): bind search: base=ou=Domains,dc=test,dc=local filter=(&(objectclass=inetOrgPerson)(mail=mailuser1 at domain2.com)) Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: ldap(mailuser1 at domain2.com): result: uid=mailuser1; uid unused Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: auth(mailuser1 at domain2.com): username changed mailuser1 at domain2.com -> mailuser1 Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: ldap(mailuser1): result: uid=mailuser1 Apr 26 14:00:33 nfs-7-00 dovecot: auth: Debug: client passdb out: OK 1 user=mailuser1 ***************************** mailuser1 at domain2.com doveadm user result: # doveadm user mailuser1 at domain2.com field value uid 500 gid 500 home /var/vmail/mailboxes/domain2.com/mailuser1/mailuser1 maildir mail: /var/vmail/mailboxes/domain2.com/mailuser/mailuser1:INDEX=MEMORY And in /var/log/maillog (enabled debug auth options): Apr 26 14:01:19 nfs-7-00 dovecot: auth: Debug: master in: USER 1 mailuser1 at domain2.com service=doveadm Apr 26 14:01:19 nfs-7-00 dovecot: auth: Debug: prefetch(mailuser1 at domain2.com): passdb didn't return userdb entries, trying the next userdb Apr 26 14:01:19 nfs-7-00 dovecot: auth: Debug: ldap(mailuser1 at domain2.com): user search: base=ou=Domains,dc=test,dc=local scope=subtree filter=(&(objectclass=inetOrgPerson)(mail=mailuser1 at domain2.com)) fields= Apr 26 14:01:19 nfs-7-00 dovecot: auth: Debug: ldap(mailuser1 at domain2.com): result: uid=mailuser1 cn=Usuario mailuser1 sn=Usuario 1 displayName=Usuario mailuser1 objectClass=inetOrgPerson,inetOrgPerson,inetOrgPerson,inetOrgPerson mail=mailuser1 at domain2.com; objectClass,cn,uid,mail,displayName,sn unused Apr 26 14:01:19 nfs-7-00 dovecot: auth: Debug: ldap(mailuser1 at domain2.com): result: uid=mailuser1 cn=Usuario mailuser1 sn=Usuario 1 displayName=Usuario mailuser1 objectClass=inetOrgPerson,inetOrgPerson,inetOrgPerson,inetOrgPerson mail=mailuser1 at domain2.com; objectClass,cn,uid,mail,displayName,sn unused Apr 26 14:01:19 nfs-7-00 dovecot: auth: Debug: userdb out: USER 1 mailuser1 at domain2.com home=/var/vmail/mailboxes/domain2.com/mailuser1/mailuser1 uid=500 gid=500 *************************** My base system is RHEL7, 24 CPUs and 16GB ram and for LDAP backend, 389 DS 1.2.2 on RHEL 6.6 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-123.20.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.0 (Maipo) nfs4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes default_client_limit = 50000 disable_plaintext_auth = no listen = * mail_fsync = always mail_gid = 500 mail_location = maildir:/var/vmail/mailboxes/%d/%8n/%n:INDEX=MEMORY mail_nfs_index = yes mail_nfs_storage = yes mail_uid = 500 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener auth-userdb { group = vmail mode = 0640 user = vmail } } service doveadm { inet_listener { port = 24245 } } service imap-login { process_min_avail = 24 service_count = 0 } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 8192 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 8192 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { process_limit = 8192 } service pop3-login { process_min_avail = 24 } ssl_cert = -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: not available URL: From teemu.huovila at dovecot.fi Sun Apr 26 18:51:25 2015 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Sun, 26 Apr 2015 21:51:25 +0300 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <553CE2F7.70405@xinu.at> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> <553CE2F7.70405@xinu.at> Message-ID: <553D33AD.5000407@dovecot.fi> On 04/26/2015 04:07 PM, Florian Pritz wrote: > Since there are three people involved I kindly ask you to be more > specific as to who should provide which (exact) information. > > Given you ask for it right after quoting my link all I can tell you is > that I provide all the information you ask for (openssl version, crash > message) in the link you quoted. Sorry if I was not clear. Ive read the link you provided and I have all the information I need for now. > Where (openssl, distro, dovecot version) did you try reproducing it? > I've asked a friend using debian or centos (don't know which) and he was > unable to reproduce so as always they might be patching something, it > might not affect old software or they don't link with openssl. I tried Debain squeeze, CentOS6 and Ubuntu 1404. Seems the issue might require a version of libopenssl, that does not have support for sslv3 compiled in. I have been made aware, that we have a fix for Dovecot in the works. br, Teemu Huovila From teemu.huovila at dovecot.fi Sun Apr 26 18:52:23 2015 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Sun, 26 Apr 2015 21:52:23 +0300 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <20150426123932.3c8204a7@pc1.fritz.box> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> <20150426123932.3c8204a7@pc1.fritz.box> Message-ID: <553D33E7.8000103@dovecot.fi> On 04/26/2015 01:39 PM, Hanno B?ck wrote: > On Sat, 25 Apr 2015 21:36:25 +0300 > Teemu Huovila wrote: > >> I was unable to reproduce this nor the first report. Could you >> describe your environment in more detail? What version of openssl do >> you have? What is the crash message you are seeing? > > both openssl and dovecot latest (1.0.2a, 2.2.16) on a Gentoo. > > Please note that it's not dovecot itself that's crashing but > pop3-login/imap-login. You don't note these if you haven't some kind of > segfault reporting. Thank you for the information. br, Teemu Huovila From hanno at hboeck.de Sun Apr 26 19:51:14 2015 From: hanno at hboeck.de (Hanno =?UTF-8?B?QsO2Y2s=?=) Date: Sun, 26 Apr 2015 21:51:14 +0200 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <553D33AD.5000407@dovecot.fi> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> <553CE2F7.70405@xinu.at> <553D33AD.5000407@dovecot.fi> Message-ID: <20150426215114.2efe6b0f@pc1.fritz.box> On Sun, 26 Apr 2015 21:51:25 +0300 Teemu Huovila wrote: > Seems the issue might require a version of libopenssl, that does not > have support for sslv3 compiled in. I have been made aware, that we > have a fix for Dovecot in the works. No that's not true. I have explicitely tried that. You just need to *disable* SSLv3, but that can be done within the config file. -- Hanno B?ck http://hboeck.de/ mail/jabber: hanno at hboeck.de GPG: BBB51E42 -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From mysql.jorge at decimal.pt Sun Apr 26 19:53:19 2015 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Sun, 26 Apr 2015 20:53:19 +0100 Subject: Encrypt messages on filesystem Message-ID: <015f01d0805a$a524f8e0$ef6eeaa0$@jorge@decimal.pt> Hi, If for some reason I want the received messages to be automatic encrypted on the file system, how should/to do it? If there's any nice howto out there please let me know. Thanks in advanced, From torsten at tributh.net Sun Apr 26 20:01:08 2015 From: torsten at tributh.net (T.Tributh) Date: Sun, 26 Apr 2015 22:01:08 +0200 Subject: TLS OCSP Stapling Message-ID: <553D4404.4070209@tributh.net> Hi, is there a plan to support TLS OCSP stapling in the near future? Regards Torsten -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From fauno at endefensadelsl.org Mon Apr 27 02:31:48 2015 From: fauno at endefensadelsl.org (=?utf-8?Q?Nicol=C3=A1s?= Reynolds) Date: Sun, 26 Apr 2015 23:31:48 -0300 Subject: Encrypt messages on filesystem In-Reply-To: <015f01d0805a$a524f8e0$ef6eeaa0$@jorge@decimal.pt> References: <015f01d0805a$a524f8e0$ef6eeaa0$@jorge@decimal.pt> Message-ID: <87sibm714b.fsf@endefensadelsl.org> Jorge Bastos writes: > Hi, > > > > If for some reason I want the received messages to be automatic encrypted on > the file system, how should/to do it? > > If there's any nice howto out there please let me know. you can take a look at gpgit, there's a way to use it with pigeonhole -- }(:= -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 584 bytes Desc: not available URL: From skdovecot at smail.inf.fh-brs.de Mon Apr 27 06:15:36 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 27 Apr 2015 08:15:36 +0200 (CEST) Subject: Using Identities to send Emails, question on Email Storage In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 24 Apr 2015, Kevin Laurie wrote: > i was wondering that when sending mail with a different > identity(bob at mydomain.com using help at mydomain.com identity), why does setup your MUA correctly, as it appends the sent message to an IMAP folder or add an appropriate BCC. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVT3UCHz1H7kL/d9rAQJNHQgAhAamQfzw81M8XoPGcJrbDdwIigFlkB8B Rx8PJVZzQGdLepiPYFAadk56mi0PW3N/eAeLdqZ/ZW24lYxGR1yJeyJ0y0UiOU+u Dns2B3OhKUtENlEz+ezhxanLe5i1JkaC2wBC3W+T9ucSPXKh4PSzEw8+M9YE5EEq EhRLERx+OiU7HpNGdGvVVzG1n5AfJp1tR3GkZngYFcJAkSnFv5Mw2E8YRoXbjMSi zriTrKkNE2OE5C11+w3QEWYrWsZ9Qoe0Oo9KAiWJ7YsoXe2t4/M2Xz1J0PJIUcFU tCwpXvZc1LgE+JFiycZni4OlbXzk1BLhcLBth2ZoL1C7SxHkkMr6vw== =cWBL -----END PGP SIGNATURE----- From teemu.huovila at dovecot.fi Mon Apr 27 06:52:22 2015 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Mon, 27 Apr 2015 09:52:22 +0300 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <20150426215114.2efe6b0f@pc1.fritz.box> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> <553CE2F7.70405@xinu.at> <553D33AD.5000407@dovecot.fi> <20150426215114.2efe6b0f@pc1.fritz.box> Message-ID: <553DDCA6.2070502@dovecot.fi> On 04/26/2015 10:51 PM, Hanno B?ck wrote: > On Sun, 26 Apr 2015 21:51:25 +0300 > Teemu Huovila wrote: > >> Seems the issue might require a version of libopenssl, that does not >> have support for sslv3 compiled in. I have been made aware, that we >> have a fix for Dovecot in the works. > > No that's not true. I have explicitely tried that. > You just need to *disable* SSLv3, but that can be done within the > config file. Fair enough. So it needs to be a libopenssl, with sslv3 removed somehow. Conversely, a workaround for this issue would be to enable sslv3, on the library level. Thank you again for your report and patch, Teemu Huovila From lista at xdrv.co.uk Mon Apr 27 08:17:31 2015 From: lista at xdrv.co.uk (James) Date: Mon, 27 Apr 2015 09:17:31 +0100 Subject: [patch] TLS Handshake failures can crash imap-login In-Reply-To: <553DDCA6.2070502@dovecot.fi> References: <20150424231720.09350797@pc1.fritz.box> <553B5696.6040000@xdrv.co.uk> <553BDEA9.4070000@dovecot.fi> <553CE2F7.70405@xinu.at> <553D33AD.5000407@dovecot.fi> <20150426215114.2efe6b0f@pc1.fritz.box> <553DDCA6.2070502@dovecot.fi> Message-ID: <553DF09B.2090205@xdrv.co.uk> On 27/04/2015 07:52, Teemu Huovila wrote: > Conversely, a workaround for this issue would be to > enable sslv3, on the library level. No, I tried with Openssl with and without ssl3 as per my original thread which has the details. http://dovecot.org/pipermail/dovecot/2015-March/100202.html James. From emailbuilder88 at yahoo.com Mon Apr 27 08:47:54 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Mon, 27 Apr 2015 01:47:54 -0700 Subject: Sieve extprograms ?not exexuting? Message-ID: <1430124474.81085.YahooMailBasic@web142403.mail.bf1.yahoo.com> Hello, I was testing the extprograms plugin. I think I had it working in the past, but many things have changed since then, so no use trying to figure out where it broke - starting over again... Debug-enabled log give me: Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: qOGyA0DePHVaOyHEM/SpMA: sieve: action execute: running program: test.sh Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: waiting for program `/usr/local/etc/dovecot/sieve_globals/test.sh' to finish after 0 seconds So I guess it thinks it is running my script? But simple test script does nothing. Here it is: #!/bin/sh read INPUT INPUT="Hello world: $INPUT" echo "$INPUT" >> /tmp/hello echo "---------------------------" >> /tmp/hello Permissions on this script file for now are rwxrwxrwx But nothing goes to /tmp/hello at all. Script works when I run it manually. I also tried without the "read" but I think that's required isn't it? Anyway, what else can I do to debug this? Dovecot 2.2.16 Pigeonhole 0.4.7 From astarmathsandphysics at gmail.com Mon Apr 27 09:19:26 2015 From: astarmathsandphysics at gmail.com (Paul Smith) Date: Mon, 27 Apr 2015 10:19:26 +0100 Subject: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve Message-ID: Here is the output from dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-32-generic x86_64 Ubuntu 14.04.2 LTS ext4 auth_mechanisms = plain login auth_verbose = yes log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = lmtp imap pop3 sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } } ssl_cert = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve PS dovecot-sieve is installe. Also this error appears without sieve in the list of protocols in /etc/dovecot/dovecot.conf From stephan at rename-it.nl Mon Apr 27 09:27:29 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 27 Apr 2015 11:27:29 +0200 Subject: Sieve extprograms ?not exexuting? In-Reply-To: <1430124474.81085.YahooMailBasic@web142403.mail.bf1.yahoo.com> References: <1430124474.81085.YahooMailBasic@web142403.mail.bf1.yahoo.com> Message-ID: <553E0101.7080808@rename-it.nl> On 4/27/2015 10:47 AM, E.B. wrote: > Hello, I was testing the extprograms plugin. I think I had it working > in the past, but many things have changed since then, so no use > trying to figure out where it broke - starting over again... > > Debug-enabled log give me: > Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: > qOGyA0DePHVaOyHEM/SpMA: sieve: action execute: running > program: test.sh > Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: > waiting for program `/usr/local/etc/dovecot/sieve_globals/test.sh' > to finish after 0 seconds > > So I guess it thinks it is running my script? But simple test script > does nothing. Here it is: > > #!/bin/sh > read INPUT > INPUT="Hello world: $INPUT" > echo "$INPUT" >> /tmp/hello > echo "---------------------------" >> /tmp/hello > > Permissions on this script file for now are rwxrwxrwx > But nothing goes to /tmp/hello at all. Script works when I run it > manually. I also tried without the "read" but I think that's required > isn't it? Anyway, what else can I do to debug this? It works here. What exactly is your config (output from `dovecot -n`)? What does the Sieve script that calls this script look like? Regards, Stephan. From stephan at rename-it.nl Mon Apr 27 09:30:16 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 27 Apr 2015 11:30:16 +0200 Subject: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve In-Reply-To: References: Message-ID: <553E01A8.90608@rename-it.nl> On 4/27/2015 11:19 AM, Paul Smith wrote: > Here is the output from dovecot -n > > > > PS dovecot-sieve is installe. Also this error appears without sieve in the > list of protocols in /etc/dovecot/dovecot.conf Sieve as a protocol actually means ManageSieve (yes it is confusing). So, is dovecot-managesieved installed? Regards, Stephan. From skdovecot at smail.inf.fh-brs.de Mon Apr 27 09:38:59 2015 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 27 Apr 2015 11:38:59 +0200 (CEST) Subject: Sieve extprograms ?not exexuting? In-Reply-To: <1430124474.81085.YahooMailBasic@web142403.mail.bf1.yahoo.com> References: <1430124474.81085.YahooMailBasic@web142403.mail.bf1.yahoo.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 27 Apr 2015, E.B. wrote: > Debug-enabled log give me: > Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: > qOGyA0DePHVaOyHEM/SpMA: sieve: action execute: running > program: test.sh > Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: > waiting for program `/usr/local/etc/dovecot/sieve_globals/test.sh' > to finish after 0 seconds > > So I guess it thinks it is running my script? But simple test script > does nothing. Here it is: > > #!/bin/sh > read INPUT > INPUT="Hello world: $INPUT" > echo "$INPUT" >> /tmp/hello > echo "---------------------------" >> /tmp/hello > > Permissions on this script file for now are rwxrwxrwx > But nothing goes to /tmp/hello at all. Script works when I run it > manually. I also tried without the "read" but I think that's required > isn't it? Anyway, what else can I do to debug this? Well, first try with a script that cannot fail (well most likely), e.g.: #!/bin/sh ( id date set ) >>/tmp/test.$$.log 2>&1 Note the /tmp/test.$$.log, so it will create a new file (hopefully) each time it runs, in order to bypass permission problems, if the file exists already. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVT4Ds3z1H7kL/d9rAQIuKgf+J5lnE+6DHNZQYz4nA4Kt+xQI3ul0Gf9/ cdHUeyVfpYtPbSUheHalzlXMgnIulHNHs4FBuRpbWoTVG184Vy6ZVFXRUJSNRRyG wLZhYqVFyTa3zRpoxq1fdxbmdyPtq5dKzO8+lGeDAtiNZdi1cGVWfG1wYEbRQkUp cS7l9FiDba7DvwL6LjQZxGkUNsveyq6ZKitOsveSmWugUphfw0ko+84Y0yVI/5d6 QtslPOj7C4Ag5TFg+5UoQ3GSwOBaTY+kYzF58y4XNatpUWiKtOCbGv3P7FbEgfzl Xle6e6a6Wqg+7/3D11sy+1R9CQUIJjLA1dgC6E8Lgi5cdvyNqJdWRQ== =HO71 -----END PGP SIGNATURE----- From mysql.jorge at decimal.pt Mon Apr 27 14:46:30 2015 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Mon, 27 Apr 2015 15:46:30 +0100 Subject: [dovecot] Extra help, Hotmail nightmare Message-ID: Hi, Some extra help. How would I make hotmail accept my emails and not make them go to junk folder? Is there any trick to do this? Thanks in advanced, Jorge Bastos From mailinglist at darac.org.uk Mon Apr 27 15:08:03 2015 From: mailinglist at darac.org.uk (Darac Marjal) Date: Mon, 27 Apr 2015 16:08:03 +0100 Subject: [dovecot] Extra help, Hotmail nightmare In-Reply-To: References: Message-ID: <20150427150803.GB2652@darac.org.uk> On Mon, Apr 27, 2015 at 03:46:30PM +0100, Jorge Bastos wrote: > Hi, > > > > Some extra help. > > How would I make hotmail accept my emails and not make them go to junk > folder? > > Is there any trick to do this? This isn't really a dovecot issue, but you can start with Microsoft's policies here: https://mail.live.com/mail/policies.aspx > > > > Thanks in advanced, > > Jorge Bastos -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 801 bytes Desc: Digital signature URL: From delrio at mie.utoronto.ca Mon Apr 27 15:17:43 2015 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Mon, 27 Apr 2015 11:17:43 -0400 Subject: [dovecot] Extra help, Hotmail nightmare In-Reply-To: <20150427150803.GB2652@darac.org.uk> References: <20150427150803.GB2652@darac.org.uk> Message-ID: <553E5317.1090604@mie.utoronto.ca> On 04/27/15 11:08 AM, Darac Marjal wrote: > On Mon, Apr 27, 2015 at 03:46:30PM +0100, Jorge Bastos wrote: >> Hi, >> >> >> >> Some extra help. >> >> How would I make hotmail accept my emails and not make them go to junk >> folder? >> >> Is there any trick to do this? > This isn't really a dovecot issue, but you can start with Microsoft's > policies here: https://mail.live.com/mail/policies.aspx > and check DNSBL IP blacklists such as http://www.dnsbl-check.info/ From trash at skrilnetz.net Mon Apr 27 18:00:55 2015 From: trash at skrilnetz.net (trash at skrilnetz.net) Date: Mon, 27 Apr 2015 18:00:55 +0000 Subject: [dovecot] Extra help, Hotmail nightmare In-Reply-To: <553E5317.1090604@mie.utoronto.ca> References: <20150427150803.GB2652@darac.org.uk> <553E5317.1090604@mie.utoronto.ca> Message-ID: <20150427180055.Horde.unf1v879uthECOff0JKGNg1@skrilnetz.net> Quoting Oscar del Rio : > On 04/27/15 11:08 AM, Darac Marjal wrote: >> On Mon, Apr 27, 2015 at 03:46:30PM +0100, Jorge Bastos wrote: >>> Hi, >>> >>> Some extra help. >>> >>> How would I make hotmail accept my emails and not make them go to junk >>> folder? >>> >>> Is there any trick to do this? >> This isn't really a dovecot issue, but you can start with Microsoft's >> policies here: https://mail.live.com/mail/policies.aspx >> > > and check DNSBL IP blacklists such as > http://www.dnsbl-check.info/ Thats what I found out about hotmail. https://skrilnetz.net/mail-server-how-to-convince-hotmail-to-deliver-your-messages-to-the-receipts-mailbox/ -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-keys Size: 1718 bytes Desc: PGP Public Key URL: From emailbuilder88 at yahoo.com Mon Apr 27 18:55:54 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Mon, 27 Apr 2015 11:55:54 -0700 Subject: Sieve extprograms ?not exexuting? In-Reply-To: Message-ID: <1430160954.20937.YahooMailBasic@web142402.mail.bf1.yahoo.com> > > Debug-enabled log give me: > > Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: > > qOGyA0DePHVaOyHEM/SpMA: sieve: action execute: running > > program: test.sh > > Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: > > waiting for program `/usr/local/etc/dovecot/sieve_globals/test.sh' > > to finish after 0 seconds > > > > So I guess it thinks it is running my script? But simple test script > > does nothing. Here it is: > > > > #!/bin/sh > > read INPUT > > INPUT="Hello world: $INPUT" > > echo "$INPUT" >> /tmp/hello > > echo "---------------------------" >> /tmp/hello > > > > Permissions on this script file for now are rwxrwxrwx > > But nothing goes to /tmp/hello at all. Script works when I run it > > manually. I also tried without the "read" but I think that's required > > isn't it? Anyway, what else can I do to debug this? > > Well, first try with a script that cannot fail (well most likely), e.g.: I tried your script for fun, same result. Log showing the script was called, but no output from the script. I also deleted the script and made sure that debug log showed that sieve could not find the script. Is it chrooted or something weird? I have confirmed it is being run by calling "exit 3" and seeing in the log that "program ... terminated with non-zero exit code 3" so problem is in commands accessing the filesystem I guess. I added this: echo "HELLO WORLD" 1>&2 And log shows "Error: HELLO WORLD" So it's working but no filesystem access. Calling from sieve script with: execute :input "myinput" "test.sh"; Also tried execute "test.sh"; From ad+lists at uni-x.org Mon Apr 27 19:19:47 2015 From: ad+lists at uni-x.org (Alexander Dalloz) Date: Mon, 27 Apr 2015 21:19:47 +0200 Subject: Sieve extprograms ?not exexuting? In-Reply-To: <1430160954.20937.YahooMailBasic@web142402.mail.bf1.yahoo.com> References: <1430160954.20937.YahooMailBasic@web142402.mail.bf1.yahoo.com> Message-ID: <553E8BD3.1020006@uni-x.org> Am 27.04.2015 um 20:55 schrieb E.B.: >>> So I guess it thinks it is running my script? But simple test script >>> does nothing. Here it is: >>> >>> #!/bin/sh >>> read INPUT >>> INPUT="Hello world: $INPUT" >>> echo "$INPUT" >> /tmp/hello >>> echo "---------------------------" >> /tmp/hello >>> >>> Permissions on this script file for now are rwxrwxrwx >>> But nothing goes to /tmp/hello at all. Script works when I run it >>> manually. I also tried without the "read" but I think that's required >>> isn't it? Anyway, what else can I do to debug this? >> >> Well, first try with a script that cannot fail (well most likely), e.g.: > > I tried your script for fun, same result. Log showing > the script was called, but no output from the script. > > I also deleted the script and made sure that debug > log showed that sieve could not find the script. Is it > chrooted or something weird? In another thread you said you are running CentOS. So I strongly guess it is SELinux interfering. Check your auditd log grep -i AVC /var/log/audit/audit.log You can test whether your setup works after "setenforce 0". That sets SELinux into permissive mode, loggging AVCs but not blocking actions. Alexander From emailbuilder88 at yahoo.com Mon Apr 27 20:31:10 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Mon, 27 Apr 2015 13:31:10 -0700 Subject: Failed running extprograms execute via socket - fatal recv(MSG_PEEK) failed disconnected Message-ID: <1430166670.64801.YahooMailBasic@web142406.mail.bf1.yahoo.com> I switched from running my extprograms execute script directly to running with dovecot socket. Log shows only this dovecot: lmtp(test at example.com): Debug: wdi0Tb5VPlGfPnEAM/SpMA: sieve: action execute: running program: test dovecot: lmtp(test at example.com): Debug: Namespace : Using permissions from /vmail/example.com/test: mode=0770 gid=default dovecot: script: Fatal: recv(MSG_PEEK) failed: disconnected For testing I opened up the script and socket with permissions 777 but the error seems to indicate less about permissions more about some kind of protocol problem i guessing. Sieve script calls using this: execute "test"; Plugin config: plugin { sieve_plugins = sieve_extprograms sieve_global_extensions = +vnd.dovecot.execute sieve_execute_socket_dir = sieve-execute sieve_before = /usr/local/etc/dovecot/sieve } service test { executable = script /usr/local/etc/dovecot/sieve_globals/test.sh unix_listener sieve-execute/test { mode = 0660 group = vmail } } FYI I have quota-warning sockets configured identical to this and they work good. Dovecot 2.2.16 Pigeonhole 0.4.7 Help appreciate a lot. From emailbuilder88 at yahoo.com Mon Apr 27 20:33:45 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Mon, 27 Apr 2015 13:33:45 -0700 Subject: Sieve extprograms ?not exexuting? In-Reply-To: <553E8BD3.1020006@uni-x.org> Message-ID: <1430166825.9370.YahooMailBasic@web142406.mail.bf1.yahoo.com> > In another thread you said you are running CentOS. So I strongly guess > it is SELinux interfering. Check your auditd log > > grep -i AVC /var/log/audit/audit.log > > You can test whether your setup works after "setenforce 0". That sets > SELinux into permissive mode, loggging AVCs but not blocking actions. Good idea, but there are no AVC reports so I guess that's not it. In the meantime I switched to calling the script using a dovecot service and now the script isn't run at all ------ see my new thread on that. From edgar at pettijohn-web.com Mon Apr 27 21:06:52 2015 From: edgar at pettijohn-web.com (Edgar Pettijohn III) Date: Mon, 27 Apr 2015 16:06:52 -0500 Subject: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve In-Reply-To: References: Message-ID: On Apr 27, 2015, at 4:19 AM, Paul Smith wrote: > Here is the output from dovecot -n > > # 2.2.9: /etc/dovecot/dovecot.conf > # OS: Linux 3.13.0-32-generic x86_64 Ubuntu 14.04.2 LTS ext4 > auth_mechanisms = plain login > auth_verbose = yes > log_path = /var/log/dovecot.log > mail_debug = yes > mail_location = maildir:/var/mail/vhosts/%d/%n > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = lmtp imap pop3 sieve erase sieve above > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener /var/spool/postfix/private/dovecot-auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > mode = 0600 > user = vmail > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 0 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > } > ssl_cert = ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RS > A:+HIGH:+MEDIUM > ssl_key = userdb { > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > driver = static > } > doveconf: Error: protocols: Unknown protocol: sieve is the above line actually in your conf or is this a copy paste error? > protocol lda { > deliver_log_format = msgid=%m: %$ > mail_plugins = sieve > postmaster_address = postmaster > quota_full_tempfail = yes > rejection_reason = Your message to <%t> was automatically rejected:%n%r > } > protocol imap { > imap_client_workarounds = delay-newmail > mail_max_userip_connections = 10 > } > protocol pop3 { > mail_max_userip_connections = 10 > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: > protocols: Unknown protocol: sieve > > > PS dovecot-sieve is installe. Also this error appears without sieve in the > list of protocols in /etc/dovecot/dovecot.conf From mysql.jorge at decimal.pt Mon Apr 27 21:58:29 2015 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Mon, 27 Apr 2015 22:58:29 +0100 Subject: [dovecot] Extra help, Hotmail nightmare In-Reply-To: <20150427180055.Horde.unf1v879uthECOff0JKGNg1@skrilnetz.net> References: <20150427150803.GB2652@darac.org.uk> <553E5317.1090604@mie.utoronto.ca> <20150427180055.Horde.unf1v879uthECOff0JKGNg1@skrilnetz.net> Message-ID: <009701d08135$4c1fd9f0$e45f8dd0$@jorge@decimal.pt> Thanks all for the answers. SPF did the trick, however I'll do further reading on the on the weekend. > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of > trash at skrilnetz.net > Sent: segunda-feira, 27 de Abril de 2015 19:01 > To: dovecot at dovecot.org > Subject: Re: [dovecot] Extra help, Hotmail nightmare > > > Quoting Oscar del Rio : > > > On 04/27/15 11:08 AM, Darac Marjal wrote: > >> On Mon, Apr 27, 2015 at 03:46:30PM +0100, Jorge Bastos wrote: > >>> Hi, > >>> > >>> Some extra help. > >>> > >>> How would I make hotmail accept my emails and not make them go to > >>> junk folder? > >>> > >>> Is there any trick to do this? > >> This isn't really a dovecot issue, but you can start with > Microsoft's > >> policies here: https://mail.live.com/mail/policies.aspx > >> > > > > and check DNSBL IP blacklists such as > > http://www.dnsbl-check.info/ > > Thats what I found out about hotmail. > https://skrilnetz.net/mail-server-how-to-convince-hotmail-to-deliver- > your-messages-to-the-receipts-mailbox/ From me at junc.eu Tue Apr 28 00:41:07 2015 From: me at junc.eu (Benny Pedersen) Date: Tue, 28 Apr 2015 02:41:07 +0200 Subject: [dovecot] Extra help, Hotmail nightmare In-Reply-To: References: Message-ID: <14e0c05cecd6ced65289c4db8a5bd016@junc.eu> Jorge Bastos skrev den 2015-04-27 16:46: > How would I make hotmail accept my emails and not make them go to junk > folder? ask hotmail how to install dovecot on a raspberry-pi ? > Is there any trick to do this? dovecot -n From wdgarc88 at gmail.com Tue Apr 28 02:15:45 2015 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Tue, 28 Apr 2015 12:15:45 +1000 Subject: CVE-2015-3420 Message-ID: When can we expect 2.2.17 to resolve this? From edgaras.lukosevicius at gmail.com Tue Apr 28 09:00:22 2015 From: edgaras.lukosevicius at gmail.com (=?utf-8?Q?Edgaras_Luko=C5=A1evi=C4=8Dius?=) Date: Tue, 28 Apr 2015 12:00:22 +0300 Subject: Quotas not working after reboot Message-ID: <12D33988-D1E4-4B32-ACD8-765315CC79AE@gmail.com> Hello, after rebooting my dovecot server quotas are no longer working. # dovecot --version 2.2.10 CentOS Linux release 7.0.1406 It is strange that restarting dovecot did not reveal this problem, but rebooting whole server did. Before reboot it was like this: # doveadm -D quota get -u test1 at testdomain1.tld doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm 03NB0d9erYBwhnzXhbS66fLDMU8v4ZiCDQDM3tDHCKme4ujpHy/lRk33305AIO9UXtgHGFyJYSpcVgoVnXJQGpJBphGvkAF4XI1JGx83Dtlb44wgJ8ZBgOm4qSNOoQIXKv0NO35EwUohtYBMlDJKPRUTwRF93tW7RsfWZGVNi4Eo5k616Tn4ooU3JMXkQA8LZ5zzLllspBVDbyb4GPAmWiw== root at ovzcloud doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota=maildir:storage=512000000 doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota_rule=*:bytes=512000000 doveadm(test1 at testdomain1.tld): Debug: Effective uid=997, gid=996, home=/home/vmail/t/e/testdomain1.tld/test1/ doveadm(test1 at testdomain1.tld): Debug: Quota root: name=storage=512000000 backend=maildir args= doveadm(test1 at testdomain1.tld): Debug: Quota rule: root=storage=512000000 mailbox=* bytes=512000000 messages=0 doveadm(test1 at testdomain1.tld): Debug: Quota warning: bytes=486400000 (95%) messages=0 reverse=no command=quota-warning 95 test1 at testdomain1.tld doveadm(test1 at testdomain1.tld): Debug: Quota warning: bytes=409600000 (80%) messages=0 reverse=no command=quota-warning 80 test1 at testdomain1.tld doveadm(test1 at testdomain1.tld): Debug: Quota grace: root=storage=512000000 bytes=25600000 (5%) doveadm(test1 at testdomain1.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/t/e/testdomain1.tld/test1/ doveadm(test1 at testdomain1.tld): Debug: maildir++: root=/home/vmail/t/e/testdomain1.tld/test1, index=, indexpvt=, control=, inbox=/home/vmail/t/e/testdomain1.tld/test1, alt= doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(test1 at testdomain1.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Quota name Type Value Limit % storage=512000000 STORAGE 0 500000 0 storage=512000000 MESSAGE 0 - Now after rebooting i get this output: # doveadm -D quota get -u test1 at testdomain1.tld doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota=maildir:storage=512000000 doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota_rule=*:bytes=512000000 doveadm(test1 at testdomain1.tld): Debug: Effective uid=997, gid=996, home=/home/vmail/t/e/testdomain1.tld/test1/ doveadm(test1 at testdomain1.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/t/e/testdomain1.tld/test1/ doveadm(test1 at testdomain1.tld): Debug: maildir++: root=/home/vmail/t/e/testdomain1.tld/test1, index=, indexpvt=, control=, inbox=/home/vmail/t/e/testdomain1.tld/test1, alt= doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: doveadm(test1 at testdomain1.tld): Debug: fs: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(test1 at testdomain1.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(test1 at testdomain1.tld): Error: Quota not enabled Quota name Type Value Limit % # egrep -v "^#|^$" /etc/dovecot/conf.d/90-quota.conf plugin { quota = maildir #quota_rule = *:storage=1G #quota_rule2 = Trash:storage=+100M # LDA/LMTP allows saving the last mail to bring user from under quota to # over quota, if the quota doesn't grow too high. Default is to allow as # long as quota will stay under 10% above the limit. Also allowed e.g. 10M. #quota_grace = 10%% quota_grace = 5%% quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota #quota = fs:User quota } plugin { #quota = dict:user::proxy::quota #quota2 = dict:domain:%d:proxy::quota_domain #quota_rule = *:storage=102400 #quota2_rule = *:storage=1048576 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = dovecot unix_listener quota-warning { user = vmail } } service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } From tss at iki.fi Tue Apr 28 09:35:03 2015 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Apr 2015 11:35:03 +0200 Subject: CVE-2015-3420 In-Reply-To: References: Message-ID: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> On 28 Apr 2015, at 04:15, Edwardo Garcia wrote: > When can we expect 2.2.17 to resolve this? As far as I know this doesn't affect any of the major distributions where Dovecot is commonly used (Debian/Ubuntu/Redhat/CentOS). I've only heard it happening with some self-compiled OpenSSL versions (Arch/Gentoo?), so I don't see this as especially critical issue. But I'm planning on v2.2.17 release sometimes soon anyway for other reasons. From tss at iki.fi Tue Apr 28 09:35:45 2015 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Apr 2015 11:35:45 +0200 Subject: CVE-2015-3420 In-Reply-To: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> References: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> Message-ID: <1A7AF112-3C5B-413B-AD01-8865ED78D088@iki.fi> On 28 Apr 2015, at 11:35, Timo Sirainen wrote: > > On 28 Apr 2015, at 04:15, Edwardo Garcia wrote: >> When can we expect 2.2.17 to resolve this? > > As far as I know this doesn't affect any of the major distributions where Dovecot is commonly used (Debian/Ubuntu/Redhat/CentOS). I've only heard it happening with some self-compiled OpenSSL versions (Arch/Gentoo?), so I don't see this as especially critical issue. But I'm planning on v2.2.17 release sometimes soon anyway for other reasons. Oh, forgot to post also the committed patch fixing this: http://hg.dovecot.org/dovecot-2.2/rev/86f535375750 From m at sys4.de Tue Apr 28 09:43:28 2015 From: m at sys4.de (Marc Schiffbauer) Date: Tue, 28 Apr 2015 11:43:28 +0200 Subject: CVE-2015-3420 In-Reply-To: <1A7AF112-3C5B-413B-AD01-8865ED78D088@iki.fi> References: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> <1A7AF112-3C5B-413B-AD01-8865ED78D088@iki.fi> Message-ID: <20150428094328.GJ3477@schiffbauer.net> * Timo Sirainen schrieb am 28.04.15 um 11:35 Uhr: >On 28 Apr 2015, at 11:35, Timo Sirainen wrote: >> >> On 28 Apr 2015, at 04:15, Edwardo Garcia wrote: >>> When can we expect 2.2.17 to resolve this? >> >> As far as I know this doesn't affect any of the major distributions where Dovecot is commonly used (Debian/Ubuntu/Redhat/CentOS). I've only heard it happening with some self-compiled OpenSSL versions (Arch/Gentoo?), so I don't see this as especially critical issue. But I'm planning on v2.2.17 release sometimes soon anyway for other reasons. > >Oh, forgot to post also the committed patch fixing this: http://hg.dovecot.org/dovecot-2.2/rev/86f535375750 Hi Timo, does this affect 2.2.16 *only*? thx -Marc -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From reuben-dovecot at reub.net Tue Apr 28 10:42:58 2015 From: reuben-dovecot at reub.net (Reuben Farrelly) Date: Tue, 28 Apr 2015 20:42:58 +1000 Subject: Crashes in dovecot -hg (86f535375750) Message-ID: <553F6432.1080100@reub.net> Seems there is some breakage with -hg latest - 2.2.16 (86f535375750+). I've just had 4 core files created in short succession on both servers in the replication set. Here's the first... tornado reuben # gdb /usr/libexec/dovecot/imap core GNU gdb (Gentoo 7.9 vanilla) 7.9 Copyright (C) 2015 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/imap...done. [New LWP 20929] warning: Could not load shared library symbols for linux-vdso.so.1. Do you need "set solib-search-path" or "set sysroot"? [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007f186087693a in fts_user_free (fuser=0x0) at fts-user.c:187 187 fts-user.c: No such file or directory. (gdb) bt full #0 0x00007f186087693a in fts_user_free (fuser=0x0) at fts-user.c:187 user_langp = 0x300000008 #1 0x00007f1860876ac2 in fts_mail_user_deinit (user=0x20a3eb0) at fts-user.c:215 fuser = 0x0 #2 0x00007f185d7890f8 in fts_lucene_mail_user_deinit (user=0x20a3eb0) at fts-lucene-plugin.c:99 fuser = 0x20a5550 #3 0x00007f185d994e0c in replication_user_deinit (user=0x20a3eb0) at replication-plugin.c:310 ruser = 0x20a5500 #4 0x00007f18615b565a in mail_user_unref (_user=0x20abc28) at mail-user.c:168 user = 0x20a3eb0 __FUNCTION__ = "mail_user_unref" #5 0x000000000041afef in client_default_destroy (client=0x20abbb0, reason=0x0) at imap-client.c:284 cmd = 0x7ffde3a18960 __FUNCTION__ = "client_default_destroy" #6 0x000000000041ada0 in client_destroy (client=0x20abbb0, reason=0x0) at imap-client.c:236 No locals. #7 0x000000000041ccf4 in client_input (client=0x20abbb0) at imap-client.c:967 cmd = 0x7ffde3a189a0 output = 0x0 bytes = 12 __FUNCTION__ = "client_input" #8 0x00007f18612fc992 in io_loop_call_io (io=0x20c8610) at ioloop.c:501 ioloop = 0x2076740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f18612fec40 in io_loop_handler_run_internal (ioloop=0x2076740) at ioloop-epoll.c:220 ctx = 0x2077460 events = 0x2078290 event = 0x2078290 list = 0x2078e80 io = 0x20c8610 tv = {tv_sec = 4, tv_usec = 999387} events_count = 5 msecs = 5000 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f18612fcb2f in io_loop_handler_run (ioloop=0x2076740) Reuben From edgaras.lukosevicius at gmail.com Tue Apr 28 11:25:09 2015 From: edgaras.lukosevicius at gmail.com (=?utf-8?Q?Edgaras_Luko=C5=A1evi=C4=8Dius?=) Date: Tue, 28 Apr 2015 14:25:09 +0300 Subject: Quotas not working after reboot In-Reply-To: <12D33988-D1E4-4B32-ACD8-765315CC79AE@gmail.com> References: <12D33988-D1E4-4B32-ACD8-765315CC79AE@gmail.com> Message-ID: <8FA4DCA8-DAB8-42DA-936D-04E1843526A0@gmail.com> By the way, my quotas are configured to use SQL: user_query = SELECT CONCAT('/home/vmail/', maildir) AS home, 997 AS uid, 996 AS gid, CONCAT('*:bytes=', quota) AS quota_rule, CONCAT('maildir:storage=', quota) AS quota FROM mailbox WHERE username = LOWER('%u') AND active = '1' AND suspended = ?0' And when I run command "doveadm -D quota get -u test1 at testdomain1.tld? i see In MySQL query log that query is sent. On 28 Apr 2015, at 12:00, Edgaras Luko?evi?ius wrote: > Hello, > > after rebooting my dovecot server quotas are no longer working. > > # dovecot --version > 2.2.10 > > CentOS Linux release 7.0.1406 > > It is strange that restarting dovecot did not reveal this problem, but rebooting whole server did. > > > > Before reboot it was like this: > > # doveadm -D quota get -u test1 at testdomain1.tld > doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot > doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so > doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm > 03NB0d9erYBwhnzXhbS66fLDMU8v4ZiCDQDM3tDHCKme4ujpHy/lRk33305AIO9UXtgHGFyJYSpcVgoVnXJQGpJBphGvkAF4XI1JGx83Dtlb44wgJ8ZBgOm4qSNOoQIXKv0NO35EwUohtYBMlDJKPRUTwRF93tW7RsfWZGVNi4Eo5k616Tn4ooU3JMXkQA8LZ5zzLllspBVDbyb4GPAmWiw== root at ovzcloud > doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) > doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) > doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so > doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so > doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) > doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) > doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota=maildir:storage=512000000 > doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota_rule=*:bytes=512000000 > doveadm(test1 at testdomain1.tld): Debug: Effective uid=997, gid=996, home=/home/vmail/t/e/testdomain1.tld/test1/ > doveadm(test1 at testdomain1.tld): Debug: Quota root: name=storage=512000000 backend=maildir args= > doveadm(test1 at testdomain1.tld): Debug: Quota rule: root=storage=512000000 mailbox=* bytes=512000000 messages=0 > doveadm(test1 at testdomain1.tld): Debug: Quota warning: bytes=486400000 (95%) messages=0 reverse=no command=quota-warning 95 test1 at testdomain1.tld > doveadm(test1 at testdomain1.tld): Debug: Quota warning: bytes=409600000 (80%) messages=0 reverse=no command=quota-warning 80 test1 at testdomain1.tld > doveadm(test1 at testdomain1.tld): Debug: Quota grace: root=storage=512000000 bytes=25600000 (5%) > doveadm(test1 at testdomain1.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/t/e/testdomain1.tld/test1/ > doveadm(test1 at testdomain1.tld): Debug: maildir++: root=/home/vmail/t/e/testdomain1.tld/test1, index=, indexpvt=, control=, inbox=/home/vmail/t/e/testdomain1.tld/test1, alt= > doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none > doveadm(test1 at testdomain1.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= > Quota name Type Value Limit % > storage=512000000 STORAGE 0 500000 0 > storage=512000000 MESSAGE 0 - > > > > Now after rebooting i get this output: > > # doveadm -D quota get -u test1 at testdomain1.tld > doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot > doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so > doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm > doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) > doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) > doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so > doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so > doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) > doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) > doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota=maildir:storage=512000000 > doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota_rule=*:bytes=512000000 > doveadm(test1 at testdomain1.tld): Debug: Effective uid=997, gid=996, home=/home/vmail/t/e/testdomain1.tld/test1/ > doveadm(test1 at testdomain1.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/t/e/testdomain1.tld/test1/ > doveadm(test1 at testdomain1.tld): Debug: maildir++: root=/home/vmail/t/e/testdomain1.tld/test1, index=, indexpvt=, control=, inbox=/home/vmail/t/e/testdomain1.tld/test1, alt= > doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: > doveadm(test1 at testdomain1.tld): Debug: fs: root=, index=, indexpvt=, control=, inbox=, alt= > doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none > doveadm(test1 at testdomain1.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= > doveadm(test1 at testdomain1.tld): Error: Quota not enabled > Quota name Type Value Limit % > > > > > # egrep -v "^#|^$" /etc/dovecot/conf.d/90-quota.conf > plugin { > quota = maildir > #quota_rule = *:storage=1G > #quota_rule2 = Trash:storage=+100M > # LDA/LMTP allows saving the last mail to bring user from under quota to > # over quota, if the quota doesn't grow too high. Default is to allow as > # long as quota will stay under 10% above the limit. Also allowed e.g. 10M. > #quota_grace = 10%% > quota_grace = 5%% > quota_status_success = DUNNO > quota_status_nouser = DUNNO > quota_status_overquota = "552 5.2.2 Mailbox is full" > } > plugin { > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > } > plugin { > #quota = dirsize:User quota > #quota = maildir:User quota > #quota = dict:User quota::proxy::quota > #quota = fs:User quota > } > plugin { > #quota = dict:user::proxy::quota > #quota2 = dict:domain:%d:proxy::quota_domain > #quota_rule = *:storage=102400 > #quota2_rule = *:storage=1048576 > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > user = dovecot > unix_listener quota-warning { > user = vmail > } > } > service quota-status { > executable = quota-status -p postfix > inet_listener { > port = 12340 > # You can choose any port you want > } > client_limit = 1 > } From tss at iki.fi Tue Apr 28 11:26:14 2015 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Apr 2015 13:26:14 +0200 Subject: CVE-2015-3420 In-Reply-To: <20150428094328.GJ3477@schiffbauer.net> References: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> <1A7AF112-3C5B-413B-AD01-8865ED78D088@iki.fi> <20150428094328.GJ3477@schiffbauer.net> Message-ID: <1501D1DB-0C6B-49CA-8E7E-2C25A354B39C@iki.fi> On 28 Apr 2015, at 11:43, Marc Schiffbauer wrote: > > * Timo Sirainen schrieb am 28.04.15 um 11:35 Uhr: >> On 28 Apr 2015, at 11:35, Timo Sirainen wrote: >>> >>> On 28 Apr 2015, at 04:15, Edwardo Garcia wrote: >>>> When can we expect 2.2.17 to resolve this? >>> >>> As far as I know this doesn't affect any of the major distributions where Dovecot is commonly used (Debian/Ubuntu/Redhat/CentOS). I've only heard it happening with some self-compiled OpenSSL versions (Arch/Gentoo?), so I don't see this as especially critical issue. But I'm planning on v2.2.17 release sometimes soon anyway for other reasons. >> >> Oh, forgot to post also the committed patch fixing this: http://hg.dovecot.org/dovecot-2.2/rev/86f535375750 > > Hi Timo, > > does this affect 2.2.16 *only*? The code has been there v2.2.14 - v2.2.16. I'm not sure if it could have affected older versions also in some way. From edgaras.lukosevicius at gmail.com Tue Apr 28 11:29:47 2015 From: edgaras.lukosevicius at gmail.com (=?utf-8?Q?Edgaras_Luko=C5=A1evi=C4=8Dius?=) Date: Tue, 28 Apr 2015 14:29:47 +0300 Subject: Quotas not working after reboot In-Reply-To: <8FA4DCA8-DAB8-42DA-936D-04E1843526A0@gmail.com> References: <12D33988-D1E4-4B32-ACD8-765315CC79AE@gmail.com> <8FA4DCA8-DAB8-42DA-936D-04E1843526A0@gmail.com> Message-ID: <3CC0246C-A83C-410B-A291-243962AE1D52@gmail.com> Aaaand... fixed. quota plugin was disabled in doveadm protocol as in: protocol doveadm { #mail_plugins = $mail_plugins pop3_migration mail_plugins = pop3_migration } Added ?quota' to mail_plugins Now I don?t know why that wasn?t a problem after issuing ?systemctl restart dovecot?, but at least it works now. On 28 Apr 2015, at 14:25, Edgaras Luko?evi?ius wrote: > By the way, my quotas are configured to use SQL: > user_query = SELECT CONCAT('/home/vmail/', maildir) AS home, 997 AS uid, 996 AS gid, CONCAT('*:bytes=', quota) AS quota_rule, CONCAT('maildir:storage=', quota) AS quota FROM mailbox WHERE username = LOWER('%u') AND active = '1' AND suspended = ?0' > > And when I run command "doveadm -D quota get -u test1 at testdomain1.tld? i see In MySQL query log that query is sent. > > > On 28 Apr 2015, at 12:00, Edgaras Luko?evi?ius wrote: > >> Hello, >> >> after rebooting my dovecot server quotas are no longer working. >> >> # dovecot --version >> 2.2.10 >> >> CentOS Linux release 7.0.1406 >> >> It is strange that restarting dovecot did not reveal this problem, but rebooting whole server did. >> >> >> >> Before reboot it was like this: >> >> # doveadm -D quota get -u test1 at testdomain1.tld >> doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot >> doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so >> doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm >> 03NB0d9erYBwhnzXhbS66fLDMU8v4ZiCDQDM3tDHCKme4ujpHy/lRk33305AIO9UXtgHGFyJYSpcVgoVnXJQGpJBphGvkAF4XI1JGx83Dtlb44wgJ8ZBgOm4qSNOoQIXKv0NO35EwUohtYBMlDJKPRUTwRF93tW7RsfWZGVNi4Eo5k616Tn4ooU3JMXkQA8LZ5zzLllspBVDbyb4GPAmWiw== root at ovzcloud >> doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) >> doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) >> doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so >> doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so >> doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) >> doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) >> doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota=maildir:storage=512000000 >> doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota_rule=*:bytes=512000000 >> doveadm(test1 at testdomain1.tld): Debug: Effective uid=997, gid=996, home=/home/vmail/t/e/testdomain1.tld/test1/ >> doveadm(test1 at testdomain1.tld): Debug: Quota root: name=storage=512000000 backend=maildir args= >> doveadm(test1 at testdomain1.tld): Debug: Quota rule: root=storage=512000000 mailbox=* bytes=512000000 messages=0 >> doveadm(test1 at testdomain1.tld): Debug: Quota warning: bytes=486400000 (95%) messages=0 reverse=no command=quota-warning 95 test1 at testdomain1.tld >> doveadm(test1 at testdomain1.tld): Debug: Quota warning: bytes=409600000 (80%) messages=0 reverse=no command=quota-warning 80 test1 at testdomain1.tld >> doveadm(test1 at testdomain1.tld): Debug: Quota grace: root=storage=512000000 bytes=25600000 (5%) >> doveadm(test1 at testdomain1.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/t/e/testdomain1.tld/test1/ >> doveadm(test1 at testdomain1.tld): Debug: maildir++: root=/home/vmail/t/e/testdomain1.tld/test1, index=, indexpvt=, control=, inbox=/home/vmail/t/e/testdomain1.tld/test1, alt= >> doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none >> doveadm(test1 at testdomain1.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= >> Quota name Type Value Limit % >> storage=512000000 STORAGE 0 500000 0 >> storage=512000000 MESSAGE 0 - >> >> >> >> Now after rebooting i get this output: >> >> # doveadm -D quota get -u test1 at testdomain1.tld >> doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot >> doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so >> doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm >> doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) >> doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) >> doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so >> doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so >> doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) >> doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) >> doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota=maildir:storage=512000000 >> doveadm(test1 at testdomain1.tld): Debug: Added userdb setting: plugin/quota_rule=*:bytes=512000000 >> doveadm(test1 at testdomain1.tld): Debug: Effective uid=997, gid=996, home=/home/vmail/t/e/testdomain1.tld/test1/ >> doveadm(test1 at testdomain1.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/t/e/testdomain1.tld/test1/ >> doveadm(test1 at testdomain1.tld): Debug: maildir++: root=/home/vmail/t/e/testdomain1.tld/test1, index=, indexpvt=, control=, inbox=/home/vmail/t/e/testdomain1.tld/test1, alt= >> doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: >> doveadm(test1 at testdomain1.tld): Debug: fs: root=, index=, indexpvt=, control=, inbox=, alt= >> doveadm(test1 at testdomain1.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none >> doveadm(test1 at testdomain1.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= >> doveadm(test1 at testdomain1.tld): Error: Quota not enabled >> Quota name Type Value Limit % >> >> >> >> >> # egrep -v "^#|^$" /etc/dovecot/conf.d/90-quota.conf >> plugin { >> quota = maildir >> #quota_rule = *:storage=1G >> #quota_rule2 = Trash:storage=+100M >> # LDA/LMTP allows saving the last mail to bring user from under quota to >> # over quota, if the quota doesn't grow too high. Default is to allow as >> # long as quota will stay under 10% above the limit. Also allowed e.g. 10M. >> #quota_grace = 10%% >> quota_grace = 5%% >> quota_status_success = DUNNO >> quota_status_nouser = DUNNO >> quota_status_overquota = "552 5.2.2 Mailbox is full" >> } >> plugin { >> quota_warning = storage=95%% quota-warning 95 %u >> quota_warning2 = storage=80%% quota-warning 80 %u >> } >> plugin { >> #quota = dirsize:User quota >> #quota = maildir:User quota >> #quota = dict:User quota::proxy::quota >> #quota = fs:User quota >> } >> plugin { >> #quota = dict:user::proxy::quota >> #quota2 = dict:domain:%d:proxy::quota_domain >> #quota_rule = *:storage=102400 >> #quota2_rule = *:storage=1048576 >> } >> service quota-warning { >> executable = script /usr/local/bin/quota-warning.sh >> user = dovecot >> unix_listener quota-warning { >> user = vmail >> } >> } >> service quota-status { >> executable = quota-status -p postfix >> inet_listener { >> port = 12340 >> # You can choose any port you want >> } >> client_limit = 1 >> } > From wdgarc88 at gmail.com Tue Apr 28 11:34:38 2015 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Tue, 28 Apr 2015 21:34:38 +1000 Subject: CVE-2015-3420 In-Reply-To: <1A7AF112-3C5B-413B-AD01-8865ED78D088@iki.fi> References: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> <1A7AF112-3C5B-413B-AD01-8865ED78D088@iki.fi> Message-ID: On 4/28/15, Timo Sirainen wrote: > On 28 Apr 2015, at 11:35, Timo Sirainen wrote: >> >> On 28 Apr 2015, at 04:15, Edwardo Garcia wrote: >>> When can we expect 2.2.17 to resolve this? >> >> As far as I know this doesn't affect any of the major distributions where >> Dovecot is commonly used (Debian/Ubuntu/Redhat/CentOS). I've only heard i Most of those distributions are way outdate version anyway, if they were not maybe problem be seen too >> happening with some self-compiled OpenSSL versions (Arch/Gentoo?), so I >> don't see this as especially critical issue. But I'm planning on v2.2.17 >> release sometimes soon anyway for other reasons. > > Oh, forgot to post also the committed patch fixing this: > http://hg.dovecot.org/dovecot-2.2/rev/86f535375750 > Thank you, with couple million users we can not afford take chance, so will apply patch this morning on all servers. From alex2grad at gmail.com Tue Apr 28 13:42:35 2015 From: alex2grad at gmail.com (Alexei Gradinari) Date: Tue, 28 Apr 2015 09:42:35 -0400 Subject: Trash Plugin bugs In-Reply-To: <1278581516.20150413112716@gmail.com> References: <1137483717.20150409174434@gmail.com> <1278581516.20150413112716@gmail.com> Message-ID: <565051478.20150428094235@gmail.com> Hello Timo, Are you going to commit my patch to Dovecot v2.2.x? I sent it 2 weeks ago and still haven't seen it in http://hg.dovecot.org/dovecot-2.2/ Regards, Alexei -------------- next part -------------- A non-text attachment was scrubbed... Name: trash-plugin.patch Type: application/octet-stream Size: 2118 bytes Desc: not available URL: From lists.zxinn at otaking.se Tue Apr 28 17:40:27 2015 From: lists.zxinn at otaking.se (=?windows-1252?Q?Tobias_Franz=E9n?=) Date: Tue, 28 Apr 2015 19:40:27 +0200 Subject: [Dovecot] Dovecot LDA/LMTP vs postfix virtual delivery agent and the x-original-to header In-Reply-To: <52CD5370.50503@Media-Brokers.com> References: <4F7D972A.8050406@Media-Brokers.com> <4F82DB22.2050201@Media-Brokers.com> <52CD5370.50503@Media-Brokers.com> Message-ID: <553FC60B.3030506@otaking.se> On 2014-01-08 14:32, Charles Marcus wrote: > On 2012-04-09 8:53 AM, Timo Sirainen wrote: >> On 9.4.2012, at 15.50, Charles Marcus wrote: >>>> LMTP adds a new Delivered-To: header when there is >>>> a single RCPT TO. You can force a single RCPT TO from Postfix side by >>>> setting lmtp_destination_recipient_limit=1. LMTP doesn't >>>> add/remove/change X-Original-To: header. > >>> Ok, thanks Timo... but... >>> >>> Are you saying that this 'Delivered-To:' header can somehow be >>> leveraged to provide the same info as the x-original-to header? > >> I guess X-Original-To is the same address as what Postfix sees as the >> original RCPT TO address before alias expansion and such? In that >> case, see my today's mail in Postfix list.. > > Hi Timo, > > I just tried to find your email from that day, but don't see it in the > archives... > > Was this ever resolved (getting x-original-to support in LMTP, like it > is for the LDA)? > > If not, since it seemed like it wasn't going to be much work, any > chance you can revisit it soon? > > Thanks, > Hello, I have tried to keep tabs on the various discussions going on related to the X-Original-To header when using Dovecot LMTP. Until now I have not needed a solution, but I am now finally about to migrate my old server. Old setup: Postfix + SpamAssassin (after-queue content filter via pipe) + virtual transport, and Courier-IMAP. New setup: Postfix + amavisd-new (after-queue content filter via smtp, with ClamAV and SpamAssassin) + Dovecot LMTP, and Dovecot for IMAP. Charles, have you found a way that works for you? I was experimenting some with my test server and came up with a way that utilizes some additional internal smtp content filter forwarding, which produces some overhead. It should be light compared with the load from ClamAV and SpamAssassin, however. I'm not yet sure how amavisd-new funneling would handle multiple local recipients with different settings without passing the mail through multiple time, at least once per local user, let alone without first performing address mapping in postfix (for alias expansion). I have configured per-user SpamAssassin bayes filtering, and may introduce a whitelist based on address book entries (Roundcube.) This solution I'm currently testing will pass each message through amavisd-new one time each per local and remote recipient, and will only add the X-Original-To header to the specific local recipient each envelope is intended for. No external users will receive the header, and no local user will see which other local users (e.g. via BCC) have potentially received the same message. Flow: all mail in (both external and tls-authenticated internal) -> smtp (1) -> smtp-split (2) -> smtp-to-me (3a) | smtp-to-external (3b) -> smtp-amavis (4) -> dovecot-lmtp (5) 1) I rely on default_destination_recipient_limit=1 in main.cf to split each incoming mail into one stream per recipient. 2) smtp-split will receive one stream per recipient. Default content_filter=smtp-to-me, followed by option "smtpd_recipient_restrictions=permit_auth_destination,check_recipient_access,pcre:/usr/local/etc/postfix/filter-to-external.pcre,permit_mynetworks,reject" means I stop processing restrictions if my server is the destination. If my server is not the destination, the FILTER in check_recipient_access will override the preceding smtp-to-me filter. Both 1) and 2) smtpd instances include option receive_override_options=no_address_mappings, to wait with mapping to internal recipient until we can add X-Original-To header for my server's users only. 3a) For mail to my server, smtp-to-me will add X-Original-To using a pcre script, in a similar fashion to step 2's filter. This step also expands the address mapping (by not specifying any receive_override_options). -o smtpd_recipient_restrictions=check_recipient_access,pcre:/usr/local/etc/postfix/recipient_access_x-orig.pcre,permit_mynetworks,reject 3b) For mail leaving my server, smtp-to-external will not add any processing besides implied expanding of the address mapping. 4) Mail is funneled through amavisd-new, once per final recipient. Mails leaving the server (sent from smtp-to-external) will be scanned by ClamV only. Mails with my server as the destination (sent from smtp-to-me) will go through ClamV, and SpamAssassin (together with per-user bayes filtering). 5) Nothing special is done here. The final destination address is sent to LMTP for delivery. Contents of /usr/local/etc/postfix/recipient_access_x-orig.pcre: /(.+)/ prepend X-Original-To: <$1> Contents of /usr/local/etc/postfix/filter-to-external.pcre: /^/ FILTER smtp-to-external:[127.0.0.1]: Room for improvement: Postfix seem to know the orig_to even after processing in amavisd-new, however I have yet to find a way to use this option. I can move the amavisd-new filter to before the X-Original-To header addition, however for amavisd-new to utilize per-user bayes, I currently need to do the address mapping in postfix before sending the content to amavisd-new. This may be possible to circumvent either with alias lookup in amavisd-new, or if I can find another way to use the postfix-available "orig_to" to populate X-Original-To header after scanning in amavisd-new. I've tried to split the mails into one per recipient after address mapping and amavisd-new, instead of before as my solution above, without default_destination_recipient_limit=1 in main.cf. Instead I tried the options as part of smtp (and even smtpd) services in master.cf, unfortunately without success. I keep ending up with multiple X-Original-To with all local recipients (including BCC) in all internal copies delivered. Have anyone successfully tackled this conundrum with other solutions? Regards, Tobias From tss at iki.fi Tue Apr 28 19:07:17 2015 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Apr 2015 21:07:17 +0200 Subject: CVE-2015-3420 In-Reply-To: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> References: <16DD08C1-32FC-409A-A659-656FD1B82385@iki.fi> Message-ID: Timo Sirainen kirjoitti 28.4.2015 kello 11.35: > >> On 28 Apr 2015, at 04:15, Edwardo Garcia wrote: >> When can we expect 2.2.17 to resolve this? > > As far as I know this doesn't affect any of the major distributions where Dovecot is commonly used (Debian/Ubuntu/Redhat/CentOS). I've only heard it happening with some self-compiled OpenSSL versions (Arch/Gentoo?), so I don't see this as especially critical issue. But I'm planning on v2.2.17 release sometimes soon anyway for other reasons. BTW. I wonder why the bug is officially in Dovecot when it was OpenSSL's new version that started causing the crash.. I wonder how many other software breaks with new OpenSSL. From CMarcus at Media-Brokers.com Tue Apr 28 19:27:07 2015 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 28 Apr 2015 15:27:07 -0400 Subject: [Dovecot] Dovecot LDA/LMTP vs postfix virtual delivery agent and the x-original-to header In-Reply-To: <553FC60B.3030506@otaking.se> References: <4F7D972A.8050406@Media-Brokers.com> <4F82DB22.2050201@Media-Brokers.com> <52CD5370.50503@Media-Brokers.com> <553FC60B.3030506@otaking.se> Message-ID: <553FDF0B.8020805@Media-Brokers.com> On 4/28/2015 1:40 PM, Tobias Franz?n wrote: > On 2014-01-08 14:32, Charles Marcus wrote: >> On 2012-04-09 8:53 AM, Timo Sirainen wrote: >>> On 9.4.2012, at 15.50, Charles Marcus wrote: >>>>> LMTP adds a new Delivered-To: header when there is >>>>> a single RCPT TO. You can force a single RCPT TO from Postfix side by >>>>> setting lmtp_destination_recipient_limit=1. LMTP doesn't >>>>> add/remove/change X-Original-To: header. >>>> Ok, thanks Timo... but... >>>> >>>> Are you saying that this 'Delivered-To:' header can somehow be >>>> leveraged to provide the same info as the x-original-to header? >>> I guess X-Original-To is the same address as what Postfix sees as the >>> original RCPT TO address before alias expansion and such? In that >>> case, see my today's mail in Postfix list.. >> Hi Timo, >> >> I just tried to find your email from that day, but don't see it in the >> archives... >> >> Was this ever resolved (getting x-original-to support in LMTP, like it >> is for the LDA)? >> >> If not, since it seemed like it wasn't going to be much work, any >> chance you can revisit it soon? > Hello, > > I have tried to keep tabs on the various discussions going on related to > the X-Original-To header when using Dovecot LMTP. Until now I have not > needed a solution, but I am now finally about to migrate my old server. > > Old setup: Postfix + SpamAssassin (after-queue content filter via pipe) > + virtual transport, and Courier-IMAP. > New setup: Postfix + amavisd-new (after-queue content filter via smtp, > with ClamAV and SpamAssassin) + Dovecot LMTP, and Dovecot for IMAP. > > Charles, have you found a way that works for you? No, and I simply haven't switched to LMTP yet, for this and one other reason (political, not technical)... As for the rest below... wow... all I can say is, it sure would be nice if Timo/Wietse could just add the few lines of code that Timo said would be needed to properly support it natively. > I was experimenting some with my test server and came up with a way that > utilizes some additional internal smtp content filter forwarding, which > produces some overhead. It should be light compared with the load from > ClamAV and SpamAssassin, however. > > I'm not yet sure how amavisd-new funneling would handle multiple local > recipients with different settings without passing the mail through > multiple time, at least once per local user, let alone without first > performing address mapping in postfix (for alias expansion). I have > configured per-user SpamAssassin bayes filtering, and may introduce a > whitelist based on address book entries (Roundcube.) > > > This solution I'm currently testing will pass each message through > amavisd-new one time each per local and remote recipient, and will only > add the X-Original-To header to the specific local recipient each > envelope is intended for. No external users will receive the header, and > no local user will see which other local users (e.g. via BCC) have > potentially received the same message. > > Flow: > all mail in (both external and tls-authenticated internal) -> smtp (1) > -> smtp-split (2) -> smtp-to-me (3a) | smtp-to-external (3b) -> > smtp-amavis (4) -> dovecot-lmtp (5) > > 1) I rely on default_destination_recipient_limit=1 in main.cf to split > each incoming mail into one stream per recipient. > 2) smtp-split will receive one stream per recipient. Default > content_filter=smtp-to-me, followed by option > "smtpd_recipient_restrictions=permit_auth_destination,check_recipient_access,pcre:/usr/local/etc/postfix/filter-to-external.pcre,permit_mynetworks,reject" > means I stop processing restrictions if my server is the destination. If > my server is not the destination, the FILTER in check_recipient_access > will override the preceding smtp-to-me filter. > > Both 1) and 2) smtpd instances include option > receive_override_options=no_address_mappings, to wait with mapping to > internal recipient until we can add X-Original-To header for my server's > users only. > > 3a) For mail to my server, smtp-to-me will add X-Original-To using a > pcre script, in a similar fashion to step 2's filter. This step also > expands the address mapping (by not specifying any > receive_override_options). > -o > smtpd_recipient_restrictions=check_recipient_access,pcre:/usr/local/etc/postfix/recipient_access_x-orig.pcre,permit_mynetworks,reject > > 3b) For mail leaving my server, smtp-to-external will not add any > processing besides implied expanding of the address mapping. > > 4) Mail is funneled through amavisd-new, once per final recipient. Mails > leaving the server (sent from smtp-to-external) will be scanned by ClamV > only. Mails with my server as the destination (sent from smtp-to-me) > will go through ClamV, and SpamAssassin (together with per-user bayes > filtering). > > 5) Nothing special is done here. The final destination address is sent > to LMTP for delivery. > > Contents of /usr/local/etc/postfix/recipient_access_x-orig.pcre: > /(.+)/ prepend X-Original-To: <$1> > > Contents of /usr/local/etc/postfix/filter-to-external.pcre: > /^/ FILTER smtp-to-external:[127.0.0.1]: > > > Room for improvement: > Postfix seem to know the orig_to even after processing in amavisd-new, > however I have yet to find a way to use this option. > I can move the amavisd-new filter to before the X-Original-To header > addition, however for amavisd-new to utilize per-user bayes, I currently > need to do the address mapping in postfix before sending the content to > amavisd-new. This may be possible to circumvent either with alias lookup > in amavisd-new, or if I can find another way to use the > postfix-available "orig_to" to populate X-Original-To header after > scanning in amavisd-new. > > I've tried to split the mails into one per recipient after address > mapping and amavisd-new, instead of before as my solution above, without > default_destination_recipient_limit=1 in main.cf. Instead I tried the > options as part of smtp (and even smtpd) services in master.cf, > unfortunately without success. I keep ending up with multiple > X-Original-To with all local recipients (including BCC) in all internal > copies delivered. > > > Have anyone successfully tackled this conundrum with other solutions? > > Regards, > Tobias > From bra at fsn.hu Tue Apr 28 20:49:06 2015 From: bra at fsn.hu (Nagy, Attila) Date: Tue, 28 Apr 2015 22:49:06 +0200 Subject: imapc fetch optimization Message-ID: <553FF242.80308@fsn.hu> Hi, imapc does a lot of UID FETCH $UID (BODY.PEEK[]), which is nice, because it works even with the dumbest IMAP server, altough it really kills performance, especially on high latency lines. I wonder: if IMAP servers can effectively handle boundless fetches (like a list with all wanted UIDs, or simply 1:* if all are needed), do you see this as a good addition to develop? This could be a new imapc_features setting afterall... Thanks, From niyalevi at gmail.com Tue Apr 28 21:37:33 2015 From: niyalevi at gmail.com (shadrock uhuru) Date: Tue, 28 Apr 2015 22:37:33 +0100 Subject: seeking sasl configuration example In-Reply-To: <118C4DF2-A7B0-4801-899C-27B98652E10D@pettijohn-web.com> References: <553CB0B6.5040102@gmail.com> <118C4DF2-A7B0-4801-899C-27B98652E10D@pettijohn-web.com> Message-ID: <553FFD9D.6030105@gmail.com> On 26/04/15 15:22, Edgar Pettijohn III wrote: > > On Apr 26, 2015, at 4:32 AM, shadrock uhuru wrote: > >> hi everyone >> could someone show me there sasl configuration section in their >> dovecot.conf, >> i have postfix and dovecot setup for virtual users (no system users) >> everything works fine including tls, >> i have tried various examples off the web for sasl but they either have >> obsolete parameters >> or are for a setup with system users, >> i would prefer to use dovecots sasl implementation. >> >> dovecot --version = 2.1.7 >> >> cat dovecot.conf >> >> ###################### >> ###################### >> >> disable_plaintext_auth = no >> mail_privileged_group = mail >> >> log_path = /var/log/dovecot.log >> # auth_verbose=yes >> # auth_debug=yes >> # auth_debug_passwords=yes >> mail_debug=yes >> # verbose_ssl=yes >> >> passdb { >> args = /etc/dovecot/dovecot-sql.conf >> driver = sql >> } >> userdb { >> driver = prefetch >> } >> userdb { >> args = /etc/dovecot/dovecot-sql.conf >> driver = sql >> } >> >> >> protocols = "pop3 imap lmtp" >> >> protocol imap { >> mail_plugins = " autocreate" >> } >> >> plugin { >> autocreate = Trash >> autocreate2 = Sent >> autocreate3 = junk >> autosubscribe = Trash >> autosubscribe2 = Sent >> autosubscribe3 = junk >> } >> >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> } >> > > That should do it. You just need to make sure postfix is set up > correctly. > > http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL > >> >> service lmtp { >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = postfix >> mode = 0600 >> user = postfix >> } >> } >> protocol lmtp { >> postmaster_address=postmaster at mydomain.com >> >> hostname=niya.mydomain.com >> } >> >> ssl_cert = > ssl_key = > >> ###################### >> ###################### >> >> >> thanks >> shadrock > many thank Edgar sasl is working but i was testing the smtp port instead of submission that sasl is setup for. From tss at iki.fi Wed Apr 29 08:29:40 2015 From: tss at iki.fi (Timo Sirainen) Date: Wed, 29 Apr 2015 10:29:40 +0200 Subject: Trash Plugin bugs In-Reply-To: <565051478.20150428094235@gmail.com> References: <1137483717.20150409174434@gmail.com> <1278581516.20150413112716@gmail.com> <565051478.20150428094235@gmail.com> Message-ID: <0DE1F7D0-F5C6-42EF-AA4B-723D6CB9FA24@iki.fi> On 28 Apr 2015, at 15:42, Alexei Gradinari wrote: > > Hello Timo, > > Are you going to commit my patch to Dovecot v2.2.x? > I sent it 2 weeks ago and still haven't seen it in http://hg.dovecot.org/dovecot-2.2/ Committed, thanks! http://hg.dovecot.org/dovecot-2.2/rev/e00f9e93a9a3 (the ret==0 check was already doing half of it, but since it didn't fully do it it could be removed entirely) http://hg.dovecot.org/dovecot-2.2/rev/2dbee58a1a0d http://hg.dovecot.org/dovecot-2.2/rev/8898c5ea38f2 From giorgio.paolucci at unipd.it Wed Apr 29 09:38:38 2015 From: giorgio.paolucci at unipd.it (giorgio paolucci) Date: Wed, 29 Apr 2015 11:38:38 +0200 Subject: lda and lmtp error after upgrading dovecot Message-ID: <5540A69E.1040907@unipd.it> Hello everybody, after upgrading dovecot on a debian wheezy installation from the standard package version (dovecot 2.1.7) to dovecot 2.2.13-11 from wheezy-backports, i noticed some errors in my logs... Apr 28 22:00:13 lmtp(4879, xxxxxxxxx at unipd.it): Info: copy from : box=INBOX, uid=error, msgid=<20150428200011.47D801F32 at mydoom.unipd.it>, size=1523 They are not frequent but still coninuing since the upgrade. After the upgrade I found also errors coming fom lda: Apr 28 12:29:36 lda(userxxxxxx at unipd.it): Info: copy from stdin: box=INBOX, uid=error, msgid=, size=595 Apr 28 12:29:37 lda(userxxxxxx at unipd.it): Info: msgid=unspecified: saved mail to INBOX Strange thing as I use lmtp for local delivery. Is there some tuning I can do? My storage is accessed via NFS with a load blancer keeping sticky sessions "per user". Is there any risk to loose mails? Here is my dovecot -n Thanks in advance. Best regards Giorgio ====================================== # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 auth_default_realm = unipd.it disable_plaintext_auth = no log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota listescape mail_log notify mdbox_rotate_interval = 1 days mdbox_rotate_size = 10 M mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext driver = sql } plugin { fts = solr fts_solr = break-imap-search url=http://147.162.10.96:8983/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size pop3_migration_mailbox = INBOX quota = dict:User quota::file:/SYSTEM/USERS/homes/%d/%1u/%u/%u.quota quota_rule = *:storage=1100M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } pop3c_host = 147.162.10.68 protocols = imap pop3 lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imaps { ssl = no } process_min_avail = 20 service_count = 1 } service imap { executable = imap postlogin } service lmtp { executable = lmtp inet_listener lmtp { port = 2223 } process_min_avail = 15 } service pop3-login { inet_listener pop3s { ssl = no } } service postlogin { executable = script-login -d rawlog user = vmail } service quota-warning { executable = script /SYSTEM/DOVECOT/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext driver = sql } protocol lmtp { info_log_path = /tmp/dovecot-lmtp-info.log log_path = /tmp/dovecot-lmtp.log mail_plugins = quota listescape mail_log notify } protocol imap { imap_max_line_length = 128 k mail_plugins = quota listescape mail_log notify imap_quota } protocol doveadm { mail_plugins = quota listescape mail_log notify pop3_migration } protocol pop3 { pop3_no_flag_updates = yes pop3_uidl_format = %10v.%09u } -- Ing. Giorgio Paolucci Universita' di Padova Centro Servizi Informatici di Ateneo Responsabile Infrastrutture, Networking e Sicurezza Tel.+39-049-8273711 -- From astarmathsandphysics at gmail.com Wed Apr 29 10:57:31 2015 From: astarmathsandphysics at gmail.com (Paul Smith) Date: Wed, 29 Apr 2015 11:57:31 +0100 Subject: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve In-Reply-To: References: Message-ID: Fixed this error removed sieve from list of protocils in 99-mail-stack-delivery.conf On 27 April 2015 at 10:19, Paul Smith wrote: > Here is the output from dovecot -n > > # 2.2.9: /etc/dovecot/dovecot.conf > # OS: Linux 3.13.0-32-generic x86_64 Ubuntu 14.04.2 LTS ext4 > auth_mechanisms = plain login > auth_verbose = yes > log_path = /var/log/dovecot.log > mail_debug = yes > mail_location = maildir:/var/mail/vhosts/%d/%n > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = lmtp imap pop3 sieve > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener /var/spool/postfix/private/dovecot-auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > mode = 0600 > user = vmail > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 0 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > } > ssl_cert = ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RS > A:+HIGH:+MEDIUM > ssl_key = userdb { > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > driver = static > } > doveconf: Error: protocols: Unknown protocol: sieve > protocol lda { > deliver_log_format = msgid=%m: %$ > mail_plugins = sieve > postmaster_address = postmaster > quota_full_tempfail = yes > rejection_reason = Your message to <%t> was automatically rejected:%n%r > } > protocol imap { > imap_client_workarounds = delay-newmail > mail_max_userip_connections = 10 > } > protocol pop3 { > mail_max_userip_connections = 10 > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: > protocols: Unknown protocol: sieve > > > PS dovecot-sieve is installe. Also this error appears without sieve in the > list of protocols in /etc/dovecot/dovecot.conf > From giorgio.paolucci at unipd.it Wed Apr 29 13:15:18 2015 From: giorgio.paolucci at unipd.it (giorgio paolucci) Date: Wed, 29 Apr 2015 15:15:18 +0200 Subject: lda and lmtp error after upgrading dovecot In-Reply-To: <5540A69E.1040907@unipd.it> References: <5540A69E.1040907@unipd.it> Message-ID: <5540D966.9070104@unipd.it> Hello everybody, I forgot to add a complete transaction sample of local delivery. The following log depicts a mail delivery with two recipients; 10.1.1.1 is the last hop MTA server that calls lmtp for local delivery; the first recipient got a correct uid while the second gets a "uid=error"; both mails got delivered to INBOX correctly.... Thankyou in advance Best regards Giorgio ------------------------------ Apr 29 09:45:45 lmtp(18802): Info: Connect from 10.1.1.1 Apr 29 09:45:46 lmtp(18802, yyyyyy at unipd.it): Info: copy from : box=INBOX, uid=32333, msgid=<64942404.485.1430293540583.JavaMail.tomcat6 at host.unipd.it>, size=2891 Apr 29 09:45:46 lmtp(18802, yyyyyy at unipd.it): Info: Jj/kNF6LQFVySQAAddyHeA: msgid=<64942404.485.1430293540583.JavaMail.tomcat6 at host.unipd.it>: saved mail to INBOX Apr 29 09:45:46 lmtp(18802, xxxxxxxx at unipd.it): Info: copy from : box=INBOX, uid=error, msgid=<64942404.485.1430293540583.JavaMail.tomcat6 at host.unipd.it>, size=3014 Apr 29 09:45:46 lmtp(18802, xxxxxxxx at unipd.it): Info: KD/kNF6LQFVySQAAddyHeA: msgid=<64942404.485.1430293540583.JavaMail.tomcat6 at host.unipd.it>: saved mail to INBOX Apr 29 09:45:48 lmtp(18802): Info: Disconnect from 10.1.1.1: Connection closed (in reset) On 29/04/2015 11:38, giorgio paolucci wrote: > Hello everybody, > after upgrading dovecot on a debian wheezy installation from the > standard package version (dovecot 2.1.7) to dovecot 2.2.13-11 from > wheezy-backports, i noticed some errors in my logs... > > Apr 28 22:00:13 lmtp(4879, xxxxxxxxx at unipd.it): Info: copy from DATA>: box=INBOX, uid=error, > msgid=<20150428200011.47D801F32 at mydoom.unipd.it>, size=1523 > > They are not frequent but still coninuing since the upgrade. > > After the upgrade I found also errors coming fom lda: > > Apr 28 12:29:36 lda(userxxxxxx at unipd.it): Info: copy from stdin: > box=INBOX, uid=error, msgid=, size=595 > Apr 28 12:29:37 lda(userxxxxxx at unipd.it): Info: msgid=unspecified: saved > mail to INBOX > > Strange thing as I use lmtp for local delivery. > > Is there some tuning I can do? My storage is accessed via NFS with a > load blancer keeping sticky sessions "per user". > > Is there any risk to loose mails? > > Here is my dovecot -n > > Thanks in advance. > > Best regards > > Giorgio > ====================================== > > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 > auth_default_realm = unipd.it > disable_plaintext_auth = no > log_path = /var/log/dovecot/dovecot.log > mail_fsync = always > mail_nfs_index = yes > mail_nfs_storage = yes > mail_plugins = quota listescape mail_log notify > mdbox_rotate_interval = 1 days > mdbox_rotate_size = 10 M > mmap_disable = yes > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > separator = / > } > passdb { > args = /etc/dovecot/conf.d/dovecot-sql.conf.ext > driver = sql > } > passdb { > args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext > driver = sql > } > plugin { > fts = solr > fts_solr = break-imap-search url=http://147.162.10.96:8983/solr/ > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename > mail_log_fields = uid box msgid size > pop3_migration_mailbox = INBOX > quota = dict:User quota::file:/SYSTEM/USERS/homes/%d/%1u/%u/%u.quota > quota_rule = *:storage=1100M > quota_rule2 = Trash:storage=+100M > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > pop3c_host = 147.162.10.68 > protocols = imap pop3 lmtp > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > } > service imap-login { > inet_listener imaps { > ssl = no > } > process_min_avail = 20 > service_count = 1 > } > service imap { > executable = imap postlogin > } > service lmtp { > executable = lmtp > inet_listener lmtp { > port = 2223 > } > process_min_avail = 15 > } > service pop3-login { > inet_listener pop3s { > ssl = no > } > } > service postlogin { > executable = script-login -d rawlog > user = vmail > } > service quota-warning { > executable = script /SYSTEM/DOVECOT/scripts/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = vmail > } > ssl = no > userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/conf.d/dovecot-sql.conf.ext > driver = sql > } > userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/conf.d/dovecot-sqlSSO.conf.ext > driver = sql > } > protocol lmtp { > info_log_path = /tmp/dovecot-lmtp-info.log > log_path = /tmp/dovecot-lmtp.log > mail_plugins = quota listescape mail_log notify > } > protocol imap { > imap_max_line_length = 128 k > mail_plugins = quota listescape mail_log notify imap_quota > } > protocol doveadm { > mail_plugins = quota listescape mail_log notify pop3_migration > } > protocol pop3 { > pop3_no_flag_updates = yes > pop3_uidl_format = %10v.%09u > } > > > -- Ing. Giorgio Paolucci Universita' di Padova Centro Servizi Informatici di Ateneo Responsabile Infrastrutture, Networking e Sicurezza Tel.+39-049-8273711 -- From racuk12 at gmail.com Wed Apr 29 15:19:38 2015 From: racuk12 at gmail.com (Robert Chalmers) Date: Wed, 29 Apr 2015 16:19:38 +0100 Subject: How do I compile passed driver for sql into Dovecot? In-Reply-To: References: Message-ID: Sorry - I found the issue and dealt with it. Forgot about compiling it in and Configure time. Robert On Wed, Apr 29, 2015 at 2:57 PM, Robert Chalmers wrote: > I'm getting this error message when trying to run. > > > dovecot[1997]: auth: Fatal: Support not compiled in for passdb driver 'sql' > > > thanks > > Robert > From miloslav.hula at gmail.com Wed Apr 29 20:47:25 2015 From: miloslav.hula at gmail.com (=?ISO-8859-2?Q?Miloslav_H=F9la?=) Date: Wed, 29 Apr 2015 22:47:25 +0200 Subject: Postpone email delivery with LMTP and Postfix Message-ID: <5541435D.7020705@gmail.com> Hi, is there any way, based on userdb/passwdb attribute, how to postpone an email delivery? The purpose is, I need to freeze an account (Maildir++) for a few minutes and new email must not be delivered. But emails must be delivered when account is unfrozen. I found few things about Postfix filters, but I'm not sure it's a good way. Thank you, Milo From gedalya at gedalya.net Wed Apr 29 22:44:54 2015 From: gedalya at gedalya.net (Gedalya) Date: Wed, 29 Apr 2015 18:44:54 -0400 Subject: Postpone email delivery with LMTP and Postfix In-Reply-To: <5541435D.7020705@gmail.com> References: <5541435D.7020705@gmail.com> Message-ID: <55415EE6.3060908@gedalya.net> On 04/29/2015 04:47 PM, Miloslav H?la wrote: > Hi, > > is there any way, based on userdb/passwdb attribute, how to postpone > an email delivery? The purpose is, I need to freeze an account > (Maildir++) for a few minutes and new email must not be delivered. But > emails must be delivered when account is unfrozen. > > I found few things about Postfix filters, but I'm not sure it's a good > way. > > Thank you, Milo The right way would probably be to use a transport map in postfix to defer deliveries for specific recipients. From emailbuilder88 at yahoo.com Thu Apr 30 01:18:03 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Wed, 29 Apr 2015 18:18:03 -0700 Subject: quota_over_flag examples? In-Reply-To: <1429232857.97649.YahooMailBasic@web142401.mail.bf1.yahoo.com> Message-ID: <1430356683.45968.YahooMailBasic@web142405.mail.bf1.yahoo.com> > > > Anyone knows how to use this flag with postfix *making postfix send > > > special reject* "user over quota" note instead of plain SMTP reject?? > > > Is an additional database lookup (restriction class?) unavoidable? :( > > > > I don't actually use this, but try perhaps: > > https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ > > And perhaps search the mailing list for "quota-status" for more info. > > That's not the same. Strange but I never found quota-status docs on > Dovecot wiki nowhere! Anyway, I think quota_over_flag is new and > possibly Timo replacing quota-status with this flag now? Can anyone confirm this is true? From marton.peter at gmail.com Thu Apr 30 05:50:45 2015 From: marton.peter at gmail.com (=?UTF-8?B?UMOpdGVyIE3DoXJ0b24=?=) Date: Thu, 30 Apr 2015 07:50:45 +0200 Subject: quota_over_flag examples? In-Reply-To: <1430356683.45968.YahooMailBasic@web142405.mail.bf1.yahoo.com> References: <1429232857.97649.YahooMailBasic@web142401.mail.bf1.yahoo.com> <1430356683.45968.YahooMailBasic@web142405.mail.bf1.yahoo.com> Message-ID: >> That's not the same. Strange but I never found quota-status docs on >> Dovecot wiki nowhere! Anyway, I think quota_over_flag is new and >> possibly Timo replacing quota-status with this flag now? > > Can anyone confirm this is true? I don't want to speak in the name of others, but I think that quota-status doesn't fit in the Dovecot "world". It contradicts the tenet of "Dovecot don't have to know about email addresses", because Postfix sends email addresses with Policy-requests. And yes, you can make it work somehow even if your mailbox names are not email addresses, but IMHO it won't be as fast (or as secure) as a db query by Postfix. Peter From reuben-dovecot at reub.net Thu Apr 30 06:51:28 2015 From: reuben-dovecot at reub.net (Reuben Farrelly) Date: Thu, 30 Apr 2015 16:51:28 +1000 Subject: doveadm -D and -v options Message-ID: <5541D0F0.1050204@reub.net> According to doveadm-dsync man page the above two options are valid, but they are rejected when used: tornado # doveadm backup -v -u testuser remote:pi.me.name:4814 backup: invalid option -- 'v' doveadm backup [-u |-A] [-S ] [-fPRU] [-l ] [-r ] [-m ] [-g ] [-n | -N] [-x ] [-s ] -d| tornado # tornado # doveadm backup -D -u testuser remote:pi.me.name:4814 backup: invalid option -- 'D' doveadm backup [-u |-A] [-S ] [-fPRU] [-l ] [-r ] [-m ] [-g ] [-n | -N] [-x ] [-s ] -d| tornado # This is with 2.2.16 (latest -hg). Looks to me like either a bug, or the documentation (man doveadm-sync) is incorrect...? Reuben From gedalya at gedalya.net Thu Apr 30 07:17:16 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 30 Apr 2015 03:17:16 -0400 Subject: doveadm -D and -v options In-Reply-To: <5541D0F0.1050204@reub.net> References: <5541D0F0.1050204@reub.net> Message-ID: <5541D6FC.1010808@gedalya.net> On 04/30/2015 02:51 AM, Reuben Farrelly wrote: > According to doveadm-dsync man page the above two options are valid, > but they are rejected when used: > > tornado # doveadm backup -v -u testuser remote:pi.me.name:4814 > backup: invalid option -- 'v' > doveadm backup [-u |-A] [-S ] [-fPRU] [-l ] > [-r ] [-m ] [-g ] [-n > | -N] [-x ] [-s ] -d| > tornado # > tornado # doveadm backup -D -u testuser remote:pi.me.name:4814 > backup: invalid option -- 'D' > doveadm backup [-u |-A] [-S ] [-fPRU] [-l ] > [-r ] [-m ] [-g ] [-n > | -N] [-x ] [-s ] -d| > tornado # > > This is with 2.2.16 (latest -hg). Looks to me like either a bug, or > the documentation (man doveadm-sync) is incorrect...? > > Reuben The man page appears to be wrong. [-Dv] belongs right after doveadm, before [sync|backup] doveadm -v backup -u testuser remote:pi.me.name:4814 From racuk12 at gmail.com Thu Apr 30 10:05:05 2015 From: racuk12 at gmail.com (Robert Chalmers) Date: Thu, 30 Apr 2015 11:05:05 +0100 Subject: A question about Configure time options, and base directories and Defaults? Message-ID: I originally downloaded the sources a few weeks ago, dovecot-2.2.16, and simply did a ./configure make make install I'm running OSX 10.10.3 on a mac-mini. Not being too sure that I was going to go ahead with this whole idea... in any event, I did. BUT... most documentation I come across as I search for answers refers to the base directories being below /etc - as in postfix actually. ie; /etc/dovecot /etc/postfix Which seems logical to me - and appears to be a "default" or standard, at least in most documentation. However, my cavaliere installation put everything below /usr/local, as in /usr/local/etc/dovecot Which has caused me no end of fiddling as I try and remember where things are when I'm working on config files. There even appears to be a /private/etc/dovecot folder, which I seem to have somehow created about a month ago??? but is empty anyway. So, on my Mac I now have these folders/directories. These may have been created by a previous attempt, or by an installation to CutedgeSystems Mailserve. Now redundant. /private/etc/dovecot <---- empty /private/etc/pam.d/dovecot <--- contains login, pop3, ssh etc etc /private/var/spool/postfix/private/dovecot <-- this is a link to the one just above ??? or the other one is a link to this? /usr/libexec/dovecot <-- this contains a link to dovecot-lda [dovecot-lda -> /usr/local/libexec/dovecot/dovecot-lda] that I put in myself because that's where dovecot was looking for it. ========= everything below this line is as a result of the installation from source /usr/local/cutedge/dovecot /usr/local/etc/dovecot /usr/local/include/dovecot /usr/local/lib/dovecot /usr/local/libexec/dovecot /usr/local/sbin/dovecot /usr/local/share/doc/dovecot /usr/local/var/lib/dovecot /usr/local/var/run/dovecot I see from this list in someone else's post, that it's obviously possible - and I should have remembered - to put the files where ever I want them. i.e. /etc/dovecot If I read this list right, it will put the installation into /etc/dovecot - with some in other, appropriate directories. NOT all below /user/local as I have done. --prefix=/usr \ --sysconfdir=/etc \ --libexecdir=\${prefix}/lib \ --localstatedir=/var \ --mandir=\${prefix}/share/man \ --infodir=\${prefix}/share/info \ --with-moduledir=\${prefix}/lib/dovecot/modules \ --disable-rpath \ --disable-static Now for the burning question. Is it possible now to re-configure, then reinstall into the more appropriate directories, then copy the configuration files over. Make the appropriate weeks, and remove the original /usr/local/xxxx installation? Or is that just a step too far for the sake of what is essentially window dressing. The system I might add appears to be working as is? Thanks for any advice from the experts. (Sorry if the formatting in this post gets screwed up. It;s gmail;s web interface) Robert From tlx at leuxner.net Thu Apr 30 16:51:01 2015 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 30 Apr 2015 18:51:01 +0200 Subject: Postpone email delivery with LMTP and Postfix In-Reply-To: <5541435D.7020705@gmail.com> References: <5541435D.7020705@gmail.com> Message-ID: <20150430165101.GA7666@nihlus.leuxner.net> * Miloslav H?la 2015.04.29 22:47: > is there any way, based on userdb/passwdb attribute, how to postpone an > email delivery? The purpose is, I need to freeze an account (Maildir++) for > a few minutes and new email must not be delivered. But emails must be > delivered when account is unfrozen. You can put the messages on hold and then release them again: http://wiki2.dovecot.org/Migration/Online -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: Digital signature URL: From stephan at rename-it.nl Thu Apr 30 17:52:14 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 30 Apr 2015 19:52:14 +0200 Subject: Xi broken Message-ID: <55426BCE.1090907@rename-it.nl> Hi, Xi is broken at the moment. This XenServer version won't boot jessie kernel. Can't fix this myself, so this may take some time. Regards, Stephan. From gedalya at gedalya.net Thu Apr 30 18:02:35 2015 From: gedalya at gedalya.net (Gedalya) Date: Thu, 30 Apr 2015 14:02:35 -0400 Subject: Xi broken In-Reply-To: <55426BCE.1090907@rename-it.nl> References: <55426BCE.1090907@rename-it.nl> Message-ID: <55426E3B.4040802@gedalya.net> On 04/30/2015 01:52 PM, Stephan Bosch wrote: > Hi, > > Xi is broken at the moment. This XenServer version won't boot jessie > kernel. > > Can't fix this myself, so this may take some time. > > Regards, > > Stephan. I had this issue too with XenServer. Changed to hvm to make it boot. It worked. From emailbuilder88 at yahoo.com Thu Apr 30 18:50:59 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 30 Apr 2015 11:50:59 -0700 Subject: Failed running extprograms execute via socket - fatal recv(MSG_PEEK) failed disconnected In-Reply-To: <1430166670.64801.YahooMailBasic@web142406.mail.bf1.yahoo.com> Message-ID: <1430419859.1254.YahooMailBasic@web142406.mail.bf1.yahoo.com> > I switched from running my extprograms execute script directly > to running with dovecot socket. Log shows only this > > dovecot: lmtp(test at example.com): Debug: wdi0Tb5VPlGfPnEAM/SpMA: sieve: action execute: running program: test > dovecot: lmtp(test at example.com): Debug: Namespace : Using permissions from /vmail/example.com/test: mode=0770 gid=default > dovecot: script: Fatal: recv(MSG_PEEK) failed: disconnected > > For testing I opened up the script and socket with > permissions 777 but the error seems to indicate > less about permissions more about some kind of > protocol problem i guessing. No one can help? Is anybody using the Sieve extprograms execute via Dovecot socket service? I think my config is vanilla, no? All other Dovecot and Sieve things (including quota service scripts configured very similarly) work fine. Taking a look at the code, the error seems to indicate that no input is available on the socket when Dovecot checks. Does my script need to behave differently? What exactly to do? Should I just go back to direct execute? What's the difference anyway beside the user/permissions will be different? Stephan? Anyone? > Sieve script calls using this: > > execute "test"; > > Plugin config: > > plugin { > sieve_plugins = sieve_extprograms > sieve_global_extensions = +vnd.dovecot.execute > sieve_execute_socket_dir = sieve-execute > sieve_before = /usr/local/etc/dovecot/sieve > } > service test { > executable = script /usr/local/etc/dovecot/sieve_globals/test.sh > unix_listener sieve-execute/test { > mode = 0660 > group = vmail > } > } > > FYI I have quota-warning sockets configured > identical to this and they work good. > > Dovecot 2.2.16 > Pigeonhole 0.4.7 > > Help appreciate a lot. From emailbuilder88 at yahoo.com Thu Apr 30 19:04:37 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 30 Apr 2015 12:04:37 -0700 Subject: Sieve extprograms ?not exexuting? In-Reply-To: <1430160954.20937.YahooMailBasic@web142402.mail.bf1.yahoo.com> Message-ID: <1430420677.17046.YahooMailBasic@web142406.mail.bf1.yahoo.com> >>> Debug-enabled log give me: >>> Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: >>> qOGyA0DePHVaOyHEM/SpMA: sieve: action execute: running >>> program: test.sh >>> Apr 27 04:11:36 mail dovecot: lmtp(test at example.com): Debug: >>> waiting for program `/usr/local/etc/dovecot/sieve_globals/test.sh' >>> to finish after 0 seconds >>> >>> So I guess it thinks it is running my script? But simple test script >>> does nothing. Here it is: >>> >>> #!/bin/sh >>> read INPUT >>> INPUT="Hello world: $INPUT" >>> echo "$INPUT" >> /tmp/hello >>> echo "---------------------------" >> /tmp/hello >>> >>> Permissions on this script file for now are rwxrwxrwx >>> But nothing goes to /tmp/hello at all. Script works when I run it >>> manually. I also tried without the "read" but I think that's required >>> isn't it? Anyway, what else can I do to debug this? >> >> Well, first try with a script that cannot fail (well most likely), e.g.: > > I tried your script for fun, same result. Log showing > the script was called, but no output from the script. > > I also deleted the script and made sure that debug > log showed that sieve could not find the script. Is it > chrooted or something weird? > > I have confirmed it is being run by calling "exit 3" and > seeing in the log that "program ... terminated with > non-zero exit code 3" so problem is in commands > accessing the filesystem I guess. I added this: > > echo "HELLO WORLD" 1>&2 > > And log shows "Error: HELLO WORLD" > > So it's working but no filesystem access. I just tried this too: touch /tmp/hello-world And nothing. I tried to *read* from the filesystem: TEST=$(cat /tmp/test) echo "TEST: $TEST" 1>&2 Nothing. I found that the script can do other things like connect to network or other services, but any way I try to do something with the filesystem come up empty. Dont' know if calling the script via dovecot socket service would make this different because there is a bug that prevents extprograms execute via socket broken (see other thread). Is this on purpose no filesystem access allowed? why? > Calling from sieve script with: > > execute :input "myinput" "test.sh"; > > Also tried > > execute "test.sh"; From larryrtx at gmail.com Thu Apr 30 19:15:49 2015 From: larryrtx at gmail.com (Larry Rosenman) Date: Thu, 30 Apr 2015 14:15:49 -0500 Subject: Sieve Rule: What am I missing here? Message-ID: I have a rule that sends all mail from root to a mailbox, but I want it to NOT send mail from mailing-lists there. if allof (address :contains :localpart "From" "root", not anyof(exists ["List-Id","List-ID","Mailing-List", "X-List-Name","List-Post"])) { fileinto "root-mail"; stop; } I got a mail with the following headers: Return-Path: Delivered-To: ler at lerctr.org Received: from thebighonker.lerctr.org by thebighonker.lerctr.org (Dovecot) with LMTP id gt09JVp6QlUfkQAAu+mOrA for ; Thu, 30 Apr 2015 13:54:29 -0500 Received: from mta.openssl.org ([194.97.150.230]:56641) by thebighonker.lerctr.org with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (Exim 4.85 (FreeBSD)) (envelope-from ) id 1YntbO-0009fK-Em for ler at lerctr.org; Thu, 30 Apr 2015 13:54:29 -0500 Received: from mta.openssl.org (localhost [127.0.0.1]) by mta.openssl.org (Postfix) with ESMTP id F3DF4204AE; Thu, 30 Apr 2015 18:54:11 +0000 (UTC) X-Original-To: openssl-users at mta.openssl.org Delivered-To: openssl-users at mta.openssl.org Received: by mta.openssl.org (Postfix, from userid 106) id 9D98B204AE; Thu, 30 Apr 2015 18:54:10 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on mta.openssl.org X-Spam-Level: X-Spam-Status: No, score=-0.5 required=5.0 tests=BAYES_05,RCVD_IN_MSPIKE_H4, RCVD_IN_MSPIKE_WL autolearn=ham autolearn_force=no version=3.4.0 X-Greylist: delayed 471 seconds by postgrey-1.34 at mta; Thu, 30 Apr 2015 18:54:10 UTC Received: from mtx6.mbn1.net (mtx6.mbn1.net [213.188.129.253]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by mta.openssl.org (Postfix) with ESMTPS id 51E1920135 for ; Thu, 30 Apr 2015 18:54:10 +0000 (UTC) From: m.de.groot To: "openssl-users at openssl.org" Date: Thu, 30 Apr 2015 20:46:11 +0200 Thread-Topic: Error signing document Thread-Index: AQHQg3XtdOOD1R0meUuAevuEqgOClg== Message-ID: < E7206BA2D53D894BAD0C4B62B2C52E7722E3CA8252 at MBX01.hosting01.active24.com> Accept-Language: nl-NL, en-US Content-Language: nl-NL X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: nl-NL, en-US MIME-Version: 1.0 Subject: [openssl-users] Error signing document X-BeenThere: openssl-users at openssl.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: openssl-users at openssl.org Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: quoted-printable Errors-To: openssl-users-bounces at openssl.org Sender: "openssl-users" X-Spam-Score: -0.9 (/) X-LERCTR-Spam-Score: -0.9 (/) X-Spam-Report: SpamScore (-0.9/5.0) BAYES_00=-1.9,HEADER_FROM_DIFFERENT_DOMAINS=0.001,KAM_LAZY_DOMAIN_SECURITY=1,RCVD_IN_MSPIKE_H3=-0.01,RCVD_IN_MSPIKE_WL=-0.01,T_RP_MATCHES_RCVD=-0.01 X-LERCTR-Spam-Report: SpamScore (-0.9/5.0) BAYES_00=-1.9,HEADER_FROM_DIFFERENT_DOMAINS=0.001,KAM_LAZY_DOMAIN_SECURITY=1,RCVD_IN_MSPIKE_H3=-0.01,RCVD_IN_MSPIKE_WL=-0.01,T_RP_MATCHES_RCVD=-0.01 What am I missing in the AnyOf part? Or am I totally messed up? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From stephan at rename-it.nl Thu Apr 30 21:00:23 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 30 Apr 2015 23:00:23 +0200 Subject: Sieve Rule: What am I missing here? In-Reply-To: References: Message-ID: <554297E7.10506@rename-it.nl> On 4/30/2015 9:15 PM, Larry Rosenman wrote: > I have a rule that sends all mail from root to a mailbox, but I want it to > NOT send mail from mailing-lists there. > > if allof (address :contains :localpart "From" "root", > not anyof(exists ["List-Id","List-ID","Mailing-List", > "X-List-Name","List-Post"])) > { > fileinto "root-mail"; > stop; > } > > > What am I missing in the AnyOf part? Or am I totally messed up? A trace of the script shows the following for the provided example message: " $ sieve-test -t - -Tlevel=matching ~/script.sieve ~/message.eml ## Started executing script 'script' 3: address test 3: starting `:contains' match with `i;ascii-casemap' comparator: 3: extracting `From' headers from message 3: parsing address header value `m.de.groot ' 3: extracting `localpart' part from address 3: matching value `m.de.groot' 3: with key `root' => 1 3: finishing match with result: matched 3: jump if result is false 3: not jumping 4: exists test 4: header `List-Id' exists 4: header `List-ID' exists 4: header `Mailing-List' is missing 4: headers are missing 5: jump if result is true 5: not jumping 7: fileinto action 7: store message in mailbox `root-mail' 8: stop command; end all script execution ## Finished executing script 'frop' Performed actions: * store message in folder: root-mail Implicit keep: (none) sieve-test(stephan): Info: final result: success " So, the "exists" test returns false, because not all listed headers exist, which conforms to the specification: RFC 5228: " 5.5. Test exists Usage: exists The "exists" test is true if the headers listed in the header-names argument exist within the message. All of the headers must exist or the test is false. " Also, your use of "anyof" is useless. The following should work: " require "fileinto"; if allof (address :contains :localpart "From" "root", not anyof( exists "List-Id", exists "List-ID", exists "Mailing-List", exists "X-List-Name", exists "List-Post")) { fileinto "root-mail"; stop; } " Regards, Stephan. From larryrtx at gmail.com Thu Apr 30 21:04:24 2015 From: larryrtx at gmail.com (Larry Rosenman) Date: Thu, 30 Apr 2015 16:04:24 -0500 Subject: Sieve Rule: What am I missing here? In-Reply-To: <554297E7.10506@rename-it.nl> References: <554297E7.10506@rename-it.nl> Message-ID: Thanks! -- I figured it was stupid stuff but my head was spinning. Appreciate the help! On Thu, Apr 30, 2015 at 4:00 PM, Stephan Bosch wrote: > On 4/30/2015 9:15 PM, Larry Rosenman wrote: > > I have a rule that sends all mail from root to a mailbox, but I want it > to > > NOT send mail from mailing-lists there. > > > > if allof (address :contains :localpart "From" "root", > > not anyof(exists ["List-Id","List-ID","Mailing-List", > > "X-List-Name","List-Post"])) > > { > > fileinto "root-mail"; > > stop; > > } > > > > > > What am I missing in the AnyOf part? Or am I totally messed up? > > A trace of the script shows the following for the provided example message: > > " > $ sieve-test -t - -Tlevel=matching ~/script.sieve ~/message.eml > > ## Started executing script 'script' > 3: address test > 3: starting `:contains' match with `i;ascii-casemap' comparator: > 3: extracting `From' headers from message > 3: parsing address header value `m.de.groot ' > 3: extracting `localpart' part from address > 3: matching value `m.de.groot' > 3: with key `root' => 1 > 3: finishing match with result: matched > 3: jump if result is false > 3: not jumping > 4: exists test > 4: header `List-Id' exists > 4: header `List-ID' exists > 4: header `Mailing-List' is missing > 4: headers are missing > 5: jump if result is true > 5: not jumping > 7: fileinto action > 7: store message in mailbox `root-mail' > 8: stop command; end all script execution > ## Finished executing script 'frop' > > Performed actions: > > * store message in folder: root-mail > > Implicit keep: > > (none) > > sieve-test(stephan): Info: final result: success > " > > So, the "exists" test returns false, because not all listed headers > exist, which conforms to the specification: > > RFC 5228: > " > 5.5. Test exists > > Usage: exists > > The "exists" test is true if the headers listed in the header-names > argument exist within the message. All of the headers must exist or > the test is false. > " > > Also, your use of "anyof" is useless. The following should work: > > " > require "fileinto"; > > if allof (address :contains :localpart "From" "root", > not anyof( > exists "List-Id", > exists "List-ID", > exists "Mailing-List", > exists "X-List-Name", > exists "List-Post")) > { > fileinto "root-mail"; > stop; > } > " > > Regards, > > Stephan. > > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From stephan at rename-it.nl Thu Apr 30 21:04:39 2015 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 30 Apr 2015 23:04:39 +0200 Subject: Failed running extprograms execute via socket - fatal recv(MSG_PEEK) failed disconnected In-Reply-To: <1430419859.1254.YahooMailBasic@web142406.mail.bf1.yahoo.com> References: <1430419859.1254.YahooMailBasic@web142406.mail.bf1.yahoo.com> Message-ID: <554298E7.6000909@rename-it.nl> On 4/30/2015 8:50 PM, E.B. wrote: >> I switched from running my extprograms execute script directly >> to running with dovecot socket. Log shows only this >> >> dovecot: lmtp(test at example.com): Debug: wdi0Tb5VPlGfPnEAM/SpMA: sieve: action execute: running program: test >> dovecot: lmtp(test at example.com): Debug: Namespace : Using permissions from /vmail/example.com/test: mode=0770 gid=default >> dovecot: script: Fatal: recv(MSG_PEEK) failed: disconnected >> >> For testing I opened up the script and socket with >> permissions 777 but the error seems to indicate >> less about permissions more about some kind of >> protocol problem i guessing. > No one can help? Is anybody using the Sieve extprograms > execute via Dovecot socket service? I think my config > is vanilla, no? All other Dovecot and Sieve things > (including quota service scripts configured very > similarly) work fine. > > Taking a look at the code, the error seems to indicate > that no input is available on the socket when Dovecot > checks. Does my script need to behave differently? > What exactly to do? > > Should I just go back to direct execute? What's the > difference anyway beside the user/permissions will > be different? > > Stephan? Anyone? Will look at this later this week. Regards, Stephan. From astarmathsandphysics at gmail.com Thu Apr 30 21:31:21 2015 From: astarmathsandphysics at gmail.com (Paul Smith) Date: Thu, 30 Apr 2015 22:31:21 +0100 Subject: timed out while receiving the initial server greeting Message-ID: Am using ubuntu 14.04 and get a lot of errors like this A84952061AC4 1457 Thu Apr 30 19:46:11 theeducationchannel at astarmathsandphysics.com (delivery temporarily suspended: conversation with astarmathsandphysics.com[private/lmtp] timed out while receiving the initial server greeting) postconf -n returns alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no config_directory = /etc/postfix html_directory = /usr/share/doc/postfix/html inet_interfaces = all inet_protocols = all mailbox_command = procmail -a "$EXTENSION" mailbox_size_limit = 51200000 mydestination = localhost myhostname = astarmathsandphysics.com mynetworks = 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128 myorigin = /etc/mailname readme_directory = /usr/share/doc/postfix recipient_delimiter = + relayhost = smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) smtpd_recipient_restrictions = permit_sasl_authenticated, permit_mynetworks, reject_unauth_destination smtpd_relay_restrictions = permit_mynetworks permit_sasl_authenticated defer_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/dovecot/dovecot.pem smtpd_tls_key_file = /etc/dovecot/private/dovecot.pem smtpd_use_tls = yes virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf virtual_mailbox_domains = mysql:/etc/postfix/ mysql-virtual-mailbox-domains.cf virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf virtual_transport = lmtp:unix:private/lmtp dovecot -n returns # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-32-generic x86_64 Ubuntu 14.04.2 LTS ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = lmtp imap pop3 service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } all the mail folders in /var/mail/vhosts/domains are empty ports 25 and 995 are open (but 465/587 are not) From miloslav.hula at gmail.com Thu Apr 30 21:31:26 2015 From: miloslav.hula at gmail.com (=?UTF-8?B?TWlsb3NsYXYgSMWvbGE=?=) Date: Thu, 30 Apr 2015 23:31:26 +0200 Subject: Postpone email delivery with LMTP and Postfix In-Reply-To: <20150430165101.GA7666@nihlus.leuxner.net> References: <5541435D.7020705@gmail.com> <20150430165101.GA7666@nihlus.leuxner.net> Message-ID: <55429F2E.5030404@gmail.com> Dne 30.4.2015 v 18:51 Thomas Leuxner napsal(a): > * Miloslav H?la 2015.04.29 22:47: > >> is there any way, based on userdb/passwdb attribute, how to postpone an >> email delivery? The purpose is, I need to freeze an account (Maildir++) for >> a few minutes and new email must not be delivered. But emails must be >> delivered when account is unfrozen. > > You can put the messages on hold and then release them again: > > http://wiki2.dovecot.org/Migration/Online Thomas, in combination with SQL, that's exactly what I'm looking for. Thank you! Best regards, Milo From emailbuilder88 at yahoo.com Thu Apr 30 22:01:08 2015 From: emailbuilder88 at yahoo.com (E.B.) Date: Thu, 30 Apr 2015 15:01:08 -0700 Subject: Failed running extprograms execute via socket - fatal recv(MSG_PEEK) failed disconnected In-Reply-To: <554298E7.6000909@rename-it.nl> Message-ID: <1430431268.35912.YahooMailBasic@web142404.mail.bf1.yahoo.com> > Will look at this later this week. Thank you. From beedee-gmane.mail.imap.dovecot at grmbl.net Tue Apr 14 23:16:38 2015 From: beedee-gmane.mail.imap.dovecot at grmbl.net (Bee) Date: Tue, 14 Apr 2015 23:16:38 -0000 Subject: concurrent IMAP connections (plus 2 easy questions) References: <54DF7809.2070909@Cleven.com> Message-ID: Ron, Ron Cleven Cleven.com> writes: > Now to my two "easy" questions. > > 1) TCP replication between our two CentOS boxes has been working great, > no complaints. However, I realized I did not know how to check the > status of replications, as one might want to do if one of the two boxes > was taken offline for maintenance or repair. On the surface, it would > appear that the command: > doveadm replicator status '*' > would likely show me what I want to know. However, when I tried it, I got: > doveadm(): Fatal: > net_connect_unix(/var/run/dovecot/replicator-doveadm) failed: No such > file or directory > The documentation says that doveadm assumes the socket > /var/run/dovecot/replicator-doveadm and the command format provides a > "-a" override. In that directory, there is no "replicator-doveadm" > socket, but I do see a "replicator" socket. So, should I be using the > command: > doveadm replicator status -a /var/run/dovecot/replicator '*' > or is the non-existence of the replicator-doveadm socket indicative of > something I might have done wrong with the config? I hate experimenting > more than I have to with a production box. The 2.2.10 Dovecot I am > running was installed via yum, so there are no potential compilation issues. I'm sttill working out some synching issues but if you haven't found it yet, this might solve your problem. Add the following to 10-replicator.conf: service replicator { unix_listener replicator-doveadm { mode = 0600 } } >From http://mcs.une.edu.au/doc/dovecot/wiki/Replication.txt Cheers, Bee From michael at skrilnetz.net Fri Apr 17 20:47:58 2015 From: michael at skrilnetz.net (Michael) Date: Fri, 17 Apr 2015 20:47:58 -0000 Subject: ManageSieve Dovecot v2 listen on localhost only In-Reply-To: <55316C4B.7020304@gedalya.net> References: <20150417202153.Horde.-DPHSkJklzyfMcyd8mwhpQ1@skrilnetz.net> <55316C4B.7020304@gedalya.net> Message-ID: <20150417204627.Horde.yTQn2DSgofr4SZBDMaqfZA9@skrilnetz.net> Thanks. I tried that now and added the "address": service managesieve-login { inet_listener sieve { port = 4190 address = 127.0.0.1 } I restarted dovecot but: tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN 0 522413 22288/dovecot Why is this not working? Quoting Gedalya : > address = 127.0.0.1 > port = 4190 > > > On 04/17/2015 04:21 PM, trash at skrilnetz.net wrote: >> >> Hi, >> >> How can I only listen on localhost for ManageSieve? >> >> I tried: >> >> port = localhost:4190 >> >> still listening *: >> tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN >> 0 515675 20540/dovecot >> >> Would did I not get here? >> >> Thanks, -- Regards, Michael https://skrilnetz.net -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-keys Size: 1718 bytes Desc: PGP Public Key URL: From kremels at mail.covisp.net Wed Apr 22 20:53:11 2015 From: kremels at mail.covisp.net (kremels) Date: Wed, 22 Apr 2015 13:53:11 -0700 Subject: Moving a local domain to sql In-Reply-To: References: <94612233-1617-40B9-BC27-09FC351202A1@kreme.com> Message-ID: On 2015-04-21 22:49, Steffen Kaiser wrote: > On Tue, 21 Apr 2015, @lbutlr wrote: >> I have a domain that current maps to local users that I want to move >> into the mysql maps with all the other domains, but I am unsure of the >> best way to proceed with this. > an userdb may overwrite anything, so you could configure your SQL > userdb to return exactly the same results you got for your local user. Ah, that's an idea, but I think in this case moving the domain into the sql DB is the way to go. > It also is a question, which username kremels is going to use to login the mysql users use user at domain.tld to login. The users for the domain will have to update their login information. > and how the LMTP/LDA (if you use it) work. If you use procmail, you > probably need to configure procmail as well. Procmail and dovecot have not gotten along very well for me, so I am not moving the accounts that need procmail. I can get it to work, but it is far more fragile than just regular procmail with local user LDA. > I moved my system users to LDAP with Dovecot v1, when moving to > Dovecot v2 I moved them to virtual users and one or three system > users. Noone noticed the change. These are not system users (that is, system users are @covisp.net) but they map to system users. for example, one of the accounts is info at example.com but maps to the local user user-example. Thanks for the reply, I think this is doable. From James.Bottomley at HansenPartnership.com Sat Apr 25 01:53:49 2015 From: James.Bottomley at HansenPartnership.com (James Bottomley) Date: Fri, 24 Apr 2015 18:53:49 -0700 Subject: dovecot crash with virtual folders (debian testing version 2.2.13-11) Message-ID: <1429926829.17868.6.camel@HansenPartnership.com> The virtual folder triggering the crash has the configuration namespace { prefix = virtual/ separator = / location = virtual:~/Maildir/virtual } And the actual virtual/openstack/dovecot-virtual file is Lists/openstack-dev inthread refs or from "james bottomley" keyword thread It's a standard search for threads I've either replied to or marked with an imap keyword 'thread' The imap command 0 status virtual/openstack (MESSAGES UNSEEN RECENT) Is crashing most of the time with gdb /usr/lib/dovecot/imap GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i586-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug//usr/lib/dovecot/imap...done. done. (gdb) r Starting program: /usr/lib/dovecot/imap process 7868 is executing new program: /usr/bin/doveconf process 7868 is executing new program: /usr/lib/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in as jejb 0 status virtual/openstack (MESSAGES UNSEEN RECENT) Program received signal SIGSEGV, Segmentation fault. 0xb7f0814b in mail_search_args_deinit_sub (args=args at entry=0x8005caf0, arg=0x8005cb08) at mail-search.c:169 169 mail-search.c: No such file or directory. (gdb) bt #0 0xb7f0814b in mail_search_args_deinit_sub (args=args at entry=0x8005caf0, arg=0x8005cb08) at mail-search.c:169 #1 0xb7f08aea in mail_search_args_deinit (args=0x8005caf0) at mail-search.c:193 #2 0xb7d9ecf1 in virtual_mailbox_close_internal (mbox=mbox at entry=0x800585d0) at virtual-storage.c:253 #3 0xb7d9ed7b in virtual_mailbox_close (box=0x800585d0) at virtual-storage.c:307 #4 0xb7f403ff in mail_thread_mailbox_close (box=0x800585d0) at index-thread.c:628 #5 0xb7f0d3fe in mailbox_close (box=0x800585d0) at mail-storage.c:1182 #6 0xb7f0d472 in mailbox_free (_box=0xbffff878) at mail-storage.c:1197 #7 0x8001e0ae in imap_status_get (cmd=0x80053948, ns=0x80052220, mailbox=0x8003a250 "virtual/openstack", items=0xbffff8f8, result_r=0xbffff900) at imap-status.c:96 #8 0x80011f64 in cmd_status (cmd=0x80053948) at cmd-status.c:40 #9 0x80016847 in command_exec (cmd=0x80053948) at imap-commands.c:158 #10 0x800155cb in client_command_input (cmd=0x80053948) at imap-client.c:778 #11 0x80015719 in client_command_input (cmd=0x80053948) at imap-client.c:839 #12 0x800159cd in client_handle_next_command (remove_io_r=, client=0x80052ee0) at imap-client.c:877 #13 client_handle_input (client=0x80052ee0) at imap-client.c:889 #14 0x80015dd5 in client_input (client=0x80052ee0) at imap-client.c:931 ---Type to continue, or q to quit--- #15 0xb7e202e3 in io_loop_call_io (io=0x800538c8) at ioloop.c:441 #16 0xb7e214be in io_loop_handler_run_internal (ioloop=0x80042458) at ioloop-epoll.c:220 #17 0xb7e2036a in io_loop_handler_run (ioloop=0x80042458) at ioloop.c:488 #18 0xb7e203f9 in io_loop_run (ioloop=0x80042458) at ioloop.c:465 #19 0xb7dc6985 in master_service_run (service=0x80042380, callback=0x800200b0 ) at master-service.c:566 #20 0x80008b44 in main (argc=1, argv=0xbffffd84) at main.c:400 I thought it might be this patch http://hg.dovecot.org/dovecot-2.2/rev/5c6f49e2d8d9 But after applying I still get the same segfault. James