From jreich at jreich.com Mon Dec 2 04:13:33 2013 From: jreich at jreich.com (Julian Reich) Date: Mon, 2 Dec 2013 03:13:33 +0100 Subject: [Dovecot] doveadm table formatter: hidden titles may cause misaligned headers Message-ID: Hello, I recently noticed a small bug in the doveadm table formatter: hidden titles may cause the headers to be misaligned. The behavior in question was introduced by commit and doveadm -f table quota get -A may be used to reproduce it. Most simple patch attached: it simply restores the old behavior, to some extent. Actually hiding those titles may be desired. Regards, Julian Reich -------------- next part -------------- A non-text attachment was scrubbed... Name: doveadm-table-formatter.patch Type: application/octet-stream Size: 374 bytes Desc: not available URL: From aoster at novanetwork.de Mon Dec 2 13:00:17 2013 From: aoster at novanetwork.de (Andreas Oster) Date: Mon, 02 Dec 2013 12:00:17 +0100 Subject: [Dovecot] FTS solr issue with second private namespace Message-ID: Hi all, I have just stumbled over an issue with the FTS plugin of dovecot. For our primary namespace, INBOX and its subfolders, searching works without any problems but in a second namespace, which I have created for old/archived mails, searching of the mail text/body does not work. I can see the search request in the tomcat log but no result is created and the mail client (Thunderbird) keeps displaying the serach message without returning any results. Tomcat6 catalina.out: Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/select params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} hits=0 status=0 QTime=1 I am currently using Dovecot 2.2.9 and do not have any special FTS config: mail_plugins = quota mailbox_alias fts fts_solr plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8080/solr/ fts_autoindex = yes } Thank you for your kind help best regards Andreas From nissim at cs.technion.ac.il Mon Dec 2 14:04:00 2013 From: nissim at cs.technion.ac.il (Nissim Etrog) Date: Mon, 2 Dec 2013 14:04:00 +0200 Subject: [Dovecot] "[CANNOT] Mailbox GUIDs are not permanent without index files" when trying to delete folder Message-ID: <231A423F07BA47FCB62CD22C6DC78F4F@CS.Technion.ac.il> Hello, Dovecot 2.0.9 on Red Hat Enterprise Linux Server release 6.4 (Santiago) location is set to : mail_location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY Index is set to memory due to permissions problems when using disk index. Everything works, even rename folder, but when trying to delete folder, using any mail client, it fails with: "[CANNOT] Mailbox GUIDs are not permanent without index files". Why ? Regards,Nissim Etrog From alexpro at homelan.lg.ua Mon Dec 2 15:41:42 2013 From: alexpro at homelan.lg.ua (=?UTF-8?B?0JDQu9C10LrRgdC10Lkg0J/RgNC+0LrQvtC/0YfRg9C6?=) Date: Mon, 02 Dec 2013 15:41:42 +0200 Subject: [Dovecot] imap-login hangs after receiving revoked SSL certificate Message-ID: <529C8E16.3070108@homelan.lg.ua> Good time of the day! My English is not very good, excuse me if I said something wrong. I use dovecot-2.1.16 on Gentoo Linux amd64. I need to setup dovecot (imap and pop3) for SSL and non-SSL connection simultaneously. For SSL connections client must submit a valid SSL certificate. Now SSL part of dovecot.conf looks like this: ----------------- ssl = yes ssl_cert = References: <528E42B2.9090609@localhost.localdomain.org> Message-ID: <8562867.mnMhhWhuq7@horus> Am Donnerstag, 21. November 2013, 17:28:18 schrieb Pascal Volk: > On 11/21/2013 11:11 AM Florian Lindner wrote: > > Hello, > > > > some spam training tools learn the same message over and over again. > > Since I want to use a daily cronjob to train messages and I do not want > > to have the same messages trained multiple times, I need to way to get > > new messages in a folder. > > > > Is there a (consolish) way to get a list of messages that were recently > > moved to a folder? dovecot does not modify mtime, according to RFC 3501. > > Does `doveadm search -u spam at xgm.de mailbox INBOX SAVEDSINCE 2013-11-21` > list the wanted messages? For more details see doveadm-search(1) and > doveadm-search-query(7). Not really: % doveadm search -u mailinglists at xgm.de mailbox INBOX SAVEDSINCE 2013-11-21 doveadm(mailinglists at xgm.de): Error: user mailinglists at xgm.de: Initialization failed: Namespace '': Mail storage autodetection failed with home=/home/flindner/Mail/mailinglists at xgm.de doveadm(mailinglists at xgm.de): Fatal: User init failed Which seems to be another problem. IMAP and POP3 work fine, but on occasions like that dovecot fails to detect that it is a maildir. Problem may be that in my database home and mail location is identical (and there is no way to change that). Is there a way to tell dovecot that every mailbox is a maildir without modifying the database? Thanks, Florian From CMarcus at Media-Brokers.com Mon Dec 2 16:29:54 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 02 Dec 2013 09:29:54 -0500 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: <8562867.mnMhhWhuq7@horus> References: <528E42B2.9090609@localhost.localdomain.org> <8562867.mnMhhWhuq7@horus> Message-ID: <529C9962.2060401@Media-Brokers.com> On 2013-12-02 9:24 AM, Florian Lindner wrote: > Problem may be that in my database home and mail location is identical (and > there is no way to change that). Is there a way to tell dovecot that every > mailbox is a maildir without modifying the database? There are very good reasons why this is broken... And I highly doubt that it *can't* be changed... you just don't want to go through the pain, right? Personally, I think you should rethink this decision, but if you still 'can't, then learn to live with the pain. -- Best regards, */Charles/* From hmoreno at gmv.com Mon Dec 2 16:46:39 2013 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Mon, 2 Dec 2013 14:46:39 +0000 Subject: [Dovecot] shared folder - ACL In-Reply-To: <5298B1F3.4010602@Media-Brokers.com> References: <5298B1F3.4010602@Media-Brokers.com> Message-ID: > On 2013-11-28 10:38 AM, H?ctor Moreno Blanco wrote: >> When I try to set acl to a folder: >> >> a02 setacl inbox.test1 user1 lr >> a02 BAD Error in IMAP command SETACL: ACLs disabled. >> >> >> In the logs, I can see: >> >> dovecot: imap(testing_ddfr): Debug: acl: No acl setting - ACLs are >> disabled >> >> >> What am I missing? > > This says it is not activated, in spite of what you copy/pasted from some config file. > > Never rely on copy/paste from configs... *always* check doveconf -n output. This will *prove* what your active config is - and sometimes it isn't what you think it is (especially with some distros that put things in non-standard places... > > doveconf -n output is now necessary... > > -- > > Best regards, > > */Charles > /* Hello Charles, This is my doveconf -n output. # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf auth_cache_size = 500 k auth_cache_ttl = 1000 secs disable_plaintext_auth = no first_valid_uid = 501 lock_method = dotlock mail_debug = yes mail_fsync = always mail_gid = vmail mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota autocreate mail_log notify acl mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mmap_disable = yes namespace { inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace { location = maildir:%h/Maildir/_backup prefix = _backup. separator = . type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared.%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl_anyone = allow acl_shared_dict = file:/etc/dovecot/shared-mailboxes.db autocreate = Spam autosubscribe = Spam mail_log_events = delete expunge copy mailbox_delete mailbox_rename quota = maildir:_backup:ns= quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u sieve = %h/.dovecot.sieve sieve_dir = %h/sieve sieve_extensions = +imapflags +notify } protocols = imap pop3 sieve service anvil { client_limit = 5000 } service auth { client_limit = 9000 unix_listener auth-master { group = vmail mode = 0700 user = vmail } user = root vsz_limit = 1 G } service imap-login { executable = /usr/local/dovecot/libexec/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_limit = 2048 process_min_avail = 20 service_count = 0 user = vmail } service imap { executable = /usr/local/dovecot/libexec/dovecot/imap process_limit = 2048 } service managesieve-login { executable = /usr/local/dovecot/libexec/dovecot/managesieve-login inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 12000 } user = vmail } service managesieve { executable = /usr/local/dovecot/libexec/dovecot/managesieve } service pop3-login { executable = /usr/local/dovecot/libexec/dovecot/pop3-login inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 } process_limit = 2048 process_min_avail = 20 service_count = 0 user = vmail } service pop3 { executable = /usr/local/dovecot/libexec/dovecot/pop3 process_limit = 2048 } service quota-warning { executable = script /usr/local/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0700 user = vmail } } ssl_ca = fue rechazado automaticamente por nuestro sistema :%n%r rejection_subject = Rechazado: %s sendmail_path = /usr/sbin/exim } protocol sieve { managesieve_implementation_string = dovecot Pigeonhole managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } Maybe the shared namespace is badly configured? Thank you very much in advanced. Kind regards. H?ctor Moreno Blanco. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From shantanu at techblue.co.uk Mon Dec 2 17:56:37 2013 From: shantanu at techblue.co.uk (Kumar Shantanu) Date: Mon, 02 Dec 2013 21:26:37 +0530 Subject: [Dovecot] Dove LDA vs Exim LDA Message-ID: <529CADB5.2000004@techblue.co.uk> Hello All, I have built up my email server with exim + dovecot + clamv/spamassasin. I am using exim as LDA(local delivery agent). I was reading about using dovecot as LDA but I couldn't find why should I use it? Now, I am looking expert advice on "Why should I use dovecot LDA" ? Is there any benefit in terms of functionality or performance ? Any advice/suggestion/feedbacks welcome. Thanks Shantanu From CMarcus at Media-Brokers.com Mon Dec 2 18:17:11 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 02 Dec 2013 11:17:11 -0500 Subject: [Dovecot] Dove LDA vs Exim LDA In-Reply-To: <529CADB5.2000004@techblue.co.uk> References: <529CADB5.2000004@techblue.co.uk> Message-ID: <529CB287.4070304@Media-Brokers.com> On 2013-12-02 10:56 AM, Kumar Shantanu wrote: > Now, I am looking expert advice on "Why should I use dovecot LDA" ? Is > there any benefit in terms of functionality or performance ? > > Any advice/suggestion/feedbacks welcome. Did you bother to read the wiki? http://wiki2.dovecot.org/LDA/ It spells out the benefits pretty well... -- Best regards, */Charles/* From rs at sys4.de Mon Dec 2 18:18:35 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 02 Dec 2013 17:18:35 +0100 Subject: [Dovecot] Dove LDA vs Exim LDA In-Reply-To: <529CADB5.2000004@techblue.co.uk> References: <529CADB5.2000004@techblue.co.uk> Message-ID: <529CB2DB.9050807@sys4.de> Am 02.12.2013 16:56, schrieb Kumar Shantanu: > Hello All, > > I have built up my email server with exim + dovecot + clamv/spamassasin. > I am using exim as LDA(local delivery agent). I was reading about using > dovecot as LDA but I couldn't find why should I use it? > > Now, I am looking expert advice on "Why should I use dovecot LDA" ? Is > there any benefit in terms of functionality or performance ? > > Any advice/suggestion/feedbacks welcome. > > > Thanks > Shantanu i guess the difference is not dove vs exim lda ( dont know this ), its more about using dove lmtp vs lda ,lmtp should perform better then any lda, search the list archive about it Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Mon Dec 2 18:19:37 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 2 Dec 2013 18:19:37 +0200 Subject: [Dovecot] imap-login hangs after receiving revoked SSL certificate In-Reply-To: <529C8E16.3070108@homelan.lg.ua> References: <529C8E16.3070108@homelan.lg.ua> Message-ID: On 2.12.2013, at 15.41, ??????? ????????? wrote: > I use dovecot-2.1.16 on Gentoo Linux amd64. > > All works fine with valid certificates. But if I submit revoked > certificate, dovecot doesn't send error or success messages to mail > client, process 'imap-login' eats 100% CPU and completely hangs. Only > SIGKILL can terminate it. When dovecot receives revoked certificate, > following messages appears in the log: > > ------------------ > Dec 2 13:50:26 mail dovecot: imap-login: Invalid certificate: > certificate revoked: /O=AP inc./OU=Admins/CN=Alexey Prokopchuk/UID=alexpro > Dec 2 13:50:26 mail dovecot: imap-login: Invalid certificate: Different > CRL scope: /CN=AP inc. root certification authority/O=AP inc./C=UA > Dec 2 13:50:39 mail last message repeated 17950 times > ------------------- What OpenSSL version are you using? This looks like the same issue: http://rt.openssl.org/Ticket/Display.html?id=3090&user=guest&pass=guest Where the fix is in: http://git.openssl.org/gitweb/?p=openssl.git;a=commitdiff;h=4b26645c1a71cf9ce489e4f79fc836760b670ffe Not sure if Dovecot should be doing something different here, or maybe working around that bug. I think Postfix has the same problem. From mailinglists at xgm.de Mon Dec 2 19:24:26 2013 From: mailinglists at xgm.de (Florian Lindner) Date: Mon, 02 Dec 2013 18:24:26 +0100 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: <529C9962.2060401@Media-Brokers.com> References: <8562867.mnMhhWhuq7@horus> <529C9962.2060401@Media-Brokers.com> Message-ID: <1697137.Nku2MoAo3s@horus> Am Montag, 2. Dezember 2013, 09:29:54 schrieb Charles Marcus: > On 2013-12-02 9:24 AM, Florian Lindner wrote: > > Problem may be that in my database home and mail location is identical > > (and > > there is no way to change that). Is there a way to tell dovecot that every > > mailbox is a maildir without modifying the database? > > There are very good reasons why this is broken... > > And I highly doubt that it *can't* be changed... you just don't want to > go through the pain, right? > > Personally, I think you should rethink this decision, but if you still > 'can't, then learn to live with the pain. Actually I don't really understand why that is so strictly enforced as a number of dovecot tools (deliver, doveadm) refuse to work while imap is working perfectly without any additional settings or workarounds. My maildir show a number of folders like .*, the usual cur, new, tmp and the dovecot* files. I don't see any possible name clash there, even without stat'ing the entries to test if it's a directory. I just need to disable the mail storage autodetection and set it always maildir. Prefixing the database entry for the mail field with maildir: changes nothing. I've read the warnings about having mail == home but honestly I don't understand. Sorry if I miss the point here, but I'm eager to learn. Kind Regards, Florian From CMarcus at Media-Brokers.com Mon Dec 2 19:44:51 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 02 Dec 2013 12:44:51 -0500 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: <1697137.Nku2MoAo3s@horus> References: <8562867.mnMhhWhuq7@horus> <529C9962.2060401@Media-Brokers.com> <1697137.Nku2MoAo3s@horus> Message-ID: <529CC713.80802@Media-Brokers.com> On 2013-12-02 12:24 PM, Florian Lindner wrote: > I've read the warnings about having mail == home but honestly I don't > understand. Sorry if I miss the point here, but I'm eager to learn. Sorry, I don't understand the gory details of the 'why' myself beyond the obvious - when you tell dovecot where the mail_location is, it expects there to *only* *be* *mail* there. Expecting dovecot to handle every possible circumstance of other possible files that someone might decide to dump in there is unreasonable. Not to mention the possibility of some other software messing with dovecots files. It simply is a really, really bad idea to use a directory that the user has direct access to for their mail location. You don't put postfix's spool directory in home do you? -- Best regards, */Charles/* From claus.r at bayern-mail.de Mon Dec 2 19:47:33 2013 From: claus.r at bayern-mail.de (Claus) Date: Mon, 02 Dec 2013 18:47:33 +0100 Subject: [Dovecot] backup mdbox best strategy Message-ID: <529CC7B5.8050103@bayern-mail.de> Hello, i have to backup (tape library) a mailsystem with about 300.000 Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. The mailstore is mdbox. Is it save to do a simple filesystem backup (full and incremental) with backupsoftware? What is the prefered strategy to do a backup for desaster recovery (mailsystem crash) and restoring single usermailboxes? Regards, Claus From paul at aptanet.com Mon Dec 2 19:48:42 2013 From: paul at aptanet.com (Paul Tansom) Date: Mon, 2 Dec 2013 17:48:42 +0000 Subject: [Dovecot] Dove LDA vs Exim LDA In-Reply-To: <529CADB5.2000004@techblue.co.uk> References: <529CADB5.2000004@techblue.co.uk> Message-ID: <20131202174825.GA3534@aptanet.com> ** Kumar Shantanu [2013-12-02 15:58]: > I have built up my email server with exim + dovecot + > clamv/spamassasin. I am using exim as LDA(local delivery agent). I > was reading about using dovecot as LDA but I couldn't find why > should I use it? > > Now, I am looking expert advice on "Why should I use dovecot LDA" ? > Is there any benefit in terms of functionality or performance ? > > Any advice/suggestion/feedbacks welcome. ** end quote [Kumar Shantanu] The main reason I switched was so that I could move from procmail to seive, which is much nicer to configure. As an aside it also fixed an annoyance I had where, with my virtual domain/user setup, a directory was created for each email address that had mail sent to it (which resulted in a collection of directories for random junk spam addresses). At the time I hadn't investigated a fix, and the upgrade to Dovecot 2, with Dovecot as the LDA managing the virtual users fixed this as a side issue :) -- Paul Tansom | Aptanet Ltd. | http://www.aptanet.com/ | 023 9238 0001 ============================================================================= Registered in England | Company No: 4905028 | Registered Office: Ralls House, Parklands Business Park, Forrest Road, Denmead, Waterlooville, Hants, PO7 6XP From bill-dovecot at carpenter.org Mon Dec 2 20:02:05 2013 From: bill-dovecot at carpenter.org (WJCarpenter) Date: Mon, 02 Dec 2013 10:02:05 -0800 Subject: [Dovecot] Dove LDA vs Exim LDA In-Reply-To: <20131202174825.GA3534@aptanet.com> References: <529CADB5.2000004@techblue.co.uk> <20131202174825.GA3534@aptanet.com> Message-ID: <529CCB1D.4030709@carpenter.org> > The main reason I switched was so that I could move from procmail to > seive, I am curious if you investigated Exim's sieve script support. Was there some problem you saw with it, or you just didn't look into it? From me at junc.eu Mon Dec 2 20:17:37 2013 From: me at junc.eu (Benny Pedersen) Date: Mon, 02 Dec 2013 19:17:37 +0100 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: <529CC713.80802@Media-Brokers.com> References: "" <8562867.mnMhhWhuq7@horus> <529C9962.2060401@Media-Brokers.com> <1697137.Nku2MoAo3s@horus> <529CC713.80802@Media-Brokers.com> Message-ID: <99812c00cc37e0abee567bb21ae66990@junc.eu> Charles Marcus skrev den 2013-12-02 18:44: > You don't put postfix's spool directory in home do you? that was unfait i think OP confuse ~ dovecot with HOME env variable, not neaseserly in /home/vmail just remember if useradd vmail make it not share groups with login users should keep it safe to use /home path From tss at iki.fi Mon Dec 2 20:26:13 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 2 Dec 2013 20:26:13 +0200 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: <8562867.mnMhhWhuq7@horus> References: <528E42B2.9090609@localhost.localdomain.org> <8562867.mnMhhWhuq7@horus> Message-ID: On 2.12.2013, at 16.24, Florian Lindner wrote: > doveadm(mailinglists at xgm.de): Error: user mailinglists at xgm.de: Initialization > failed: Namespace '': Mail storage autodetection failed with > home=/home/flindner/Mail/mailinglists at xgm.de > doveadm(mailinglists at xgm.de): Fatal: User init failed > > Which seems to be another problem. IMAP and POP3 work fine, but on occasions > like that dovecot fails to detect that it is a maildir. If something works fine for imap and pop3, but not for doveadm (for the same user), then the difference is that imap/pop3 sees different settings (e.g. in protocol imap {}). From michael.abbott at apple.com Mon Dec 2 20:50:57 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 02 Dec 2013 12:50:57 -0600 Subject: [Dovecot] Full text search improvements In-Reply-To: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> Message-ID: <9E911E87-660C-4482-A591-EF297B8FB452@apple.com> > how [FTS indexing] could be improved for everyone in future For sites which set client_limit > 1 it would help performance not to stall for INDEXER_WAIT_MSECS when polling the indexer for input. Currently dovecot unwinds back out to the main command loop repeatedly to allow other clients to use the process but it also stalls the whole process for INDEXER_WAIT_MSECS every time it finds no input from the indexer, which hurts responsiveness for those other clients. This can be avoided by removing the client's I/O from the main ioloop and adding the indexer's instead, or perhaps by leveraging CLIENT_COMMAND_STATE_WAIT_EXTERNAL. Third-party FTS implementations may benefit from having the NOT/AND/OR seq_range_array merging logic in squat_lookup_arg() generalized and made available to all. It would also be helpful if FTS expunge were asynchronous, but this is not critical. From rs at sys4.de Mon Dec 2 21:37:40 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 02 Dec 2013 20:37:40 +0100 Subject: [Dovecot] backup mdbox best strategy In-Reply-To: <529CC7B5.8050103@bayern-mail.de> References: <529CC7B5.8050103@bayern-mail.de> Message-ID: <529CE184.4060102@sys4.de> Am 02.12.2013 18:47, schrieb Claus: > Hello, > > i have to backup (tape library) a mailsystem with about 300.000 > Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. > The mailstore is mdbox. > Is it save to do a simple filesystem backup (full and incremental) with > backupsoftware? hm i wouldnt do that with mdbox, cause it does strongly depends to index, but if you use dsync you could convert to maildir at backup, maildir should be fine to store on tape, but with 2 TB this is only good for total desaster archive, i guess it would take long time to restore specially single mailboxes in acceptable time, from tape Better use cheap sata storage raids for frequent backups, and do tape snapshots sometimes. > What is the prefered strategy to do a backup for desaster recovery > (mailsystem crash) and restoring single usermailboxes? dsync should do fine http://wiki2.dovecot.org/Tools/Dsync but there is no universal answer to this, perhaps filesystem snapshots strategy might better, it depened on your general setup , filesystems , mailstore etc. wait for others report their solutions, and find the one fits best at your place > > > Regards, > Claus Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Mon Dec 2 21:41:43 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 2 Dec 2013 21:41:43 +0200 Subject: [Dovecot] Full text search improvements In-Reply-To: <9E911E87-660C-4482-A591-EF297B8FB452@apple.com> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> <9E911E87-660C-4482-A591-EF297B8FB452@apple.com> Message-ID: <6A2DDDD1-5041-425A-B82B-DA4E1FD436FA@iki.fi> On 2.12.2013, at 20.50, Mike Abbott wrote: >> how [FTS indexing] could be improved for everyone in future > > For sites which set client_limit > 1 it would help performance not to stall for INDEXER_WAIT_MSECS when polling the indexer for input. Currently dovecot unwinds back out to the main command loop repeatedly to allow other clients to use the process but it also stalls the whole process for INDEXER_WAIT_MSECS every time it finds no input from the indexer, which hurts responsiveness for those other clients. This can be avoided by removing the client's I/O from the main ioloop and adding the indexer's instead, or perhaps by leveraging CLIENT_COMMAND_STATE_WAIT_EXTERNAL. Gets a bit tricky to implement, at least without changing the lib-storage API. I did have some plans for this earlier where lib-storage could call some callback when there is more data available for search/fetch/mailbox_open/etc functions. Currently I?m thinking that most of the reasons for client_limit>1 can be avoided just by moving IMAP IDLE connections to a separate imap-idle process where they wait until they have more work to do. Do you think that would work for you also? From gedalya at gedalya.net Mon Dec 2 21:54:43 2013 From: gedalya at gedalya.net (Gedalya) Date: Mon, 02 Dec 2013 14:54:43 -0500 Subject: [Dovecot] Full text search improvements In-Reply-To: <6A2DDDD1-5041-425A-B82B-DA4E1FD436FA@iki.fi> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> <9E911E87-660C-4482-A591-EF297B8FB452@apple.com> <6A2DDDD1-5041-425A-B82B-DA4E1FD436FA@iki.fi> Message-ID: <529CE583.7010002@gedalya.net> On 12/02/2013 02:41 PM, Timo Sirainen wrote: > Currently I?m thinking that most of the reasons for client_limit>1 can be avoided just by moving IMAP IDLE connections to a separate imap-idle process where they wait until they have more work to do. Do you think that would work for you also? I was exactly thinking about the same thing.. I wanted to request this feature but I guess I was too shy to write about it :D I think a special IDLE process would be a wonderful idea. I find that otherwise client_limit>1 doesn't really work. It gets especially annoying when a client with a large mailbox makes a process grow and it doesn't shrink back, is there some insight about that? And, after service_count is maxed out, you end up having lots of processes waiting for the last 1 or 2 IDLEing clients to quit, so your total number of processes is really much larger than total connections / client_limit. From paul at aptanet.com Mon Dec 2 22:02:57 2013 From: paul at aptanet.com (Paul Tansom) Date: Mon, 2 Dec 2013 20:02:57 +0000 Subject: [Dovecot] Dove LDA vs Exim LDA In-Reply-To: <529CCB1D.4030709@carpenter.org> References: <529CADB5.2000004@techblue.co.uk> <20131202174825.GA3534@aptanet.com> <529CCB1D.4030709@carpenter.org> Message-ID: <20131202200241.GB6861@aptanet.com> ** WJCarpenter [2013-12-02 18:04]: > >The main reason I switched was so that I could move from procmail > >to seive, > > I am curious if you investigated Exim's sieve script support. Was > there some problem you saw with it, or you just didn't look into it? ** end quote [WJCarpenter] Good question, and it is a while ago so I can't completely remember. I think it may well have come down to documentation, there seems to be more easy to use stuff out there for the Dovecot implementation (even with Exim). There's tons of in detail stuff on Exim (I know I host a mirror), but it can be a little too in depth sometimes! -- Paul Tansom | Aptanet Ltd. | http://www.aptanet.com/ | 023 9238 0001 ============================================================================= Registered in England | Company No: 4905028 | Registered Office: Ralls House, Parklands Business Park, Forrest Road, Denmead, Waterlooville, Hants, PO7 6XP From martin.rabl at rablnet.de Mon Dec 2 22:25:34 2013 From: martin.rabl at rablnet.de (Martin Rabl) Date: Mon, 02 Dec 2013 21:25:34 +0100 Subject: [Dovecot] dovecot.index-Errors with multiple IMAP client access in Dovecot 2.2 Message-ID: <529CECBE.7070006@rablnet.de> Hello list, I hope you can help me! My self-compiled dovecot 2.2.6 (and the two minor versions before, too) throws that errors: Nov 28 18:29:00 mailserv dovecot: imap(martin at example.com): Error: Transaction log /srv/vmail/example.com/martin/Maildir/dovecot.index.log: duplicate transaction log sequence (25) Nov 28 18:29:00 mailserv dovecot: imap(martin at example.com): Error: /srv/vmail/example.com/martin/Maildir/dovecot.index log position went backwards (24,40 < 25,10028) ... and so on ... duplicate transaction log sequences and backwards gone log positions, and this always, when I use at least two IMAP clients at the same time (better: the two clients are online and logged in at the same time). That happens only with one user (me ;-) ), the other about 15 users on this server are having no problems. What I see: the clients are bothering each other, but I don't know, why. I thought about the used reiserfs filesystem on the server, but there were no problems with 1.2 on the same server. Some words about my client setup: I use Thunderbird and iPhone at the same time, and as a third client on the same Server there is a Thunderbird instance at my company, which runs parallel to the other two. Seems to be weired, but isn't really (IMHO ;-) ). Sometimes there are two TBs at the same mailbox, sometimes only the iPhone and a TB, sometimes all three. This runs quite good for long time with dovecot 1.2 and 2.1.x (the last one at my company in a similary setup with more users and several clients at the same time). Maybe there is an error by using "my" build configurations (I think, not)? ---- configures ------------------- ./configure \ --prefix=/usr/local \ --with-sql \ --with-ssl \ --with-mysql ----------------------------------- Here are my dovecot.conf (only the changes of defaults) - maybe there is a misconfiguration? ---- dovecot.conf ----------------- # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-028stab101.1 x86_64 Ubuntu 10.04.4 LTS reiserfs auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-master default_internal_user = vmail default_login_user = vmail dict { acl = mysql:/etc/dovecot/dovecot-dict-acl-sql.conf.ext } disable_plaintext_auth = no imap_capability = +NAMESPACE imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags tb-extra-mailbox-sep listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_access_groups = vmail mail_location = maildir:/srv/vmail/%d/%n/Maildir mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify namespace { list = yes location = maildir:%%Lh/Maildir/:INDEX=%%Lh/shared-idx/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no list = yes location = maildir:/srv/vmail/public prefix = public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_after = /srv/vmail/sieve/after.sieve sieve_before = /srv/vmail/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/sieve sieve_global_path = /srv/vmail/sieve/globalsieverc } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster@%d protocols = imap pop3 quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service imap { process_limit = 2048 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> <9E911E87-660C-4482-A591-EF297B8FB452@apple.com> <6A2DDDD1-5041-425A-B82B-DA4E1FD436FA@iki.fi> Message-ID: <0392A01D-17AB-4E9A-9260-68A84EE2C40E@apple.com> > Do you think [moving IMAP IDLE connections to a separate imap-idle process] would work for you also? Probably. It always depends on the details. Forking a new imap process every time there's a little input to read or output to send might perform poorly under load. Having a pool of ready imap processes could help that, when the configuration permits (e.g. all mail owned by one uid). It would be interesting to compare client_limit > 1 vs. an idle connection aggregator. What's so evil about client_limit > 1 besides requiring one uid, the indexer polling I mentioned, and broken fcntl-style file locks? Or is that enough? From tss at iki.fi Tue Dec 3 00:22:10 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 00:22:10 +0200 Subject: [Dovecot] Full text search improvements In-Reply-To: <0392A01D-17AB-4E9A-9260-68A84EE2C40E@apple.com> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> <9E911E87-660C-4482-A591-EF297B8FB452@apple.com> <6A2DDDD1-5041-425A-B82B-DA4E1FD436FA@iki.fi> <0392A01D-17AB-4E9A-9260-68A84EE2C40E@apple.com> Message-ID: <4490F0CF-261B-4DE7-91F2-C0F4E07C9174@iki.fi> On 3.12.2013, at 0.09, Mike Abbott wrote: >> Do you think [moving IMAP IDLE connections to a separate imap-idle process] would work for you also? > > Probably. It always depends on the details. Forking a new imap process every time there's a little input to read or output to send might perform poorly under load. Having a pool of ready imap processes could help that, when the configuration permits (e.g. all mail owned by one uid). It would be interesting to compare client_limit > 1 vs. an idle connection aggregator. I was thinking that you?d have a pool of imap processes waiting and being reused. Some state would be transferred between the imap-idle and imap processes. And it could work also for non-IDLEing idling connections. Then there needs to be some kind of a good balance of figuring out when to move connection to imap-idle to maximize the amount of time it?s there but also to minimize unnecessary CPU-wasting transfers.. Oh, and this would be possible also with multiple UIDs (although imap-idle might have to run as root then). > What's so evil about client_limit > 1 besides requiring one uid, the indexer polling I mentioned, and broken fcntl-style file locks? Or is that enough? Mainly that there are so many possible reasons for why imap process might block. It?s not possible to make all of them asynchronous. I guess getting rid of the longest waits could help, but I still wouldn?t dare to run that in production. From alexpro at homelan.lg.ua Tue Dec 3 00:41:26 2013 From: alexpro at homelan.lg.ua (=?UTF-8?B?0JDQu9C10LrRgdC10Lkg0J/RgNC+0LrQvtC/0YfRg9C6?=) Date: Tue, 03 Dec 2013 00:41:26 +0200 Subject: [Dovecot] imap-login hangs after receiving revoked SSL certificate In-Reply-To: References: <529C8E16.3070108@homelan.lg.ua> Message-ID: <529D0C96.80302@homelan.lg.ua> Hello again. 02.12.2013 18:19, Timo Sirainen ?????: > What OpenSSL version are you using? > > This looks like the same issue: > > http://rt.openssl.org/Ticket/Display.html?id=3090&user=guest&pass=guest > > Where the fix is in: > > http://git.openssl.org/gitweb/?p=openssl.git;a=commitdiff;h=4b26645c1a71cf9ce489e4f79fc836760b670ffe > > Not sure if Dovecot should be doing something different here, or maybe working around that bug. I think Postfix has the same problem. I used openssl version 1.0.1c when wrote first message. Following your advice, I tried to apply patch from fix above on openssl-1.0.1e Now no hangs but dovecot assumes any user certificate as invalid. And very interesting. First dovecot reports that certificate is invalid, and immediately thereafter reports that same certificate is valid. And finally reports "client sent an invalid cert". I have own test CA based on EJBCA. Server and all client certificates which I tried to test were issued by this CA. Freshest CRL is embedded into ca.pem file which used as ca certificate in dovecot.conf. Here is the log: ------------------------------------------------------ Dec 3 00:10:25 mail dovecot: imap-login: Invalid certificate: Different CRL scope: /CN=AP inc. root certification authority/O=AP inc./C=UA Dec 3 00:10:25 mail dovecot: imap-login: Invalid certificate: unable to get certificate CRL: /CN=AP inc. root certification authority/O=AP inc./C=UA Dec 3 00:10:25 mail dovecot: imap-login: Valid certificate: /CN=AP inc. root certification authority/O=AP inc./C=UA Dec 3 00:10:25 mail dovecot: imap-login: Valid certificate: /O=AP inc./OU=Admins/CN=Alexey Prokopchuk/UID=alexpro Dec 3 00:10:25 mail dovecot: imap-login: Disconnected (client sent an invalid cert): user=<>, method=PLAIN, rip=192.168.200.55, lip=192.168.200.1, TLS, session= ------------------------------------------------------ Now I'm quite confused: apache works with these certificates as expected: accepts valid and refuses revoked. But with dovecot which yesterday accepts at least one certificate (which I revoked for testing) today rejects all others from same CA. Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE) From s.potapov at rambler-co.ru Tue Dec 3 11:18:05 2013 From: s.potapov at rambler-co.ru (Potapov Sergey) Date: Tue, 3 Dec 2013 09:18:05 +0000 Subject: [Dovecot] Error in imap_address_arg_append Message-ID: <409CEB1649811749B2E36961BEE2DDBC293603F7@MBX2.rambler.ramblermedia.com> Hi Function imap_envelope_parse return incorrect result for addresses with groups due to error in imap_address_arg_append because of with ", " is added after group name and before first mailbox. Patch for dovecot v2.1 in attach. -------------- next part -------------- A non-text attachment was scrubbed... Name: imap-envelope.patch Type: application/octet-stream Size: 1455 bytes Desc: imap-envelope.patch URL: From mailinglists at xgm.de Tue Dec 3 12:40:35 2013 From: mailinglists at xgm.de (Florian Lindner) Date: Tue, 03 Dec 2013 11:40:35 +0100 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: References: <8562867.mnMhhWhuq7@horus> Message-ID: <3747214.k2agLtms99@horus> Am Montag, 2. Dezember 2013, 20:26:13 schrieb Timo Sirainen: > On 2.12.2013, at 16.24, Florian Lindner wrote: > > doveadm(mailinglists at xgm.de): Error: user mailinglists at xgm.de: > > Initialization failed: Namespace '': Mail storage autodetection failed > > with > > home=/home/flindner/Mail/mailinglists at xgm.de > > doveadm(mailinglists at xgm.de): Fatal: User init failed > > > > Which seems to be another problem. IMAP and POP3 work fine, but on > > occasions like that dovecot fails to detect that it is a maildir. > > If something works fine for imap and pop3, but not for doveadm (for the same > user), then the difference is that imap/pop3 sees different settings (e.g. > in protocol imap {}). Actually there isn't a protocol imap {} section. Or am I missing something? Thanks, Florian # doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_mechanisms = plain login digest-md5 cram-md5 ntlm namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = create special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { auto = create special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = References: <526145F7.9020303@mur.at> <1383860745696-45200.post@n4.nabble.com> Message-ID: <529DBCDA.2040703@mur.at> Dear Alex et al > Did you happen to have this working? Could you share how? So far it's not working yet. We are currently exploring more recent dovecot versions (2.2.9 AFAIR) but had to do some other work to keep the mailsystem running. Now we have more time to work on migration and will post any useful results (or more questions, whatever comes first). Cheers! -- j.hofm?ller Optimism doesn't alter the laws of physics. - Subcommander T'Pol -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 230 bytes Desc: OpenPGP digital signature URL: From alexpro at homelan.lg.ua Tue Dec 3 14:40:13 2013 From: alexpro at homelan.lg.ua (=?UTF-8?B?0JDQu9C10LrRgdC10Lkg0J/RgNC+0LrQvtC/0YfRg9C6?=) Date: Tue, 03 Dec 2013 14:40:13 +0200 Subject: [Dovecot] imap-login hangs after receiving revoked SSL certificate In-Reply-To: <529D0C96.80302@homelan.lg.ua> References: <529C8E16.3070108@homelan.lg.ua> <529D0C96.80302@homelan.lg.ua> Message-ID: <529DD12D.1020104@homelan.lg.ua> Hello again 03.12.2013 00:41, ??????? ????????? ?????: > I have own test CA based > on EJBCA. Server and all client certificates which I tried to test were > issued by this CA. Freshest CRL is embedded into ca.pem file which used > as ca certificate in dovecot.conf. > Now I'm quite confused: apache works with these certificates as > expected: accepts valid and refuses revoked. But with dovecot which > yesterday accepts at least one certificate (which I revoked for testing) > today rejects all others from same CA. Thanks for attention and excuse me that occupied your time. The problem was in CRL generated by EJBCA. Apparently, EJBCA and openSSL is not entirely compatible. When I remove CRL distribution point field from my EJBCA generated CRL, all works as expected: valid certificates accepted, revoked certificates rejected. And no problem with CRL scope, so fix from first reply doesn't needed, all works with initially installed openssl-1.0.1c With regard to apache I think it checks certificate validity with OCSP. And I doesn't embed CRL in ca certificate for apache. Perhaps it would be nice to implement OCSP validity checking together with embedded CRL with possibility to choose which one will be used. Thanks again, especially for a hint about openssl scope loop problem. With best regards, Alexey Prokopchuk (AP8686-RIPE) From pw at wk-serv.de Tue Dec 3 14:55:56 2013 From: pw at wk-serv.de (Patrick Westenberg) Date: Tue, 03 Dec 2013 13:55:56 +0100 Subject: [Dovecot] disconnecting (disconnected by server) Message-ID: <529DD4DC.9080001@wk-serv.de> Hi all, I just recognized a lot of log entries like this on my proxy: Dec 03 13:50:54 imap-login: Info: proxy(mail at example.com): disconnecting 1.2.3.4 (Disconnected by server): user=, method=PLAIN, rip=1.2.3.4, lip=2.4.6.8, TLS, session= There are no similar entries on the backends. What does this mean? Something I have to worry about? Regards Patrick # 2.2.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_mechanisms = plain login default_process_limit = 150 director_mail_servers = 172.17.1.2 172.17.1.1 director_servers = 172.17.1.3 172.17.1.4 director_user_expire = 5 mins lmtp_proxy = yes log_path = /var/log/dovecot.log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 172.17.1.3 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = 172.17.1.3 port = 24 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } service pop3-login { executable = pop3-login director } ssl_cert = Hi, I'm migrating from from 1.1 to 2.2. Currently I am doing test to ensure I'm doing it right. On the old server the managesieve config says: sieve = /correo/%d/%u/dovecot.sieve sieve_dir = /correo/%d/%u/Sieve and is working fine. But the same config on the new server is not working. I have activated verbose logging and this is the result: Dec 3 09:59:41 imap-01 dovecot: managesieve-login: Login: user=, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29855, session= Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx at ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx at ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx at ubu.es): Error: sieve-storage: Failed to stat active sieve script symlink (/correo/ubu.es/xxxx at ubu.es/dovecot.sieve): Permission denied. Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx at ubu.es): Disconnected: Logged out bytes=120/331 Dec 3 09:59:51 imap-01 dovecot: managesieve-login: Login: user=, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29858, session=<6bDthJ3s+wAKkQRB> Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx at ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx at ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx at ubu.es): Disconnected: Logged out bytes=44/199 Permissions are ok. I modified the permissions using 0777 but the error message is the same. I have made other tests to see if I can find the problem, and I made it work if I delete "%d" from config, this way: sieve = /correo/%u/dovecot.sieve sieve_dir = /correo/%u/Sieve I have copied all filters preserving permissions, and with the same file permissions is working. If I add the '%d' to the path error comes again. Can anyone tell me if this is the normal behavior or is a bug? Thanks, Pedro -- ------------------------------------------------------------------------ Pedro R. Benito da Rocha - Servicio de Informatica - Area de Sistemas Universidad de Burgos (Espa?a) E-mail: pedro at ubu.es Tel: +34 947258845 ------------------------------------------------------------------------ From alanm at sics.se Tue Dec 3 16:01:42 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Tue, 03 Dec 2013 15:01:42 +0100 Subject: [Dovecot] Complete migration from Cyrus on remote server Message-ID: <61548408cfa01585efa77316ac1ee20d@sics.se> Hi All! I am working on a complete migration from an old solaris machine running Cyrus IMAP v2.3.14 and wish to migrate all users to a new ubuntu vm running Dovecot 2.0.19. What I have so far is a fully functional dovecot installation with LDAP / Dovecot SASL auth using Maildir++. My plan is to use Perdition IMAP proxy on a third host and migrate users a few at a time (see attached picture of my whiteboard). The proxy is in place and already used by webmail clients to connect to the old server, shortly I will change the dns to point smtp.domain.com and imap.domain.com etc to the proxy instead of the old server but I haven't finished testing yet. Once that is done it is a simple matter of changing the proxy configuration per user to make them hit the new server instead. The problem I am having with this is that I am using Imapsync (http://imapsync.lamiral.info) to perform the initial synchronization (i have scripted it to maintain sync every 10 minutes with the addtion of "--maxage 1" option) using the following command line options: /usr/local/bin/imapsync --noreleasecheck --useheader ALL --delete2 --expunge2 --tmpdir /var/vmail/cache --subscribe --subscribed --tls1 --tls2 --usecache --nofoldersizes --nocheckmessageexists --host1 oldserver.domain.com --authuser1 adminuser --user1 testuser at domain.com --authmech1 PLAIN --password1 --host2 newserver.domain.com --authuser2 adminuser --user2 testuser at domain.com --authmech2 PLAIN --password2 All email is copied over and stored in dovecot as you would expect. Then I switch the user to the new server on the imapproxy and restart the client (thunderbird or whatever). This is where all email headers are downloaded again as if they were new! There are *Many* users here who would complain intensely if this happened and I was really wanting the migration to be as invisible as possible. Is there a way to do what I have described without the clients redownloading headers / full messages? I have been working on this for some time now but have hit a roadblock and don't know where to turn, any help would be really appreciated! Notes: * The proxy is not used during imapsync. * Some users have 20 years worth of mail running into 10's of GB * I have looked at dsync but the docs state that the mailbox should not be accessed during sync, this is not possible for me (it doesn't say why this is the case however) From skdovecot at smail.inf.fh-brs.de Tue Dec 3 16:39:38 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 3 Dec 2013 15:39:38 +0100 (CET) Subject: [Dovecot] Possible managesieve bug. In-Reply-To: <529DD775.6090704@ubu.es> References: <529DD775.6090704@ubu.es> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 3 Dec 2013, Pedro R. Benito da Rocha wrote: > > sieve = /correo/%d/%u/dovecot.sieve > sieve_dir = /correo/%d/%u/Sieve > > and is working fine. > > But the same config on the new server is not working. > I have activated verbose logging and this is the result: > > Dec 3 09:59:41 imap-01 dovecot: managesieve-login: Login: > user=, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, > mpid=29855, session= > Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx at ubu.es): Error: > sieve-storage: Performing readlink() on active sieve symlink > '/correo/ubu.es/xxxx at ubu.es/dovecot.sieve' failed: Permission denied What are the filesystem permissions of /correo/ubu.es, /correo/ubu.es/xxxx at ubu.es and /correo ? > Permissions are ok. I modified the permissions using 0777 but the error > message is the same. > I have made other tests to see if I can find the problem, and I made it work > if I delete "%d" from config, this way: > > sieve = /correo/%u/dovecot.sieve > sieve_dir = /correo/%u/Sieve > > I have copied all filters preserving permissions, and with the same file > permissions is working. > If I add the '%d' to the path error comes again. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUp3tKl3r2wJMiz2NAQJL5Qf7B5JTl8Q5mRXWwRUhOg4psIuBrR+ZOc65 U03+De115SwuzZpHfHeK4y+5jDsZx+7c5h3OeGYUP2A9IqH+BXvhZwt4rj/enmrZ AaB34JqWZEJ+J2IQI8u7ZdtO0acrWPG/bXcAentjWWKDl5fihgOad91w1GsABi3L 2ocYTS9HHkrJe1Ge4sDdUEc9B4Ej7X2w4yOaKeKbsiZLsidLSrgMx09KSkCl2qrP NTRUEKplxyt7Vw7rSnkPRP8zIe6cDpNf4OSPtUjtpqRFu70Yl7Uhf2yKru34csmp 8RlMtqtp+rjPnvf9GvyygAiKmTxmO7rGJT0QE2YcFD9c+IZggo3S3g== =1z9a -----END PGP SIGNATURE----- From alexpro at homelan.lg.ua Tue Dec 3 17:29:04 2013 From: alexpro at homelan.lg.ua (=?UTF-8?B?0JDQu9C10LrRgdC10Lkg0J/RgNC+0LrQvtC/0YfRg9C6?=) Date: Tue, 03 Dec 2013 17:29:04 +0200 Subject: [Dovecot] Different settings for SSL/non-SSL protocols Message-ID: <529DF8C0.9040702@homelan.lg.ua> Good time of the day! It is possible to setup dovecot with different requirements for SSL and non-SSL protocols? What would I like to do: pop3/imap non-SSL = allowed plain text authentication. pop3/imap with SSL = allowed plain text authentication with required valid SSL certificates. I need to allow access from any IP address for first group of users, which have valid SSL certificates. And allow access from only local IP addresses for second group of users which doesn't have SSL certificates at all. I tried to setup dovecot for such task. SSL and non-SSL pop3/imap works together fine, but without require valid SSL certificates. If I set auth_ssl_require_client_cert = yes, non-SSL pop3/imap refuses authentication without valid SSL certificate. I tried to use different sections for protocol pop3 {} and protocol pop3s {} (and imap/imaps) but this seems doesn't work. Is there any way to solve this? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE) From lst_hoe02 at kwsoft.de Tue Dec 3 17:30:41 2013 From: lst_hoe02 at kwsoft.de (lst_hoe02 at kwsoft.de) Date: Tue, 03 Dec 2013 16:30:41 +0100 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <61548408cfa01585efa77316ac1ee20d@sics.se> References: <61548408cfa01585efa77316ac1ee20d@sics.se> Message-ID: <20131203163041.Horde._6QsQvC_0pLW9H11swZvAw2@webmail.kwsoft.de> Zitat von Alan McGinlay - SICS : > Hi All! > > I am working on a complete migration from an old solaris machine > running Cyrus IMAP v2.3.14 and wish to migrate all users to a new ubuntu > vm running Dovecot 2.0.19. > > What I have so far is a fully functional dovecot installation with LDAP > / Dovecot SASL auth using Maildir++. > > My plan is to use Perdition IMAP proxy on a third host and migrate > users a few at a time (see attached picture of my whiteboard). > > The proxy is in place and already used by webmail clients to connect to > the old server, shortly I will change the dns to point smtp.domain.com > and imap.domain.com etc to the proxy instead of the old server but I > haven't finished testing yet. Once that is done it is a simple matter of > changing the proxy configuration per user to make them hit the new > server instead. > > The problem I am having with this is that I am using Imapsync > (http://imapsync.lamiral.info) to perform the initial synchronization (i > have scripted it to maintain sync every 10 minutes with the addtion of > "--maxage 1" option) using the following command line options: > > /usr/local/bin/imapsync --noreleasecheck --useheader ALL --delete2 > --expunge2 --tmpdir /var/vmail/cache --subscribe --subscribed --tls1 > --tls2 --usecache --nofoldersizes --nocheckmessageexists --host1 > oldserver.domain.com --authuser1 adminuser --user1 testuser at domain.com > --authmech1 PLAIN --password1 --host2 newserver.domain.com > --authuser2 adminuser --user2 testuser at domain.com --authmech2 PLAIN > --password2 > > All email is copied over and stored in dovecot as you would expect. > Then I switch the user to the new server on the imapproxy and restart > the client (thunderbird or whatever). This is where all email headers > are downloaded again as if they were new! There are *Many* users here > who would complain intensely if this happened and I was really wanting > the migration to be as invisible as possible. > > Is there a way to do what I have described without the clients > redownloading headers / full messages? > > I have been working on this for some time now but have hit a roadblock > and don't know where to turn, any help would be really appreciated! > > Notes: > > * The proxy is not used during imapsync. > * Some users have 20 years worth of mail running into 10's of GB > * I have looked at dsync but the docs state that the mailbox should not > be accessed during sync, this is not possible for me (it doesn't say why > this is the case however) Sounds like you have not adjusted the message UID to not change on the new server? http://wiki2.dovecot.org/Migration Regards Andreas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5958 bytes Desc: S/MIME Cryptographic Signature URL: From manu at netbsd.org Tue Dec 3 19:50:03 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Tue, 3 Dec 2013 18:50:03 +0100 Subject: [Dovecot] BUG: Authentication client sent unknown handshake command In-Reply-To: <20131129165407.GA29172@homeworld.netbsd.org> Message-ID: <1ldbfyp.1hip8ot176qi9rM%manu@netbsd.org> Emmanuel Dreyfus wrote: > Nov 29 16:56:01 volanges dovecot: auth: Error: BUG: Authentication client > sent unknown handshake command: > REQUEST?6970356762?616?6?235264ef69dbd1665538af54... I have real trouble to debug that one. I had a look at wiki2.dovecot.org/Design/AuthProtocol, and if I understand correctly, the auth server receives data from the master where it awaits data from the auth client. That suggests some confusion with file descriptors somewhere. Where are the pipe() invocation to create these two pipe sets? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From user+dovecot at localhost.localdomain.org Tue Dec 3 20:55:23 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Tue, 03 Dec 2013 18:55:23 +0000 Subject: [Dovecot] Gettings mails recently moved to a folder In-Reply-To: <3747214.k2agLtms99@horus> References: <8562867.mnMhhWhuq7@horus> <3747214.k2agLtms99@horus> Message-ID: <529E291B.30003@localhost.localdomain.org> On 12/03/2013 10:40 AM Florian Lindner wrote: > Actually there isn't a protocol imap {} section. Or am I missing something? > > Thanks, > Florian > > # doveconf -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 > auth_mechanisms = plain login digest-md5 cram-md5 ntlm > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = create > special_use = \Drafts > } > mailbox Junk { > auto = create > special_use = \Junk > } > mailbox Sent { > auto = create > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Spam { > special_use = \Junk > } > mailbox Trash { > auto = create > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocols = imap pop3 > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > Let me repeat myself: Set a mail_location Regards, Pascal -- The trapper recommends today: f007ba11.1333719 at localdomain.org From tss at iki.fi Tue Dec 3 21:10:31 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 21:10:31 +0200 Subject: [Dovecot] BUG: Authentication client sent unknown handshake command In-Reply-To: <20131129165407.GA29172@homeworld.netbsd.org> References: <20131129165407.GA29172@homeworld.netbsd.org> Message-ID: <8A080BAF-4928-4BCA-9930-B8243EEEAF39@iki.fi> On 29.11.2013, at 18.54, Emmanuel Dreyfus wrote: > After upgrading the kernel, everything is fine, except dovecot authentication. > I get this trange thing (data after REQUEST? changed just in case it > contains anything sensitive): > > Nov 29 16:56:01 volanges dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: REQUEST?6970356762?616?6?235264ef69dbd1665538af54d12fdaea?session_pid=453?req... I think net_getunixname() no longer works correctly. src/auth/main.c uses it to figure out what each socket is. From tss at iki.fi Tue Dec 3 21:17:41 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 21:17:41 +0200 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <61548408cfa01585efa77316ac1ee20d@sics.se> References: <61548408cfa01585efa77316ac1ee20d@sics.se> Message-ID: <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> On 3.12.2013, at 16.01, Alan McGinlay - SICS wrote: > I am working on a complete migration from an old solaris machine > running Cyrus IMAP v2.3.14 and wish to migrate all users to a new ubuntu > vm running Dovecot 2.0.19. v2.0 is rather old. > All email is copied over and stored in dovecot as you would expect. > Then I switch the user to the new server on the imapproxy and restart > the client (thunderbird or whatever). This is where all email headers > are downloaded again as if they were new! There are *Many* users here > who would complain intensely if this happened and I was really wanting > the migration to be as invisible as possible. > > Is there a way to do what I have described without the clients > redownloading headers / full messages? I don?t think imapsync supports Dovecot?s dovecot-uidlist, so it can?t preserve the IMAP UIDs. > * I have looked at dsync but the docs state that the mailbox should not > be accessed during sync, this is not possible for me (it doesn't say why > this is the case however) dsync is intended for these kinds of migrations. I?m not sure where you read that mailbox shouldn?t be accessed during it? Anyway v2.0 dsync is rather bad. Even if you end up using Dovecot v2.0, for the migration you could use Dovecot v2.2 dsync binary (installed e.g. under /tmp/dovecot-2.2). v2.2.9 dsync+imapc performance is very good when mail_prefetch_count=10 (or more). From tss at iki.fi Tue Dec 3 21:21:54 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 21:21:54 +0200 Subject: [Dovecot] disconnecting (disconnected by server) In-Reply-To: <529DD4DC.9080001@wk-serv.de> References: <529DD4DC.9080001@wk-serv.de> Message-ID: <64C1D348-6CC4-4DE6-B579-8E560DBE9FF1@iki.fi> On 3.12.2013, at 14.55, Patrick Westenberg wrote: > I just recognized a lot of log entries like this on my proxy: > > Dec 03 13:50:54 imap-login: Info: proxy(mail at example.com): disconnecting 1.2.3.4 (Disconnected by server): user=, method=PLAIN, rip=1.2.3.4, lip=2.4.6.8, TLS, session= > > There are no similar entries on the backends. > > What does this mean? Something I have to worry about? See the session ID ?qk02v6DsJwBTlUQX?. Find the disconnection message from the backend server?s logs by grepping it. From tss at iki.fi Tue Dec 3 21:33:28 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 21:33:28 +0200 Subject: [Dovecot] Error in imap_address_arg_append In-Reply-To: <409CEB1649811749B2E36961BEE2DDBC293603F7@MBX2.rambler.ramblermedia.com> References: <409CEB1649811749B2E36961BEE2DDBC293603F7@MBX2.rambler.ramblermedia.com> Message-ID: <39B5A4F0-0ADE-42C7-9ECB-DB636CC11873@iki.fi> On 3.12.2013, at 11.18, Potapov Sergey wrote: > Function imap_envelope_parse return incorrect result for addresses with groups due to error in imap_address_arg_append because of with ", " is added after group name and before first mailbox. > > Patch for dovecot v2.1 in attach. Committed to v2.2: http://hg.dovecot.org/dovecot-2.2/rev/342f6962390e From pw at wk-serv.de Tue Dec 3 22:15:18 2013 From: pw at wk-serv.de (Patrick Westenberg) Date: Tue, 03 Dec 2013 21:15:18 +0100 Subject: [Dovecot] disconnecting (disconnected by server) In-Reply-To: <64C1D348-6CC4-4DE6-B579-8E560DBE9FF1@iki.fi> References: <529DD4DC.9080001@wk-serv.de> <64C1D348-6CC4-4DE6-B579-8E560DBE9FF1@iki.fi> Message-ID: <529E3BD6.8090403@wk-serv.de> Timo Sirainen schrieb: > See the session ID ?qk02v6DsJwBTlUQX?. Find the disconnection message from the backend server?s logs by grepping it. There is only the login entry: Dec 03 13:50:53 imap-login: Info: Login: user=, method=PLAIN, rip=1.2.3.4, lip=2.3.4.5, mpid=3707, TLS, session= From tss at iki.fi Tue Dec 3 22:16:23 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 22:16:23 +0200 Subject: [Dovecot] disconnecting (disconnected by server) In-Reply-To: <529E3BD6.8090403@wk-serv.de> References: <529DD4DC.9080001@wk-serv.de> <64C1D348-6CC4-4DE6-B579-8E560DBE9FF1@iki.fi> <529E3BD6.8090403@wk-serv.de> Message-ID: On 3.12.2013, at 22.15, Patrick Westenberg wrote: > Timo Sirainen schrieb: > >> See the session ID ?qk02v6DsJwBTlUQX?. Find the disconnection message from the backend server?s logs by grepping it. > > There is only the login entry: > > Dec 03 13:50:53 imap-login: Info: Login: user=, method=PLAIN, rip=1.2.3.4, lip=2.3.4.5, mpid=3707, TLS, session= Oh, right, Adding %{session} to mail_log_prefix is useful. Maybe I?ll make it the default some day. From pw at wk-serv.de Tue Dec 3 22:43:16 2013 From: pw at wk-serv.de (Patrick Westenberg) Date: Tue, 03 Dec 2013 21:43:16 +0100 Subject: [Dovecot] disconnecting (disconnected by server) In-Reply-To: References: <529DD4DC.9080001@wk-serv.de> <64C1D348-6CC4-4DE6-B579-8E560DBE9FF1@iki.fi> <529E3BD6.8090403@wk-serv.de> Message-ID: <529E4264.3040603@wk-serv.de> Timo Sirainen schrieb: > On 3.12.2013, at 22.15, Patrick Westenberg wrote: > >> Timo Sirainen schrieb: >> >>> See the session ID ?qk02v6DsJwBTlUQX?. Find the disconnection message from the backend server?s logs by grepping it. >> >> There is only the login entry: >> >> Dec 03 13:50:53 imap-login: Info: Login: user=, method=PLAIN, rip=1.2.3.4, lip=2.3.4.5, mpid=3707, TLS, session= > > Oh, right, Adding %{session} to mail_log_prefix is useful. Maybe I?ll make it the default some day. Now I see more, but the logout seems quite normal: Dec 03 21:39:07 imap-login: Info: proxy(mail at example.com): disconnecting 2.4.6.8 (Disconnected by server): user=, method=PLAIN, rip=2.4.6.8, lip=2.3.4.5, TLS, session= Dec 03 21:39:07 eaeiR6fs1gBUdqox -- imap(mail at example.com): Info: Disconnected: Logged out in=63 out=778 From tss at iki.fi Tue Dec 3 22:49:00 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 3 Dec 2013 22:49:00 +0200 Subject: [Dovecot] disconnecting (disconnected by server) In-Reply-To: <529E4264.3040603@wk-serv.de> References: <529DD4DC.9080001@wk-serv.de> <64C1D348-6CC4-4DE6-B579-8E560DBE9FF1@iki.fi> <529E3BD6.8090403@wk-serv.de> <529E4264.3040603@wk-serv.de> Message-ID: <34B2B3B0-ACC9-4E16-85CE-1B02AF35EB31@iki.fi> On 3.12.2013, at 22.43, Patrick Westenberg wrote: > Now I see more, but the logout seems quite normal: > > Dec 03 21:39:07 imap-login: Info: proxy(mail at example.com): disconnecting 2.4.6.8 (Disconnected by server): user=, method=PLAIN, rip=2.4.6.8, lip=2.3.4.5, TLS, session= > > Dec 03 21:39:07 eaeiR6fs1gBUdqox -- imap(mail at example.com): Info: Disconnected: Logged out in=63 out=778 Right, I guess that?s then what it always does. Logout sequence goes: C: a LOGOUT S: * Bye S: a OK S: The server doesn?t wait for client to disconnect. So proxy sees that server does the disconnection. The other possibility would have been that it saw client disconnecting. From mkliewe at gmx.de Tue Dec 3 23:33:42 2013 From: mkliewe at gmx.de (Michael Kliewe) Date: Tue, 03 Dec 2013 22:33:42 +0100 Subject: [Dovecot] Panic in indexer-worker Message-ID: <529E4E36.9030806@gmx.de> Hi, I did a fresh installation of 2.2.9 in my test environment and enabled fts_autoindex=yes. I'm using a solr-server for FTS. I got this error, just once until now: _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= ==> dovecot-lmtp-errors.log <== Dec 03 16:15:06 lmtp(30601, username at domain.de): Error: Timeout (29s) while waiting for lock for transaction log file /maildata/domain.de/username/maildir/dovecot.list.index.log ==> dovecot-lmtp.log <== Dec 03 16:15:06 lmtp(30601, username at domain.de): Info: h2jGC1j1nVKJdwAAwaC1kQ: sieve: msgid=<20131203151436.962C06B6E9 at monitoring01.domain.de>: stored mail into mailbox 'Trash' Dec 03 16:15:06 lmtp(30601): Info: Disconnect from 10.0.0.3: Successful quit ==> dovecot.log <== Dec 03 16:15:06 indexer-worker(username at domain.de): Panic: file http-client-request.c: line 521 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Dec 03 16:15:06 indexer-worker(username at domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7fc60fe2eab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7fc60fe2eb8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc60fdea3ce] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send_more+0x2ed) [0x7fc60fe0406d] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send+0x1e1) [0x7fc60fe042a1] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_connection_next_request+0x120) [0x7fc60fe06720] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3f6b7) [0x7fc60fe076b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xbf) [0x7fc60fe3e9af] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x94) [0x7fc60fe3f7d4] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3bb3f) [0x7fc60fe03b3f] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_end+0x61) [0x7fc60f1d5421] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x4388) [0x7fc60f1d2388] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x29) [0x7fc60f3dfd29] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xbb7c) [0x7fc60f3e4b7c] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc982) [0x7fc60f3e5982] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(+0xb584) [0x7fc60f5f6584] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90927) [0x7fc61012a927] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3f) [0x7fc6101162cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7fc61011636e] -> dovecot/indexer-worker [username at domain.de Trash]() [0x4024f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fc60fe3ea87] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc60fe3f817] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fc60fdef5c3] -> dovecot/indexer-worker [username at domain.de Trash](main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fc60fa21de5] -> dovecot/indexer-worker [username at domain.de Trash]() [0x401fc2] Dec 03 16:15:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for username at domain.de Dec 03 16:15:13 indexer-worker(username at domain.de): Fatal: master: service(indexer-worker): child 30611 killed with signal 6 (core dumped) _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= This happend when LMTP received a mail, and because of fts_autoindex=yes it should be sent to the solr server. Is this normal when waiting for lock on transaction log file times out, or should there be something more graceful, maybe just skip it or so? I already tried to reproduce, but I cannot. I will check the logfiles if it happens again. Regards Michael From delrio at mie.utoronto.ca Tue Dec 3 23:55:43 2013 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Tue, 03 Dec 2013 16:55:43 -0500 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> References: <61548408cfa01585efa77316ac1ee20d@sics.se> <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> Message-ID: <529E535F.4070705@mie.utoronto.ca> On 12/ 3/13 02:17 PM, Timo Sirainen wrote: > On 3.12.2013, at 16.01, Alan McGinlay - SICS wrote: > >> * I have looked at dsync but the docs state that the mailbox should not >> be accessed during sync, this is not possible for me (it doesn't say why >> this is the case however) > dsync is intended for these kinds of migrations. I?m not sure where you read that mailbox shouldn?t be accessed during it? > http://wiki2.dovecot.org/Migration/Dsync "The source IMAP/POP3 mailboxes shouldn't be modified while dsync is running." From tss at iki.fi Wed Dec 4 00:33:31 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 4 Dec 2013 00:33:31 +0200 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <529E535F.4070705@mie.utoronto.ca> References: <61548408cfa01585efa77316ac1ee20d@sics.se> <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> <529E535F.4070705@mie.utoronto.ca> Message-ID: <850DAFA4-FEAE-497C-ADDB-6A7098ACED78@iki.fi> On 3.12.2013, at 23.55, Oscar del Rio wrote: > > On 12/ 3/13 02:17 PM, Timo Sirainen wrote: >> On 3.12.2013, at 16.01, Alan McGinlay - SICS wrote: >> >>> * I have looked at dsync but the docs state that the mailbox should not >>> be accessed during sync, this is not possible for me (it doesn't say why >>> this is the case however) >> dsync is intended for these kinds of migrations. I?m not sure where you read that mailbox shouldn?t be accessed during it? >> > > http://wiki2.dovecot.org/Migration/Dsync > "The source IMAP/POP3 mailboxes shouldn't be modified while dsync is running.? I?m not sure why I wrote that. Maybe it didn?t work as well in earlier versions. I removed the text now from the page. From gareth at acsdata.co.nz Wed Dec 4 06:31:11 2013 From: gareth at acsdata.co.nz (Gareth Palmer) Date: Wed, 04 Dec 2013 17:31:11 +1300 Subject: [Dovecot] [PATCH] lib-sql/driver-mysql.c - Add support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT In-Reply-To: References: <1385073316.2545.36.camel@bad-dog> <20131122072206.GB28106@sys4.de> Message-ID: <1386131471.2595.14.camel@bad-dog> Timo, Were there any further changes you wanted made to the patch? It now defaults to having ssl_verify_server_cert enabled. On Fri, 2013-11-22 at 13:52 +0200, Timo Sirainen wrote: > On 22.11.2013, at 9.22, Patrick Ben Koetter

wrote: > > > * Timo Sirainen : > >> On 22.11.2013, at 0.35, Gareth Palmer wrote: > >> > >>> The following patch adds support for enabling > >>> MYSQL_OPT_SSL_VERIFY_SERVER_CERT. > >>> > >>> It makes the mysql client library check that the commonName in the > >>> server's SSL certificate matches the host name provided to > >>> mysql_real_connect() and aborts the connection if the name doesn't > >>> match. > >> > >> If someone goes through the trouble of using SSL with MySQL .. should this > >> even be optional? I guess I shouldn?t break any v2.2 installations even > >> accidentally, but for v2.3 I don?t really see any point of not having this > >> enabled unconditionally. > > > > It should be optional or it will break other running systems when the > > update/upgrade. > > But perhaps it should break (in v2.3.0)? Otherwise it?s not really running securely anyway. At least the default should be to verify the cert. -------------- next part -------------- A non-text attachment was scrubbed... Name: ssl-verify-server-cert-20131120.patch Type: text/x-patch Size: 4615 bytes Desc: not available URL: From pizzaiolo at gmx.com Wed Dec 4 06:43:07 2013 From: pizzaiolo at gmx.com (Pizza Napoletana) Date: Tue, 3 Dec 2013 20:43:07 -0800 Subject: [Dovecot] Multi-master Replication? Message-ID: <461A5BBC-F92D-47B8-A244-B6A44997A0FA@gmx.com> Will the replication method described at http://wiki2.dovecot.org/Replication support a master/master/master configuration to keep three replicas in sync? Thanks From manu at netbsd.org Wed Dec 4 07:20:37 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Wed, 4 Dec 2013 06:20:37 +0100 Subject: [Dovecot] BUG: Authentication client sent unknown handshake command In-Reply-To: <8A080BAF-4928-4BCA-9930-B8243EEEAF39@iki.fi> Message-ID: <1ldcbm0.13124emwb4wg7M%manu@netbsd.org> Timo Sirainen wrote: > I think net_getunixname() no longer works correctly. src/auth/main.c uses > it to figure out what each socket is. Indeed, when the auth process calls net_getunixname(), getsockname() fills the name buffer with garbage. That happens with fd 7 for instance, and inspecting the process with fstat(1) I see no fd 7. I am not yet sure if it is closed before or after getsockname() # ps -axp 6025 6025 ? I 0:00.02 dovecot/auth -w # fstat -p 6025 USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root auth 6025 wd / 636320 drwxr-xr-x 1024 r root auth 6025 0 / 68173 crw-rw-rw- null w root auth 6025 1 / 68173 crw-rw-rw- null w root auth 6025 2* pipe 0xc732d254 -> 0xc710c010 w root auth 6025 3* pipe 0xc725e310 -> 0xc70b330c w root auth 6025 4 / 545650 -rw-r--r-- 121 r root auth 6025 5* pipe 0xc725ecd0 -> 0xc710c0d0 wn root auth 6025 6* pipe 0xc7be385c -> 0xc79b885c w root auth 6025 5* misc 0xc67dff18 root auth 6025 9* pipe 0xc7057f04 <- 0xc618f000 rn root auth 6025 10* pipe 0xc618f000 -> 0xc7057f04 wn root auth 6025 4* kqueue pending 0 root auth 6025 4* kqueue pending 0 root auth 6025 13 / 545650 -rw-r--r-- 121 r root auth 6025 14* internet stream tcp 192.0.2.16:636 <-> 192.0.2.26:62473 root auth 6025 15* unix stream <-> /var/run/dovecot/auth-worker root auth 6025 130 / 545650 -rw-r--r-- 121 r The other auth process has it as a Unix socket like we expect: # ps -axp 17204 PID TTY STAT TIME COMMAND 17204 ? I 0:00.02 dovecot/auth # fstat -p 17204 USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root auth 17204 wd / 636320 drwxr-xr-x 1024 r root auth 17204 0 / 68173 crw-rw-rw- null w root auth 17204 1 / 68173 crw-rw-rw- null w root auth 17204 2* pipe 0xc725e250 -> 0xc618ee40 w root auth 17204 3* pipe 0xc725e310 -> 0xc70b330c w root auth 17204 4 / 545650 -rw-r--r-- 121 r root auth 17204 5* pipe 0xc7058184 -> 0xc710c9d0 wn root auth 17204 6* pipe 0xc7be385c -> 0xc79b885c w root auth 17204 7* unix stream <-> /var/run/dovecot/login/login root auth 17204 8* unix stream <-> /var/run/dovecot/token-login/tokenlogin root auth 17204 9* unix stream <-> /var/run/dovecot/auth-login root auth 17204 10* unix stream <-> /var/run/dovecot/auth-client root auth 17204 11* unix stream <-> /var/run/dovecot/auth-userdb root auth 17204 12* unix stream <-> /var/run/dovecot/auth-master root auth 17204 5* misc 0xc67dff60 root auth 17204 14* unix stream <-> c71b6e14 root auth 17204 4* kqueue pending 0 root auth 17204 16* pipe 0xc70b36cc <- 0xc7058244 rn root auth 17204 17* pipe 0xc7058244 -> 0xc70b36cc wn root auth 17204 4* kqueue pending 0 root auth 17204 19 / 545650 -rw-r--r-- 121 r root auth 17204 20* internet stream tcp 192.0.2.15:636 <-> 192.0.2.26:62459 root auth 17204 22* unix stream <-> c60cb974 root auth 17204 130 / 545650 -rw-r--r-- 121 r -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From manu at netbsd.org Wed Dec 4 08:50:31 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Wed, 4 Dec 2013 07:50:31 +0100 Subject: [Dovecot] BUG: Authentication client sent unknown handshake command In-Reply-To: <1ldcbm0.13124emwb4wg7M%manu@netbsd.org> Message-ID: <1ldcge4.bp80f61vfib88M%manu@netbsd.org> Emmanuel Dreyfus wrote: > Indeed, when the auth process calls net_getunixname(), getsockname() fills the > name buffer with garbage. I checked with a test program: on a non open, or closed socket, getsockname() returns -1. However on a socket that was not bound, it returns 0 and fills the buffer with garbage. I suspect this is a kernel bug, but how do we reach that situation? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From pedro at ubu.es Wed Dec 4 09:47:13 2013 From: pedro at ubu.es (Pedro R. Benito da Rocha) Date: Wed, 04 Dec 2013 08:47:13 +0100 Subject: [Dovecot] Possible managesieve bug. In-Reply-To: References: <529DD775.6090704@ubu.es> Message-ID: <529EDE01.607@ubu.es> Hello, Permissions are: * /correo: 0777 (rwxrwxrwx) * /correo/ubu.es: 0770 (rwxrwx---) * /correo/ubu.es/xxxx at ubu.es: 0777 (rwxrwxrwx) All users belong to the same group. If I change /correo/ubu.es permissions to 0777 (rwxrwxrwx) it works again. I have checked old server config again an I realize that it is using another group for mail access, so is a permissions issue. But if If change permissions to 0777 on user's directory and files an error occurs. If I change to 0770 it works fine. Thank you for the tip, I was blocked :) Pedro El 03/12/13 15:39, Steffen Kaiser escribi?: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 3 Dec 2013, Pedro R. Benito da Rocha wrote: > >> >> sieve = /correo/%d/%u/dovecot.sieve >> sieve_dir = /correo/%d/%u/Sieve >> >> and is working fine. >> >> But the same config on the new server is not working. >> I have activated verbose logging and this is the result: >> >> Dec 3 09:59:41 imap-01 dovecot: managesieve-login: Login: >> user=, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, >> mpid=29855, session= >> Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx at ubu.es): Error: >> sieve-storage: Performing readlink() on active sieve symlink >> '/correo/ubu.es/xxxx at ubu.es/dovecot.sieve' failed: Permission denied > > What are the filesystem permissions of /correo/ubu.es, > /correo/ubu.es/xxxx at ubu.es and /correo ? > >> Permissions are ok. I modified the permissions using 0777 but the >> error message is the same. > >> I have made other tests to see if I can find the problem, and I made >> it work if I delete "%d" from config, this way: >> >> sieve = /correo/%u/dovecot.sieve >> sieve_dir = /correo/%u/Sieve >> >> I have copied all filters preserving permissions, and with the same >> file permissions is working. >> If I add the '%d' to the path error comes again. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUp3tKl3r2wJMiz2NAQJL5Qf7B5JTl8Q5mRXWwRUhOg4psIuBrR+ZOc65 > U03+De115SwuzZpHfHeK4y+5jDsZx+7c5h3OeGYUP2A9IqH+BXvhZwt4rj/enmrZ > AaB34JqWZEJ+J2IQI8u7ZdtO0acrWPG/bXcAentjWWKDl5fihgOad91w1GsABi3L > 2ocYTS9HHkrJe1Ge4sDdUEc9B4Ej7X2w4yOaKeKbsiZLsidLSrgMx09KSkCl2qrP > NTRUEKplxyt7Vw7rSnkPRP8zIe6cDpNf4OSPtUjtpqRFu70Yl7Uhf2yKru34csmp > 8RlMtqtp+rjPnvf9GvyygAiKmTxmO7rGJT0QE2YcFD9c+IZggo3S3g== > =1z9a > -----END PGP SIGNATURE----- -- ------------------------------------------------------------------------ Pedro R. Benito da Rocha - Servicio de Informatica - Area de Sistemas Universidad de Burgos (Espa?a) E-mail: pedro at ubu.es Tel: +34 947258845 ------------------------------------------------------------------------ From openmsk at gmail.com Wed Dec 4 10:09:47 2013 From: openmsk at gmail.com (John Smith) Date: Wed, 4 Dec 2013 12:09:47 +0400 Subject: [Dovecot] letters local filter duplicated Message-ID: two servers with replicated master/master. dovecot.conf = http://pastebin.com/jVnvyWZM with this setup letters processed local filter duplicated. ?ie when the mail client receives a letter begins processing using rules (filters) to move the letters in a different folder. summarized in this folder is two duplicate letters.? if you disable the filter, the message is not duplicated. But does not move to another location. -- Best Regards, Evgeny Senior System Administrator OOO "Vaz Service Hurley" From aoster at novanetwork.de Wed Dec 4 10:12:43 2013 From: aoster at novanetwork.de (Andreas Oster) Date: Wed, 04 Dec 2013 09:12:43 +0100 Subject: [Dovecot] FTS solr issue with second private namespace In-Reply-To: References: Message-ID: <529EE3FB.2030505@novanetwork.de> Am 02.12.2013 12:00, schrieb Andreas Oster: > Hi all, > > I have just stumbled over an issue with the FTS plugin of dovecot. > For our primary namespace, INBOX and its subfolders, searching works > without any problems but in a second namespace, which I have created > for old/archived mails, searching of the mail text/body does not work. > I can see the search request in the tomcat log but no result is created > and the mail client (Thunderbird) keeps displaying the serach message > without returning any results. > > Tomcat6 catalina.out: > > Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute > INFO: [] webapp=/solr path=/select > params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} > hits=0 status=0 QTime=1 > > > I am currently using Dovecot 2.2.9 and do not have any special FTS config: > > mail_plugins = quota mailbox_alias fts fts_solr > > plugin { > fts = solr > fts_solr = break-imap-search url=http://localhost:8080/solr/ > fts_autoindex = yes > } > > > Thank you for your kind help > > best regards > > Andreas > > Hi all, does nobody have an idea what could be the cause of this issue or has run into the same problem with fts ? Thank you for your kind help best regards Andreas From aoster at novanetwork.de Wed Dec 4 10:12:43 2013 From: aoster at novanetwork.de (Andreas Oster) Date: Wed, 04 Dec 2013 09:12:43 +0100 Subject: [Dovecot] FTS solr issue with second private namespace In-Reply-To: References: Message-ID: <529EE3FB.2030505@novanetwork.de> Am 02.12.2013 12:00, schrieb Andreas Oster: > Hi all, > > I have just stumbled over an issue with the FTS plugin of dovecot. > For our primary namespace, INBOX and its subfolders, searching works > without any problems but in a second namespace, which I have created > for old/archived mails, searching of the mail text/body does not work. > I can see the search request in the tomcat log but no result is created > and the mail client (Thunderbird) keeps displaying the serach message > without returning any results. > > Tomcat6 catalina.out: > > Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute > INFO: [] webapp=/solr path=/select > params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} > hits=0 status=0 QTime=1 > > > I am currently using Dovecot 2.2.9 and do not have any special FTS config: > > mail_plugins = quota mailbox_alias fts fts_solr > > plugin { > fts = solr > fts_solr = break-imap-search url=http://localhost:8080/solr/ > fts_autoindex = yes > } > > > Thank you for your kind help > > best regards > > Andreas > > Hi all, does nobody have an idea what could be the cause of this issue or has run into the same problem with fts ? Thank you for your kind help best regards Andreas From c at roessner-network-solutions.com Wed Dec 4 10:04:26 2013 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Wed, 4 Dec 2013 09:04:26 +0100 Subject: [Dovecot] file descriptor errors Message-ID: <243F62B7-292F-4188-8B96-4D01EFC2A0C7@roessner-network-solutions.com> Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = From alanm at sics.se Wed Dec 4 11:07:07 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Wed, 04 Dec 2013 10:07:07 +0100 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <529E535F.4070705@mie.utoronto.ca> References: <61548408cfa01585efa77316ac1ee20d@sics.se> <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> <529E535F.4070705@mie.utoronto.ca> Message-ID: <47dbb84d3aac31ef7d5d89fe55ac627a@sics.se> On 2013-12-03 22:55, Oscar del Rio wrote: > On 12/ 3/13 02:17 PM, Timo Sirainen wrote: > On 3.12.2013, at 16.01, Alan McGinlay - SICS wrote: > > * I have looked at dsync but the docs state that the mailbox should > not > be accessed during sync, this is not possible for me (it doesn't say > why > this is the case however) > dsync is intended for these kinds of migrations. I?m not sure where > you read that mailbox shouldn?t be accessed during it? > > > http://wiki2.dovecot.org/Migration/Dsync > "The source IMAP/POP3 mailboxes shouldn't be modified while dsync is > running." Thanks, yes indeed that is where I read that factoid. So what does that mean, it works but might produce corrupt messages on the receiver if the other side is accessed simultaneously? I did actually use Imapsync without first blocking access and it seemed to work (aside from the UID issues i mentioned) From cr at sys4.de Wed Dec 4 11:50:20 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Wed, 4 Dec 2013 10:50:20 +0100 Subject: [Dovecot] file descriptor errors Message-ID: <438ED883-1F43-407F-8E4D-E675D22F3EDC@sys4.de> Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = From cr at sys4.de Wed Dec 4 12:00:12 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Wed, 4 Dec 2013 11:00:12 +0100 Subject: [Dovecot] file descriptor errors In-Reply-To: <438ED883-1F43-407F-8E4D-E675D22F3EDC@sys4.de> References: <438ED883-1F43-407F-8E4D-E675D22F3EDC@sys4.de> Message-ID: <6B8EB8B0-F672-4998-B140-76332672D8E6@sys4.de> Hi, just a short question: I had sent exactly this same email with a wrong email address (not the cr at sys4.de) and unfortunately I was to late deleting it in Mailman. Now I get replies to the c at roessner-network-solutions.com address, which will not succeed at the moment, because of DMARC policy. So if you already sent answers, could you please email it again to the cr at sys4.de mail. Thanks a lot in advance Am 04.12.2013 um 10:50 schrieb Christian R??ner : > Hi, > > I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: > > Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: > Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor > > What could cause these error messages? > > My mailboxes are stored on an ext4 filesystem: > /dev/vdb1 on /srv/mail type ext4 (rw,noatime) > > doveconf -n: > # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 > auth_master_user_separator = * > auth_mechanisms = plain login > auth_verbose = yes > disable_plaintext_auth = no > imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_access_groups = mail > mail_attachment_dir = /srv/mail/copymail/attachments > mail_gid = mail > mail_location = maildir:/srv/mail/virtual/%d/%n > mail_plugins = quota acl zlib mail_log notify > mail_privileged_group = mail > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk-E-Mail { > auto = subscribe > special_use = \Junk > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = INBOX. > } > passdb { > args = /usr/local/sbin/ispcp-decrypt.py > driver = checkpassword > } > plugin { > acl = vfile > acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db > quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota > quota_rule = *:storage=300M:messages=20000 > quota_status_nouser = DUNNO > quota_status_overquota = 552 5.2.2 Mailbox is full > quota_status_success = DUNNO > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > zlib_save = gz > zlib_save_level = 6 > } > postmaster_address = postmaster at deltaweb.de > protocols = imap pop3 lmtp sieve > service auth-worker { > extra_groups = ssl-cert > unix_listener auth-worker { > mode = 0600 > user = vmail > } > user = vmail > } > service auth { > extra_groups = ssl-cert > unix_listener /var/spool/postfix.relay/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > mode = 0660 > user = vmail > } > user = vmail > } > service config { > unix_listener config { > mode = 0600 > user = vmail > } > } > service dict { > unix_listener dict { > mode = 0600 > user = vmail > } > } > service imap-login { > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > inet_listener lmtp { > address = ::1 > port = 24 > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > inet_listener sieve_deprecated { > port = 2000 > } > } > service pop3-login { > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service quota-status { > client_limit = 1 > executable = quota-status -p postfix > inet_listener { > port = 12340 > } > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = dovecot > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol lmtp { > mail_plugins = quota acl zlib mail_log notify sieve > } > protocol lda { > mail_plugins = quota acl zlib mail_log notify sieve > } > protocol imap { > mail_max_userip_connections = 50 > mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib > } > > Thanks in advance > > -Christian R??ner > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein > -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From lst_hoe02 at kwsoft.de Wed Dec 4 12:35:33 2013 From: lst_hoe02 at kwsoft.de (lst_hoe02 at kwsoft.de) Date: Wed, 04 Dec 2013 11:35:33 +0100 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <850DAFA4-FEAE-497C-ADDB-6A7098ACED78@iki.fi> References: <61548408cfa01585efa77316ac1ee20d@sics.se> <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> <529E535F.4070705@mie.utoronto.ca> <850DAFA4-FEAE-497C-ADDB-6A7098ACED78@iki.fi> Message-ID: <20131204113533.Horde.3vXsQFaG08J-MGwFvccQYg5@webmail.kwsoft.de> Zitat von Timo Sirainen : > On 3.12.2013, at 23.55, Oscar del Rio wrote: > >> >> On 12/ 3/13 02:17 PM, Timo Sirainen wrote: >>> On 3.12.2013, at 16.01, Alan McGinlay - SICS wrote: >>> >>>> * I have looked at dsync but the docs state that the mailbox should not >>>> be accessed during sync, this is not possible for me (it doesn't say why >>>> this is the case however) >>> dsync is intended for these kinds of migrations. I?m not sure >>> where you read that mailbox shouldn?t be accessed during it? >>> >> >> http://wiki2.dovecot.org/Migration/Dsync >> "The source IMAP/POP3 mailboxes shouldn't be modified while dsync >> is running.? > > I?m not sure why I wrote that. Maybe it didn?t work as well in > earlier versions. I removed the text now from the page. We have done it by simply copy the Cyrus Mailbox, use the "cyrus2dovecot" script listed here http://wiki2.dovecot.org/Migration/Cyrus and afterwards apply dsync to convert if maildir is not the intended target format for Dovecot. The 2.0.19 Dovecot version is the one included in Ubuntu 12.04 LTS BTW. Regards Andreas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5958 bytes Desc: S/MIME Cryptographic Signature URL: From alanm at sics.se Wed Dec 4 13:09:17 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Wed, 04 Dec 2013 12:09:17 +0100 Subject: [Dovecot] Complete migration from Cyrus on remote server In-Reply-To: <20131204113533.Horde.3vXsQFaG08J-MGwFvccQYg5@webmail.kwsoft.de> References: <61548408cfa01585efa77316ac1ee20d@sics.se> <9FED7E15-4EA3-4D9D-BC74-3CC1C3DE499F@iki.fi> <529E535F.4070705@mie.utoronto.ca> <850DAFA4-FEAE-497C-ADDB-6A7098ACED78@iki.fi> <20131204113533.Horde.3vXsQFaG08J-MGwFvccQYg5@webmail.kwsoft.de> Message-ID: <5fbd1bc1af6bda3308ef78ee30e92dfa@sics.se> On 2013-12-04 11:35, lst_hoe02 at kwsoft.de wrote: > Zitat von Timo Sirainen : > > On 3.12.2013, at 23.55, Oscar del Rio wrote: > > > On 12/ 3/13 02:17 PM, Timo Sirainen wrote: > On 3.12.2013, at 16.01, Alan McGinlay - SICS wrote: > > * I have looked at dsync but the docs state that the mailbox should > not > be accessed during sync, this is not possible for me (it doesn't say > why > this is the case however) > dsync is intended for these kinds of migrations. I?m not sure where > you read that mailbox shouldn?t be accessed during it? > > > http://wiki2.dovecot.org/Migration/Dsync > "The source IMAP/POP3 mailboxes shouldn't be modified while dsync is > running.? > > I?m not sure why I wrote that. Maybe it didn?t work as well in > earlier versions. I removed the text now from the page. > > We have done it by simply copy the Cyrus Mailbox, use the > "cyrus2dovecot" script listed here > http://wiki2.dovecot.org/Migration/Cyrus and afterwards apply dsync to > convert if maildir is not the intended target format for Dovecot. The > 2.0.19 Dovecot version is the one included in Ubuntu 12.04 LTS BTW. > > Regards > > Andreas Yeah unfortunately ubuntu / debian packages are somewhat outdated but the Dovecot docs say them selves not to use the later (nightly built) packages on systems that need to be stable. From CMarcus at Media-Brokers.com Wed Dec 4 12:57:52 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 04 Dec 2013 05:57:52 -0500 Subject: [Dovecot] file descriptor errors In-Reply-To: <6B8EB8B0-F672-4998-B140-76332672D8E6@sys4.de> References: <438ED883-1F43-407F-8E4D-E675D22F3EDC@sys4.de> <6B8EB8B0-F672-4998-B140-76332672D8E6@sys4.de> Message-ID: <529F0AB0.8030301@Media-Brokers.com> Just fyi, you missed no answers... sorry I can't help... Maybe problem with the filesystem? Have you fsck'd it? On 2013-12-04 5:00 AM, Christian R??ner wrote: > Hi, > > just a short question: I had sent exactly this same email with a wrong email address (not the cr at sys4.de) and unfortunately I was to late deleting it in Mailman. Now I get replies to the c at roessner-network-solutions.com address, which will not succeed at the moment, because of DMARC policy. So if you already sent answers, could you please email it again to the cr at sys4.de mail. Thanks a lot in advance > > Am 04.12.2013 um 10:50 schrieb Christian R??ner : > >> Hi, >> >> I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: >> >> Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: >> Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor >> >> What could cause these error messages? >> >> My mailboxes are stored on an ext4 filesystem: >> /dev/vdb1 on /srv/mail type ext4 (rw,noatime) >> >> doveconf -n: >> # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 >> auth_master_user_separator = * >> auth_mechanisms = plain login >> auth_verbose = yes >> disable_plaintext_auth = no >> imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags >> lda_mailbox_autocreate = yes >> lda_mailbox_autosubscribe = yes >> mail_access_groups = mail >> mail_attachment_dir = /srv/mail/copymail/attachments >> mail_gid = mail >> mail_location = maildir:/srv/mail/virtual/%d/%n >> mail_plugins = quota acl zlib mail_log notify >> mail_privileged_group = mail >> mail_uid = vmail >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave >> namespace inbox { >> inbox = yes >> location = >> mailbox Drafts { >> auto = subscribe >> special_use = \Drafts >> } >> mailbox Junk-E-Mail { >> auto = subscribe >> special_use = \Junk >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> auto = subscribe >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> auto = subscribe >> special_use = \Trash >> } >> prefix = INBOX. >> } >> passdb { >> args = /usr/local/sbin/ispcp-decrypt.py >> driver = checkpassword >> } >> plugin { >> acl = vfile >> acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db >> quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota >> quota_rule = *:storage=300M:messages=20000 >> quota_status_nouser = DUNNO >> quota_status_overquota = 552 5.2.2 Mailbox is full >> quota_status_success = DUNNO >> quota_warning = storage=95%% quota-warning 95 %u >> quota_warning2 = storage=80%% quota-warning 80 %u >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> zlib_save = gz >> zlib_save_level = 6 >> } >> postmaster_address = postmaster at deltaweb.de >> protocols = imap pop3 lmtp sieve >> service auth-worker { >> extra_groups = ssl-cert >> unix_listener auth-worker { >> mode = 0600 >> user = vmail >> } >> user = vmail >> } >> service auth { >> extra_groups = ssl-cert >> unix_listener /var/spool/postfix.relay/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener auth-userdb { >> mode = 0660 >> user = vmail >> } >> user = vmail >> } >> service config { >> unix_listener config { >> mode = 0600 >> user = vmail >> } >> } >> service dict { >> unix_listener dict { >> mode = 0600 >> user = vmail >> } >> } >> service imap-login { >> inet_listener imaps { >> port = 993 >> ssl = yes >> } >> } >> service lmtp { >> inet_listener lmtp { >> address = ::1 >> port = 24 >> } >> } >> service managesieve-login { >> inet_listener sieve { >> port = 4190 >> } >> inet_listener sieve_deprecated { >> port = 2000 >> } >> } >> service pop3-login { >> inet_listener pop3s { >> port = 995 >> ssl = yes >> } >> } >> service quota-status { >> client_limit = 1 >> executable = quota-status -p postfix >> inet_listener { >> port = 12340 >> } >> } >> service quota-warning { >> executable = script /usr/local/bin/quota-warning.sh >> unix_listener quota-warning { >> user = vmail >> } >> user = dovecot >> } >> ssl_cert = > ssl_key = > userdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> protocol lmtp { >> mail_plugins = quota acl zlib mail_log notify sieve >> } >> protocol lda { >> mail_plugins = quota acl zlib mail_log notify sieve >> } >> protocol imap { >> mail_max_userip_connections = 50 >> mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib >> } >> >> Thanks in advance >> >> -Christian R??ner >> >> -- >> [*] sys4 AG >> >> http://sys4.de, +49 (89) 30 90 46 64 >> Franziskanerstra?e 15, 81669 M?nchen >> >> Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 >> Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer >> Aufsichtsratsvorsitzender: Florian Kirstein >> > -Christian R??ner > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein > -- Best regards, */Charles Marcus/* I.T. Director Media Brokers International, Inc. *678.514.6224 | 678.514.6299 fax* From CMarcus at Media-Brokers.com Wed Dec 4 12:59:44 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 04 Dec 2013 05:59:44 -0500 Subject: [Dovecot] letters local filter duplicated In-Reply-To: References: Message-ID: <529F0B20.6000002@Media-Brokers.com> On 2013-12-04 3:09 AM, John Smith wrote: > dovecot.conf =http://pastebin.com/jVnvyWZM Please post these things inline... Many people won't click on $randomlinks from $randompeople... Also, this breaks continuity for archival purposes (when the link target disappears)... -- Best regards, */Charles/* From cr at sys4.de Wed Dec 4 13:47:32 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Wed, 4 Dec 2013 12:47:32 +0100 Subject: [Dovecot] file descriptor errors In-Reply-To: <438ED883-1F43-407F-8E4D-E675D22F3EDC@sys4.de> References: <438ED883-1F43-407F-8E4D-E675D22F3EDC@sys4.de> Message-ID: Hi, Am 04.12.2013 um 10:50 schrieb Christian R??ner : > Hi, > > I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: > > Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: > Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor > I found the problem, but do not know, if my solution is okay. It is the checkpassword script that I wrote in python: ? # Return data to Dovecot try: fd = os.fdopen(dovecot_out, "w") except: sl.syslog(sl.LOG_ERR, "Can not write to FD 4") sys.exit(1) os.write(fd.fileno(), "\tuserdb_uid=%i" "\tuserdb_gid=%i" % (uid, gid)) #os.close(fd.fileno()) try: os.putenv('USER', username) os.putenv('HOME', local_part_dir) except: sl.syslog(sl.LOG_WARN, "Can not set environment variables?) ? When it comes to the os.close(fd.fileno()) call dovecot throws an error. So for now, I leave the file descriptor open and wait for the script to terminate. I thought, I would have to close the descriptor after using it, do I? -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From alexpro at homelan.lg.ua Wed Dec 4 13:49:46 2013 From: alexpro at homelan.lg.ua (=?UTF-8?B?0JDQu9C10LrRgdC10Lkg0J/RgNC+0LrQvtC/0YfRg9C6?=) Date: Wed, 04 Dec 2013 13:49:46 +0200 Subject: [Dovecot] Different settings for SSL/non-SSL protocols In-Reply-To: <529DF8C0.9040702@homelan.lg.ua> References: <529DF8C0.9040702@homelan.lg.ua> Message-ID: <529F16DA.5080308@homelan.lg.ua> Greetings 03.12.2013 17:29, ??????? ????????? ?????: > Good time of the day! > > It is possible to setup dovecot with different requirements for SSL and > non-SSL protocols? > What would I like to do: > > pop3/imap non-SSL = allowed plain text authentication. > pop3/imap with SSL = allowed plain text authentication with required > valid SSL certificates. I examined in detail dovecot's behavior with 'auth_ssl_require_client_cert=yes'. Dovecot misinterprets configuration in case with parameters: ssl = yes auth_ssl_require_client_cert = yes If ssl is not equal 'required', so not necessarily required, then unencrypted connection permissible. And case 'ssl = required' processed separately when connection begins. But dovecot answers to client with unencrypted connection "Client didn't sent a valid SSL certificate". This is wrong because with unencrypted connection can't be any certificates at all. I use dovecot-2.1.16. In auth-request-handler.c I found: if (request->set->ssl_require_client_cert && !request->valid_client_cert) { /* we fail without valid certificate */ auth_request_handler_auth_fail(handler, request, "Client didn't present valid SSL certificate"); return TRUE; } Here is need to check encrypted connection, and if connection not encrypted, condition should not be triggered. And as I said above, case with 'ssl = required' processed early and in this case we don't get to this place in code. Sources of dovecot is quite complex, and I can't find a way how to determine encrypted connection or not at this place for a while. Can you give me the hint how I can determine it? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE) From openmsk at gmail.com Wed Dec 4 14:16:29 2013 From: openmsk at gmail.com (John Smith) Date: Wed, 4 Dec 2013 16:16:29 +0400 Subject: [Dovecot] letters local filter duplicated In-Reply-To: <529F0B20.6000002@Media-Brokers.com> References: <529F0B20.6000002@Media-Brokers.com> Message-ID: OK # 2.2.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_debug = yes auth_mechanisms = plain login auth_use_winbind = yes auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no doveadm_password = pa$$word dsync_remote_cmd = doveadm dsync-server -u%u hostname = s1mx1ls.city.local listen = * mail_access_groups = vmail mail_debug = yes mail_gid = 5000 mail_location = mdbox:~/:LAYOUT=fs mail_plugins = " quota acl notify replication" mail_privileged_group = vmail mail_uid = 5000 mbox_write_locks = fcntl namespace { hidden = no list = children location = mdbox:~/:INDEX=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = dovecot driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/acls acl_shared_dict = file:/home/vmail/shared-mailboxes.db mail_replica = tcp:192.168.3.14:4092 quota = dirsize:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+10%% quota_rule3 = Sent:storage=+20%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u replication_full_sync_interval = 1 hours } service aggregator { fifo_listener replication-notify-fifo { user = vmail } process_limit = 100 process_min_avail = 3 unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { mode = 0666 user = vmail } } service config { unix_listener config { mode = 0600 user = vmail } } service doveadm { inet_listener { port = 4092 } process_limit = 100 process_min_avail = 3 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service replicator { process_limit = 100 process_min_avail = 3 unix_listener replicator-doveadm { group = vmail mode = 0660 } } ssl_cert = > On 2013-12-04 3:09 AM, John Smith wrote: > >> dovecot.conf =http://pastebin.com/jVnvyWZM >> > > Please post these things inline... > > Many people won't click on $randomlinks from $randompeople... > > Also, this breaks continuity for archival purposes (when the link target > disappears)... > > -- > > Best regards, > > */Charles/* > -- Best Regards, Evgeny Senior System Administrator OOO "Vaz Service Hurley" From alanm at sics.se Wed Dec 4 16:35:47 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Wed, 04 Dec 2013 15:35:47 +0100 Subject: [Dovecot] Ubuntu packages and broken link in docs Message-ID: <6e69ef073c65f6d3d77f0f4f55812143@sics.se> Hi, Two things: 1. Does anyone know of a good PPA with updated packages of Dovecot for Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka APT Repository. (Outdated. Could someone provide a ppa for latest stable Dovecot, please?)" 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page there is a link to a supposedly outdated PPA, the ppa page now redirects to an ad for the guys services so should probably be removed. /Alan From alexpro at homelan.lg.ua Wed Dec 4 16:49:11 2013 From: alexpro at homelan.lg.ua (=?UTF-8?B?0JDQu9C10LrRgdC10Lkg0J/RgNC+0LrQvtC/0YfRg9C6?=) Date: Wed, 04 Dec 2013 16:49:11 +0200 Subject: [Dovecot] Different settings for SSL/non-SSL protocols In-Reply-To: <529F16DA.5080308@homelan.lg.ua> References: <529DF8C0.9040702@homelan.lg.ua> <529F16DA.5080308@homelan.lg.ua> Message-ID: <529F40E7.7050300@homelan.lg.ua> Greetings 04.12.2013 13:49, ??????? ????????? ?????: > I examined in detail dovecot's behavior with > 'auth_ssl_require_client_cert=yes'. > Dovecot misinterprets configuration in case with parameters: > ssl = yes > auth_ssl_require_client_cert = yes > > If ssl is not equal 'required', so not necessarily required, then > unencrypted connection permissible. > And case 'ssl = required' processed separately when connection begins. > But dovecot answers to client with unencrypted connection "Client didn't > sent a valid SSL certificate". > This is wrong because with unencrypted connection can't be any > certificates at all. > > I use dovecot-2.1.16. > In auth-request-handler.c I found: > > if (request->set->ssl_require_client_cert && > !request->valid_client_cert) { > /* we fail without valid certificate */ > auth_request_handler_auth_fail(handler, request, > "Client didn't present valid SSL certificate"); > return TRUE; > } > > Here is need to check encrypted connection, and if connection not > encrypted, condition should not be triggered. > And as I said above, case with 'ssl = required' processed early and in > this case we don't get to this place in code. Finally, I found everything that is needed. I patched auth-request-handler.c and now: case1: ssl = yes, auth_ssl_require_client_cert = yes. If we trying to authenticate via pop3 or imap with SSL enabled, and valid certificate present, and password is correct, result is success. If we trying to authenticate via pop3 or imap with SSL enabled, and no valid certificate present - result is error. If we trying to authenticate via pop3 or imap without SSL, and password is correct - result is success. case2: ssl = required, auth_ssl_require_client_cert = yes If we trying to authenticate via pop3 or imap with SSL enabled, and valid certificate present, and password is correct, result is success. If we trying to authenticate via pop3 or imap with SSL enabled, and no valid certificate present - result is error. If we trying to authenticate via pop3 or imap without SSL - result is error (SSL connection required). Patch for dovecot-2.1.16 is attached to this message. Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE) -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-2.1.16-ssl-auth.patch Type: text/x-patch Size: 809 bytes Desc: not available URL: From metro_domain_admin at fastmail.fm Wed Dec 4 17:22:03 2013 From: metro_domain_admin at fastmail.fm (Metro Domain Admin) Date: Wed, 04 Dec 2013 10:22:03 -0500 Subject: [Dovecot] Full text search improvements In-Reply-To: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> Message-ID: <529F489B.6070900@fastmail.fm> Substring match is important to us, so we'd love to see Squat reinstated with speed improvements. It seems like Solr can handle substrings as well ([Edge]NGramFilterFactory), but for small deployments, having the engine built right in is a plus. From gilles.chauvin at univ-rouen.fr Wed Dec 4 19:02:59 2013 From: gilles.chauvin at univ-rouen.fr (Gilles Chauvin) Date: Wed, 04 Dec 2013 18:02:59 +0100 Subject: [Dovecot] Question regarding quotas (is this a bug or intended behavior) ? Message-ID: <529F6043.30405@univ-rouen.fr> Hi, I was wondering if this is a normal behavior (test was made using Dovecot v2.2.9). In my config, quotas are configured as follows: plugin { quota = dict:Userquota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_rule2 = Trash:ignore } # doveadm mailbox status -u my_user "messages vsize" '*' Trash messages=4997 vsize=229535631 Drafts messages=0 vsize=0 Sent messages=0 vsize=0 Junk messages=0 vsize=0 INBOX messages=0 vsize=0 # doveadm -f flow quota get -u my_user Quota name=Userquota Type=STORAGE Value=0 Limit=1048576 %=0 Quota name=Userquota Type=MESSAGE Value=0 Limit=- %=0 The 4997 mails in the Trash mailbox are ignored as desired, but now, if I have the following case: # doveadm mailbox status -u my_user "messages vsize" '*' Trash messages=0 vsize=0 Trash/TEST messages=4997 vsize=229535631 Drafts messages=0 vsize=0 Sent messages=0 vsize=0 Junk messages=0 vsize=0 INBOX messages=0 vsize=0 (As you can see mails were moved to a Trash/TEST mailbox) # doveadm -f flow quota get -u my_user Quota name=Userquota Type=STORAGE Value=220918 Limit=1048576 %=21 Quota name=Userquota Type=MESSAGE Value=4997 Limit=- %=0 I tried to add the following quota_rule: quota_rule3 = Trash/*:ignore But this doesn't fix anything. Do you have any idea about why this is not working ? Thanks, Regards, Gilles. From slusarz at curecanti.org Wed Dec 4 19:20:11 2013 From: slusarz at curecanti.org (Michael M Slusarz) Date: Wed, 04 Dec 2013 10:20:11 -0700 Subject: [Dovecot] Full text search improvements In-Reply-To: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> Message-ID: <20131204102011.Horde.8RLNc5s9v8hRO22bsYc1pQ1@bigworm.curecanti.org> Quoting Timo Sirainen : > 1. Support for multiple languages. Use textcat while indexing to > guess the language of the indexed data. FWIW, you could probably use the Content-Language header (if it exists) to at least give a hint. No guarantee it is correct, but it's a better starting place than simply scanning all languages. And, for that matter, you could leverage Accept-Language also (again, if it exists). Which might be more useful, since it lists all the languages the user recognizes. michael From davehall at cs.binghamton.edu Wed Dec 4 20:52:36 2013 From: davehall at cs.binghamton.edu (Dave Hall) Date: Wed, 04 Dec 2013 13:52:36 -0500 Subject: [Dovecot] Dovecot readable compressed mail archive Message-ID: <529F79F4.9020204@cs.binghamton.edu> Hello. Is Dovecot able to create and/or read any sort of compressed mail archive? We have a large installation with a few users who need to keep a large amount of email available. With maildir this means a large number of individual files, leading to additional load on our backup process. Even using a compressed mbox file as an archive would help, but only if Dovecot is able to interact with this file seamlessly while keeping current email in the maildir format. Please pardon if this is old business, but I haven't been able to find any reference to it by searching. Thanks. -Dave -- Dave Hall System Administrator Computer Science Binghamton University davehall at cs.binghamton.edu 607-760-2328 (Cell) 607-777-4641 (Office) From CMarcus at Media-Brokers.com Wed Dec 4 21:07:55 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 04 Dec 2013 14:07:55 -0500 Subject: [Dovecot] Dovecot readable compressed mail archive In-Reply-To: <529F79F4.9020204@cs.binghamton.edu> References: <529F79F4.9020204@cs.binghamton.edu> Message-ID: <529F7D8B.10809@Media-Brokers.com> On 2013-12-04 1:52 PM, Dave Hall wrote: > > Is Dovecot able to create and/or read any sort of compressed mail > archive? We have a large installation with a few users who need to > keep a large amount of email available. With maildir this means a > large number of individual files, leading to additional load on our > backup process. Even using a compressed mbox file as an archive would > help, but only if Dovecot is able to interact with this file > seamlessly while keeping current email in the maildir format. Maybe http://wiki2.dovecot.org/Plugins/Zlib helps? -- Best regards, */Charles Marcus/* I.T. Director Media Brokers International, Inc. *678.514.6224 | 678.514.6299 fax* From user+dovecot at localhost.localdomain.org Wed Dec 4 22:00:12 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 04 Dec 2013 20:00:12 +0000 Subject: [Dovecot] Ubuntu packages and broken link in docs In-Reply-To: <6e69ef073c65f6d3d77f0f4f55812143@sics.se> References: <6e69ef073c65f6d3d77f0f4f55812143@sics.se> Message-ID: <529F89CC.4040303@localhost.localdomain.org> On 12/04/2013 02:35 PM Alan McGinlay - SICS wrote: > Hi, > > Two things: > > 1. Does anyone know of a good PPA with updated packages of Dovecot for > Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka APT > Repository. (Outdated. Could someone provide a ppa for latest stable > Dovecot, please?)" I don't know how 'stable' PPAs are. There is a list of Dovecot PPAs: You may also try Stephan's auto builds: > 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page there > is a link to a supposedly outdated PPA, the ppa page now redirects to an > ad for the guys services so should probably be removed. Thanks for the info. I've removed the outdated link. Regards, Pascal -- The trapper recommends today: 5e1f1e55.1333800 at localdomain.org From manu at netbsd.org Wed Dec 4 22:29:03 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Wed, 4 Dec 2013 21:29:03 +0100 Subject: [Dovecot] BUG: Authentication client sent unknown handshake command In-Reply-To: <1ldcge4.bp80f61vfib88M%manu@netbsd.org> Message-ID: <1lddibi.199cf1h1ja7lfkM%manu@netbsd.org> Emmanuel Dreyfus wrote: > I checked with a test program: on a non open, or closed socket, > getsockname() returns -1. However on a socket that was not bound, it > returns 0 and fills the buffer with garbage. Wrong diagnostic. I am now tracking synchronisation problems between auth and imap-login. -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From craig.dovecot at noboost.org Thu Dec 5 02:27:52 2013 From: craig.dovecot at noboost.org (craig.dovecot at noboost.org) Date: Thu, 5 Dec 2013 11:27:52 +1100 Subject: [Dovecot] Postfix & Dovecot Sieve Advice Message-ID: <20131205002752.GA13360@noboost.org> Hi, I've configured up Dovecot Pigeonhole with Postfix for delivery (all working perfectly). Seeing as I'm about to use this in production, I'm just after any advice or tips people might have to safeguard email delivery from Postfix to Dovecot via LMTP? Spec: postfix-2.6.6-2.2.el6_1.x86_64 dovecot-2.0.9-5.el6.x86_64 dovecot-pigeonhole-2.0.9-5.el6.x86_64 Postfix: virtual_transport = lmtp:unix:private/dovecot-lmtp Dovecot (key settings): vim /etc/dovecot/conf.d/10-auth.conf auth_username_format = %Ln vim /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } vim /etc/dovecot/conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } vim /etc/dovecot/conf.d/90-sieve.conf plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_min_period = 1h sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d } Regards, Craig From skdovecot at smail.inf.fh-brs.de Thu Dec 5 10:40:35 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 5 Dec 2013 09:40:35 +0100 (CET) Subject: [Dovecot] Full text search improvements In-Reply-To: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, 30 Nov 2013, Timo Sirainen wrote: > 7. Don't index non-text data? For example if there is large block of > base64 data or something else that definitely doesn't look like text, > it's pretty useless to index it. Then again, we do want to index all > kinds of IDs that someone might want to search. This could be a bit > difficult to implement well. > 9. Attachments can be translated to indexable UTF-8 text already with > fts_decoder setting by doing it via a conversion script. This could also > support Apache Tika server directly. This means some kind of MIME type based (or file type guesser) "... to UTF8 text" converter script? Some users would find that very very very ^ n nice. There are already several programs used in the field of CMS. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqA8A13r2wJMiz2NAQLQYwf/bAyrg080/i2khM/XGXLlhjlcPcyxGHym KgoFFBhh2sgfl+ecRHCM4BP+WX/c5coxAScyXhSy9JjwcQz8MXUHzkbGL4d8kwa4 pgdhaD4hFhPqpOJGf1ULwBSIBEsJfZeHaOkJHlMqDgd3yKY5APoJPKJtG2z+lI+7 vqR/Pe8n8EhCcWcLC1CfEGKxcci09XYj09Sai96VGbCO2coVCm+xIKRSCW6pasoQ NTqpJBTCe2gCD3KdVA5jUNqFeEj2AQF5+nkujtSF4B1G/xrpfoABLkJ+lyQ8F5hc DTJFiHhlvJKRIIKbhuyQukeqDSzeln2UtSRce3q59fek4foFzDrhTw== =l3mf -----END PGP SIGNATURE----- From tss at iki.fi Thu Dec 5 13:33:06 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 5 Dec 2013 13:33:06 +0200 Subject: [Dovecot] Full text search improvements In-Reply-To: References: <7515F67D-13FB-451C-923D-493438246EE2@iki.fi> Message-ID: <1B48605B-7794-4D45-85C5-EA71BE3FAF99@iki.fi> On 5.12.2013, at 10.40, Steffen Kaiser wrote: >> 9. Attachments can be translated to indexable UTF-8 text already with fts_decoder setting by doing it via a conversion script. This could also support Apache Tika server directly. > > This means some kind of MIME type based (or file type guesser) "... to UTF8 text" converter script? Some users would find that very very very ^ n nice. There are already several programs used in the field of CMS. That?s already been possible since v2.1: http://hg.dovecot.org/dovecot-2.2/file/342f6962390e/src/plugins/fts/decode2text.sh From aoster at novanetwork.de Thu Dec 5 13:35:21 2013 From: aoster at novanetwork.de (Andreas Oster) Date: Thu, 05 Dec 2013 12:35:21 +0100 Subject: [Dovecot] FTS solr issue with second private namespace In-Reply-To: References: Message-ID: <52A064F9.6050606@novanetwork.de> Am 02.12.2013 12:00, schrieb Andreas Oster: > Hi all, > > I have just stumbled over an issue with the FTS plugin of dovecot. > For our primary namespace, INBOX and its subfolders, searching works > without any problems but in a second namespace, which I have created > for old/archived mails, searching of the mail text/body does not work. > I can see the search request in the tomcat log but no result is created > and the mail client (Thunderbird) keeps displaying the serach message > without returning any results. > > Tomcat6 catalina.out: > > Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute > INFO: [] webapp=/solr path=/select > params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} > hits=0 status=0 QTime=1 > > > I am currently using Dovecot 2.2.9 and do not have any special FTS config: > > mail_plugins = quota mailbox_alias fts fts_solr > > plugin { > fts = solr > fts_solr = break-imap-search url=http://localhost:8080/solr/ > fts_autoindex = yes > } > > > Thank you for your kind help > > best regards > > Andreas > > Hi all, I have recognized the following: in order to get the mails, stored in the secondary private namespace, indexed I have to manually do: doveadm index -u user -q MainArchive/ or doveadm index -A -q MainArchive/ fts_autoindex does not seem to work for other namespaces than INBOX. Is this a bug or desired functionality ? Thank you for your kind help best regards Andreas From aoster at novanetwork.de Thu Dec 5 13:35:21 2013 From: aoster at novanetwork.de (Andreas Oster) Date: Thu, 05 Dec 2013 12:35:21 +0100 Subject: [Dovecot] FTS solr issue with second private namespace In-Reply-To: References: Message-ID: <52A064F9.6050606@novanetwork.de> Am 02.12.2013 12:00, schrieb Andreas Oster: > Hi all, > > I have just stumbled over an issue with the FTS plugin of dovecot. > For our primary namespace, INBOX and its subfolders, searching works > without any problems but in a second namespace, which I have created > for old/archived mails, searching of the mail text/body does not work. > I can see the search request in the tomcat log but no result is created > and the mail client (Thunderbird) keeps displaying the serach message > without returning any results. > > Tomcat6 catalina.out: > > Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute > INFO: [] webapp=/solr path=/select > params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} > hits=0 status=0 QTime=1 > > > I am currently using Dovecot 2.2.9 and do not have any special FTS config: > > mail_plugins = quota mailbox_alias fts fts_solr > > plugin { > fts = solr > fts_solr = break-imap-search url=http://localhost:8080/solr/ > fts_autoindex = yes > } > > > Thank you for your kind help > > best regards > > Andreas > > Hi all, I have recognized the following: in order to get the mails, stored in the secondary private namespace, indexed I have to manually do: doveadm index -u user -q MainArchive/ or doveadm index -A -q MainArchive/ fts_autoindex does not seem to work for other namespaces than INBOX. Is this a bug or desired functionality ? Thank you for your kind help best regards Andreas From claus.r at bayern-mail.de Thu Dec 5 13:43:36 2013 From: claus.r at bayern-mail.de (Claus) Date: Thu, 05 Dec 2013 12:43:36 +0100 Subject: [Dovecot] backup mdbox best strategy In-Reply-To: <529CE184.4060102@sys4.de> References: <529CC7B5.8050103@bayern-mail.de> <529CE184.4060102@sys4.de> Message-ID: <52A066E8.8070702@bayern-mail.de> Am 02.12.2013 20:37, schrieb Robert Schetterer: > Am 02.12.2013 18:47, schrieb Claus: >> Hello, >> >> i have to backup (tape library) a mailsystem with about 300.000 >> Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. >> The mailstore is mdbox. >> Is it save to do a simple filesystem backup (full and incremental) with >> backupsoftware? > hm i wouldnt do that with mdbox, cause it does strongly depends to > index, but if you use dsync you could convert to maildir at backup, > maildir should be fine to store on tape, but with 2 TB this is only good > for total desaster archive, i guess it would take long time to restore > specially single mailboxes in acceptable time, from tape > Better use cheap sata storage raids for frequent backups, and do tape > snapshots sometimes. > >> What is the prefered strategy to do a backup for desaster recovery >> (mailsystem crash) and restoring single usermailboxes? > dsync should do fine > > http://wiki2.dovecot.org/Tools/Dsync > > but there is no universal answer to this, perhaps filesystem snapshots > strategy might better, it depened on your general setup , filesystems , > mailstore etc. > > wait for others report their solutions, and find the one fits best at > your place > >> >> Regards, >> Claus > > > Best Regards > MfG Robert Schetterer > thanks for your answer, the main reason we plan to use mdbox is to reduce backuptime. Now we are using Maildir on cyrus and the (full)-backup takes about 20 hours on one backend storing 150 GB of Mails in about 3 million files. Because of that we have many backends, so we can parallelize the backup prozess. greets, Claus From rs at sys4.de Thu Dec 5 13:58:21 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 05 Dec 2013 12:58:21 +0100 Subject: [Dovecot] backup mdbox best strategy In-Reply-To: <52A066E8.8070702@bayern-mail.de> References: <529CC7B5.8050103@bayern-mail.de> <529CE184.4060102@sys4.de> <52A066E8.8070702@bayern-mail.de> Message-ID: <52A06A5D.9020606@sys4.de> Am 05.12.2013 12:43, schrieb Claus: > Am 02.12.2013 20:37, schrieb Robert Schetterer: >> Am 02.12.2013 18:47, schrieb Claus: >>> Hello, >>> >>> i have to backup (tape library) a mailsystem with about 300.000 >>> Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. >>> The mailstore is mdbox. >>> Is it save to do a simple filesystem backup (full and incremental) with >>> backupsoftware? >> hm i wouldnt do that with mdbox, cause it does strongly depends to >> index, but if you use dsync you could convert to maildir at backup, >> maildir should be fine to store on tape, but with 2 TB this is only good >> for total desaster archive, i guess it would take long time to restore >> specially single mailboxes in acceptable time, from tape >> Better use cheap sata storage raids for frequent backups, and do tape >> snapshots sometimes. >> >>> What is the prefered strategy to do a backup for desaster recovery >>> (mailsystem crash) and restoring single usermailboxes? >> dsync should do fine >> >> http://wiki2.dovecot.org/Tools/Dsync >> >> but there is no universal answer to this, perhaps filesystem snapshots >> strategy might better, it depened on your general setup , filesystems , >> mailstore etc. >> >> wait for others report their solutions, and find the one fits best at >> your place >> >>> >>> Regards, >>> Claus >> >> >> Best Regards >> MfG Robert Schetterer >> > thanks for your answer, > the main reason we plan to use mdbox is to reduce backuptime. yeah but study http://wiki2.dovecot.org/MailboxFormat/dbox for diffs to maildir format, specially at restore however as i said ,dsync should play nice , beside other strategies > Now we are using Maildir on cyrus and the (full)-backup takes about 20 > hours on one backend storing 150 GB of Mails in about 3 million files. > Because of that we have many backends, so we can parallelize the backup > prozess. > > greets, Claus > > > > > > > > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From CMarcus at Media-Brokers.com Thu Dec 5 14:07:10 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 05 Dec 2013 07:07:10 -0500 Subject: [Dovecot] backup mdbox best strategy In-Reply-To: <52A066E8.8070702@bayern-mail.de> References: <529CC7B5.8050103@bayern-mail.de> <529CE184.4060102@sys4.de> <52A066E8.8070702@bayern-mail.de> Message-ID: <52A06C6E.8050708@Media-Brokers.com> On 2013-12-05 6:43 AM, Claus wrote: > Now we are using Maildir on cyrus and the (full)-backup takes about 20 > hours on one backend storing 150 GB of Mails in about 3 million files. !? What backup software are you using? Not to take away from the advantages of mdbox, but... I use rsnapshot, and am pushing the backups to an NFS mount on a cheaper NAS (QNAP) device, and the initial full backup of 300+GB of maildirs (not sure how many more millions of files, but a lot more than yours I imagine) only took about 4 or 5 hours. The subsequent runs now take anywhere from 1-2 hours... So, maybe it is your backup software that is broken? I am also planning on migrating to mdbox, for two reasons - much less files to backup (should reduce backup snapshot times to minutes, allowing me to add many more during the day), and I also want to enable SIS to reduce dramatically the overall storage requirements (we use a lot of large attachments, and I know for a fact that they are duplicated many times over, so the overall storage should be reduced by half or more)... -- Best regards, */Charles/* From bruno.galindro at gmail.com Thu Dec 5 14:17:16 2013 From: bruno.galindro at gmail.com (Bruno Galindro da Costa) Date: Thu, 5 Dec 2013 10:17:16 -0200 Subject: [Dovecot] Syslog debug messages Message-ID: Is there a way to configure dovecot to register in syslog the debug messages enabled by mail_debug=yes as a debug not as information? I need this because I want to send this kind of information only to a remote server. I've configured rsyslog to do this, but dovecot is registering those debug messages as information not as debug (as I expected). This is my rsyslog config: mail.info;\ mail.warning;\ mail.err;\ mail.crit -/var/log/mail.log mail.* :omrelp:192.168.2.162:2514 root at imap:~# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 4748). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.32-44-server x86_64 Ubuntu 10.04.4 LTS xfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve pop3s listen(default): *:143,[::]:143 listen(imap): *:143,[::]:143 listen(pop3): * listen(managesieve): * ssl_listen(default): *:993,[::]:993 ssl_listen(imap): *:993,[::]:993 ssl_listen(pop3): *:2221,[::]:2221 ssl_listen(managesieve): ssl_ca_file(default): /etc/dovecot/ca.crt ssl_ca_file(imap): /etc/dovecot/ca.crt ssl_ca_file(pop3): /etc/dovecot/ca.crt ssl_ca_file(managesieve): ssl_cert_file(default): /etc/dovecot/ufsc.br.crt ssl_cert_file(imap): /etc/dovecot/ufsc.br.crt ssl_cert_file(pop3): /etc/dovecot/ufsc.br.crt ssl_cert_file(managesieve): /etc/ssl/certs/dovecot.pem ssl_key_file(default): /etc/dovecot/ufsc.br.key ssl_key_file(imap): /etc/dovecot/ufsc.br.key ssl_key_file(pop3): /etc/dovecot/ufsc.br.key ssl_key_file(managesieve): /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_process_size: 256 login_max_processes_count: 900 login_max_connections: 1024 max_mail_processes: 2048 mail_max_userip_connections(default): 2048 mail_max_userip_connections(imap): 2048 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_privileged_group: mail mail_uid: vmail mail_gid: mail mail_location: maildir:/var/mail/mailboxes/%d/%n:INDEX=/var/mail/indexes/%d/%n mail_debug: yes fsync_disable(default): yes fsync_disable(imap): yes fsync_disable(pop3): yes fsync_disable(managesieve): no mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota autocreate trash zlib mail_plugins(imap): quota imap_quota autocreate trash zlib mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve managesieve_implementation_string(default): dovecot managesieve_implementation_string(imap): dovecot managesieve_implementation_string(pop3): dovecot managesieve_implementation_string(managesieve): Cyrus timsieved v2.2.13 lda: fsync_disable: no postmaster_address: xxx at xxx.xxx.xx mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@~ username_format: %Lu passdb: driver: checkpassword args: /etc/dovecot/passdb.v3.1.sh userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap-userdb.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: quota_exceeded_message: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx. quota: maildir:DefaultQuota quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 %u quota_warning2: storage=90%% /usr/local/bin/quota-warning.sh 90 %u trash: /etc/dovecot/dovecot-trash.conf sieve: /var/mail/sieve_scripts/%d/%n/.dovecot.sieve sieve_dir: /var/mail/sieve_scripts/%d/%n/sieve mail_log_events: delete expunge copy mailbox_delete mail_log_fields: uid box msgid from subject size vsize autocreate: Spam autosubscribe: Spam -- Att. Bruno Galindro da Costa From CMarcus at Media-Brokers.com Thu Dec 5 14:33:35 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 05 Dec 2013 07:33:35 -0500 Subject: [Dovecot] Syslog debug messages In-Reply-To: References: Message-ID: <52A0729F.30504@Media-Brokers.com> On 2013-12-05 7:17 AM, Bruno Galindro da Costa wrote: > Is there a way to configure dovecot to register in syslog the debug > messages enabled by mail_debug=yes as a debug not as information? > > I need this because I want to send this kind of information only to a > remote server. I've configured rsyslog to do this, but dovecot is > registering those debug messages as information not as debug (as I > expected). > > > This is my rsyslog config: > > mail.info;\ > mail.warning;\ > mail.err;\ > mail.crit -/var/log/mail.log > mail.* :omrelp:192.168.2.162:2514 > > > root at imap:~# dovecot -n > # 1.2.9: /etc/dovecot/dovecot.conf Maybe t his works as expected in a modern supported version? 1.x has been unsupported for a long long time. -- Best regards, */Charles/* From alanm at sics.se Thu Dec 5 22:18:01 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Thu, 05 Dec 2013 21:18:01 +0100 Subject: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam Message-ID: <04d0a36b3fa63bf81111ecc4794bedec@sics.se> Hi, I upgraded (in place upgrade, preserving my dovecot configs) to a newer release of ubuntu in order to gain access to slightly newer Dovecot release and be able to use Dsync for migration from Cyrus, here is my doveconf -n output: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-44-generic x86_64 Ubuntu 12.10 auth_debug = yes auth_default_realm = whatever.com auth_master_user_separator = * auth_socket_path = /var/run/dovecot/auth-master imapc_features = rfc822.size imapc_host = oldmail.whatever.com imapc_master_user = cyradmin imapc_password =

) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7fffb9588f40, reg_save_area = 0x7fffb9588e80}} #5 0x00000000004191e9 in imap_sync_deinit (ctx=0x1a36ae0, sync_cmd=0x19a54c0) at imap-sync.c:242 client = 0x19a48e0 status = {messages = 1983, recent = 0, unseen = 0, uidvalidity = 1290163110, uidnext = 84072, first_unseen_seq = 0, first_recent_uid = 84072, last_cached_seq = 0, highest_modseq = 1, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 1, permanent_keywords = 0, allow_new_keywords = 0} sync_status = {sync_delayed_expunges = 0} ret = 0 #6 0x000000000040b366 in idle_finish (ctx=0x19a55b0, done_ok=false, free_cmd=false) at cmd-idle.c:38 client = 0x19a48e0 #7 0x000000000040b69c in cmd_idle_continue (cmd=0x19a54c0) at cmd-idle.c:234 client = 0x19a48e0 ctx = 0x19a55b0 orig_offset = 704677 #8 0x0000000000411ffd in command_exec (cmd=0x19a54c0) at imap-commands.c:148 hook = 0x1989cd0 ret = #9 0x00000000004108da in client_command_cancel (_cmd=0x7fffb9589088) at imap-client.c:136 cmd = 0x19a54c0 cmd_ret = #10 0x000000000041178d in client_destroy (client=0x19a48e0, reason=) at imap-client.c:202 cmd = 0x0 __FUNCTION__ = "client_destroy" #11 0x00007f68af1bab56 in io_loop_call_io (io=0x1a35ad0) at ioloop.c:379 ioloop = 0x1988670 t_id = 2 #12 0x00007f68af1bbb8f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x19889e0 event = 0x1988a50 list = 0x19a5410 io = 0xff6 tv = {tv_sec = 29, tv_usec = 999250} msecs = ret = i = 0 call = false #13 0x00007f68af1baaf8 in io_loop_run (ioloop=0x1988670) at ioloop.c:398 No locals. #14 0x00007f68af1a6413 in master_service_run (service=0x1988520, callback=0xff6) at master-service.c:544 No locals. ---Type to continue, or q to quit--- #15 0x0000000000419dd4 in main (argc=1, argv=0x1988370) at main.c:389 set_roots = {0x41cf20, 0x0} login_set = {auth_socket_path = 0x1980078 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41a0b0 , failure_callback = 0x41a050 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = (gdb) And my configuration: dovecot -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 auth_cache_size = 8 M deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = always mail_location = maildir:~/Maildir mail_log_prefix = "%s(%u), session=<%{session}>: " mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl zlib expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt deny = yes driver = passwd-file } passdb { args = cache_key=%s%u webmail=192.168.1.5 driver = vpopmail } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { process_limit = 300 unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap { process_limit = 2400 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz Cloud Email Hosting -> http://www.qboxmail.com @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From michael at bigmichi1.de Thu Dec 12 10:12:55 2013 From: michael at bigmichi1.de (Michael Cramer) Date: Thu, 12 Dec 2013 09:12:55 +0100 Subject: [Dovecot] error with xz compression Message-ID: <20131212091255.Horde.hFMpjUeIeV2fS0MSpYT-2Q4@horde.bigmichi1.de> i have enabled the zlib plugin with xz compression but on some new mails i got now a segfault and the following lines in dovecot error.log Dec 12 08:51:23 imap(tester at domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/root/storage/m.3): unexpected EOF at 136004 Dec 12 08:51:23 imap(tester at domain.com): Error: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3)) failed: Invalid argument (uid=2985) Dec 12 08:51:23 imap(tester at domain.com): Error: mail parser: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3), box=Shared/root at domain.com) failed: Invalid argument Dec 12 08:52:33 indexer-worker(tester at domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/tester/storage/m.41): unexpected EOF at 4913758 the problem is that the mails can't be shown. this happens not with every mail i also got new mails that can be shown without any problem. i was not able to produce a coredump From rs at sys4.de Thu Dec 12 10:20:48 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 12 Dec 2013 09:20:48 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A96F78.3030706@skye.it> References: <52A96F78.3030706@skye.it> Message-ID: <52A971E0.2060803@sys4.de> Am 12.12.2013 09:10, schrieb Alessio Cecchi: > Hi, > > I'm running dovecot 2.1.7 you may upgrade to 2.1.17, then try again there where bugs solved http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail search list for patches and/or wait for Timo to answer with vpopmail auth and Maildir on NFS (I have > only one POP/IMAP server). All works fine but sometimes dovecot "imap" > process crush and I would like to understand why: > > Error in log files: > > Dec 12 06:32:56 pop01eeh dovecot: imap-login: Login: > user=, method=PLAIN, rip=1.2.3.4, lip=192.168.1.3, > mpid=4086, session= > Dec 12 06:50:25 pop01eeh dovecot: imap(info at mydomain.com), > session=: Disconnected: Disconnected in IDLE in=654 > out=704677 > Dec 12 06:50:25 pop01eeh dovecot: imap(info at mydomain.com), > session=: Panic: Message count decreased > Dec 12 06:50:25 pop01eeh dovecot: imap(info at mydomain.com), > session=: Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x4892a) [0x7f68af1ae92a] -> > /usr/lib/dovecot/libdovecot.so.0(+0x48976) [0x7f68af1ae976] -> > /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f68af181faf] -> > dovecot/imap() [0x4191e9] -> dovecot/imap() [0x40b366] -> dovecot/imap() > [0x40b69c] -> dovecot/imap(command_exec+0x3d) [0x411ffd] -> > dovecot/imap(client_command_cancel+0x3a) [0x4108da] -> > dovecot/imap(client_destroy+0xdd) [0x41178d] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f68af1bab56] > -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) > [0x7f68af1bbb8f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) > [0x7f68af1baaf8] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f68af1a6413] -> dovecot/imap(main+0x2a4) [0x419dd4] -> > /lib/libc.so.6(__libc_start_main+0xfd) [0x7f68aee22c8d] -> > dovecot/imap() [0x4090b9] > Dec 12 06:50:25 pop01eeh dovecot: imap(info at mydomain.com), > session=: Fatal: master: service(imap): child 4086 > killed with signal 6 (core dumped) > > > Backtrace: > > # gdb /usr/libexec/dovecot/imap /home/dovecot/core > GNU gdb (GDB) 7.0.1-debian > Copyright (C) 2009 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-linux-gnu". > For bug reporting instructions, please see: > ... > Reading symbols from /usr/libexec/dovecot/imap...done. > > warning: Can't read pathname for load map: Input/output error. > Reading symbols from /usr/lib/dovecot/libdovecot-storage.so.0...done. > Loaded symbols for /usr/lib/dovecot/libdovecot-storage.so.0 > Reading symbols from /usr/lib/dovecot/libdovecot.so.0...done. > Loaded symbols for /usr/lib/dovecot/libdovecot.so.0 > Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. > Loaded symbols for /lib/libc.so.6 > Reading symbols from /usr/lib/libssl.so.0.9.8...(no debugging symbols > found)...done. > Loaded symbols for /usr/lib/libssl.so.0.9.8 > Reading symbols from /usr/lib/libcrypto.so.0.9.8...(no debugging symbols > found)...done. > Loaded symbols for /usr/lib/libcrypto.so.0.9.8 > Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done. > Loaded symbols for /lib/libdl.so.2 > Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done. > Loaded symbols for /lib/librt.so.1 > Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols > found)...done. > Loaded symbols for /lib64/ld-linux-x86-64.so.2 > Reading symbols from /usr/lib/libz.so.1...(no debugging symbols > found)...done. > Loaded symbols for /usr/lib/libz.so.1 > Reading symbols from /lib/libpthread.so.0...(no debugging symbols > found)...done. > Loaded symbols for /lib/libpthread.so.0 > Reading symbols from /usr/lib/dovecot/lib01_acl_plugin.so...done. > Loaded symbols for /usr/lib/dovecot/lib01_acl_plugin.so > Reading symbols from /usr/lib/dovecot/lib02_imap_acl_plugin.so...done. > Loaded symbols for /usr/lib/dovecot/lib02_imap_acl_plugin.so > Reading symbols from /usr/lib/dovecot/lib10_quota_plugin.so...done. > Loaded symbols for /usr/lib/dovecot/lib10_quota_plugin.so > Reading symbols from /usr/lib/dovecot/lib11_imap_quota_plugin.so...done. > Loaded symbols for /usr/lib/dovecot/lib11_imap_quota_plugin.so > Reading symbols from /usr/lib/dovecot/lib20_expire_plugin.so...done. > Loaded symbols for /usr/lib/dovecot/lib20_expire_plugin.so > Reading symbols from /usr/lib/dovecot/lib20_zlib_plugin.so...done. > Loaded symbols for /usr/lib/dovecot/lib20_zlib_plugin.so > Reading symbols from /lib/libbz2.so.1.0...(no debugging symbols > found)...done. > Loaded symbols for /lib/libbz2.so.1.0 > Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols > found)...done. > Loaded symbols for /lib/libgcc_s.so.1 > Core was generated by `dovecot/imap'. > Program terminated with signal 6, Aborted. > #0 0x00007f68aee361b5 in raise () from /lib/libc.so.6 > (gdb) bt full > #0 0x00007f68aee361b5 in raise () from /lib/libc.so.6 > No symbol table info available. > #1 0x00007f68aee38fc0 in abort () from /lib/libc.so.6 > No symbol table info available. > #2 0x00007f68af1ae93d in default_fatal_finish (type= out>, status=0) at failures.c:191 > backtrace = 0x1980248 > "/usr/lib/dovecot/libdovecot.so.0(+0x4892a) [0x7f68af1ae92a] -> > /usr/lib/dovecot/libdovecot.so.0(+0x48976) [0x7f68af1ae976] -> > /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f68af181faf] -> > dovecot/im"... > #3 0x00007f68af1ae976 in i_internal_fatal_handler (ctx=0x7fffb9588e70, > format=, args=) at failures.c:649 > status = 0 > #4 0x00007f68af181faf in i_panic (format=0xff6
bounds>) at failures.c:263 > ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} > args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = > 0x7fffb9588f40, reg_save_area = 0x7fffb9588e80}} > #5 0x00000000004191e9 in imap_sync_deinit (ctx=0x1a36ae0, > sync_cmd=0x19a54c0) at imap-sync.c:242 > client = 0x19a48e0 > status = {messages = 1983, recent = 0, unseen = 0, uidvalidity = > 1290163110, uidnext = 84072, first_unseen_seq = 0, first_recent_uid = > 84072, > last_cached_seq = 0, highest_modseq = 1, keywords = 0x0, > permanent_flags = 0, nonpermanent_modseqs = 1, permanent_keywords = 0, > allow_new_keywords = 0} > sync_status = {sync_delayed_expunges = 0} > ret = 0 > #6 0x000000000040b366 in idle_finish (ctx=0x19a55b0, done_ok=false, > free_cmd=false) at cmd-idle.c:38 > client = 0x19a48e0 > #7 0x000000000040b69c in cmd_idle_continue (cmd=0x19a54c0) at > cmd-idle.c:234 > client = 0x19a48e0 > ctx = 0x19a55b0 > orig_offset = 704677 > #8 0x0000000000411ffd in command_exec (cmd=0x19a54c0) at > imap-commands.c:148 > hook = 0x1989cd0 > ret = > #9 0x00000000004108da in client_command_cancel (_cmd=0x7fffb9589088) at > imap-client.c:136 > cmd = 0x19a54c0 > cmd_ret = > #10 0x000000000041178d in client_destroy (client=0x19a48e0, > reason=) at imap-client.c:202 > cmd = 0x0 > __FUNCTION__ = "client_destroy" > #11 0x00007f68af1bab56 in io_loop_call_io (io=0x1a35ad0) at ioloop.c:379 > ioloop = 0x1988670 > t_id = 2 > #12 0x00007f68af1bbb8f in io_loop_handler_run (ioloop= out>) at ioloop-epoll.c:213 > ctx = 0x19889e0 > event = 0x1988a50 > list = 0x19a5410 > io = 0xff6 > tv = {tv_sec = 29, tv_usec = 999250} > msecs = > ret = > i = 0 > call = false > #13 0x00007f68af1baaf8 in io_loop_run (ioloop=0x1988670) at ioloop.c:398 > No locals. > #14 0x00007f68af1a6413 in master_service_run (service=0x1988520, > callback=0xff6) at master-service.c:544 > No locals. > ---Type to continue, or q to quit--- > #15 0x0000000000419dd4 in main (argc=1, argv=0x1988370) at main.c:389 > set_roots = {0x41cf20, 0x0} > login_set = {auth_socket_path = 0x1980078 > "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, > postlogin_timeout_secs = 60, > callback = 0x41a0b0 , failure_callback > = 0x41a050 } > service_flags = > storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT > username = 0x0 > c = > (gdb) > > And my configuration: > > dovecot -n > # 2.1.17: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 > auth_cache_size = 8 M > deliver_log_format = msgid=%m, from=%f, subject="%s": %$ > dict { > acl = mysql:/etc/dovecot/dovecot-share-folder.conf > expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > } > disable_plaintext_auth = no > dotlock_use_excl = no > first_valid_gid = 89 > first_valid_uid = 89 > last_valid_gid = 89 > last_valid_uid = 89 > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_fsync = always > mail_location = maildir:~/Maildir > mail_log_prefix = "%s(%u), session=<%{session}>: " > mail_nfs_index = yes > mail_nfs_storage = yes > mail_plugins = quota acl zlib expire > maildir_very_dirty_syncs = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character subaddress comparator-i;ascii-numeric relational regex > imap4flags copy include variables body enotify environment mailbox date > ihave vnd.dovecot.duplicate > mmap_disable = yes > namespace { > list = children > location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u > prefix = shared/%%n/ > separator = / > subscriptions = no > type = shared > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Spam { > special_use = \Junk > } > mailbox Trash { > special_use = \Trash > } > prefix = > separator = / > } > passdb { > args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt > deny = yes > driver = passwd-file > } > passdb { > args = cache_key=%s%u webmail=192.168.1.5 > driver = vpopmail > } > plugin { > acl = vfile:/etc/dovecot/global-acls:cache_secs=300 > acl_shared_dict = proxy::acl > expire = Trash > expire2 = Spam > expire_dict = proxy::expire > quota = maildir:UserQuota > quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota > quota_rule2 = Trash:storage=+100M > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/.dovecot.sieve > sieve_before = /etc/dovecot/sieve/before.sieve > sieve_dir = ~/sieve > sieve_extensions = +vnd.dovecot.duplicate -vacation > } > pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o > protocols = imap pop3 sieve > service auth { > unix_listener auth-userdb { > group = vchkpw > mode = 0660 > user = vpopmail > } > } > service dict { > process_limit = 300 > unix_listener dict { > group = vchkpw > mode = 0660 > user = vpopmail > } > } > service imap-login { > process_min_avail = 4 > service_count = 0 > } > service imap { > process_limit = 2400 > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > } > service pop3-login { > service_count = 0 > } > service quota-warning { > executable = script /etc/dovecot/scripts/quota-warning.sh > unix_listener quota-warning { > user = vpopmail > } > user = vpopmail > } > ssl_cert = ssl_key = submission_host = localhost > userdb { > args = quota_template=quota_rule=*:backend=%q > driver = vpopmail > } > protocol lda { > mail_plugins = quota acl zlib expire sieve > } > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > tb-lsub-flags > imap_idle_notify_interval = 29 mins > mail_max_userip_connections = 15 > mail_plugins = quota acl zlib expire imap_quota imap_acl > } > protocol sieve { > mail_max_userip_connections = 2 > } > protocol pop3 { > mail_max_userip_connections = 5 > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } > > Thanks Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From alessio at skye.it Thu Dec 12 10:40:58 2013 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 12 Dec 2013 09:40:58 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A971E0.2060803@sys4.de> References: <52A96F78.3030706@skye.it> <52A971E0.2060803@sys4.de> Message-ID: <52A9769A.1070906@skye.it> Il 12/12/2013 09:20, Robert Schetterer ha scritto: > Am 12.12.2013 09:10, schrieb Alessio Cecchi: >> >Hi, >> > >> >I'm running dovecot 2.1.7 > you may upgrade to 2.1.17, then try again > > there where bugs solved > > http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail > > search list for patches > > and/or wait for Timo to answer Hi Robert, I'm alreay running 2.1.17, was a typo error: dovecot -n # 2.1.17: /etc/dovecot/dovecot.conf Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz Cloud Email Hosting -> http://www.qboxmail.com @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From rs at sys4.de Thu Dec 12 10:57:12 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 12 Dec 2013 09:57:12 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A9769A.1070906@skye.it> References: <52A96F78.3030706@skye.it> <52A971E0.2060803@sys4.de> <52A9769A.1070906@skye.it> Message-ID: <52A97A68.7060708@sys4.de> Am 12.12.2013 09:40, schrieb Alessio Cecchi: > Il 12/12/2013 09:20, Robert Schetterer ha scritto: >> Am 12.12.2013 09:10, schrieb Alessio Cecchi: >>> >Hi, >>> > >>> >I'm running dovecot 2.1.7 >> you may upgrade to 2.1.17, then try again >> >> there where bugs solved >> >> http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail >> >> search list for patches >> >> and/or wait for Timo to answer > > Hi Robert, > > I'm alreay running 2.1.17, was a typo error: > > dovecot -n > # 2.1.17: /etc/dovecot/dovecot.conf > > Thanks yes i see, sorry i missed it, but looking at your backtrace i dont wanna speculate however why are using nfs for only one server ?, and why have you set maildir_very_dirty_syncs also please reread http://wiki2.dovecot.org/NFS Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From alessio at skye.it Thu Dec 12 11:13:36 2013 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 12 Dec 2013 10:13:36 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A97A68.7060708@sys4.de> References: <52A96F78.3030706@skye.it> <52A971E0.2060803@sys4.de> <52A9769A.1070906@skye.it> <52A97A68.7060708@sys4.de> Message-ID: <52A97E40.60906@skye.it> Il 12/12/2013 09:57, Robert Schetterer ha scritto: > Am 12.12.2013 09:40, schrieb Alessio Cecchi: >> Il 12/12/2013 09:20, Robert Schetterer ha scritto: >>> Am 12.12.2013 09:10, schrieb Alessio Cecchi: >>>>> Hi, >>>>> >>>>> I'm running dovecot 2.1.7 >>> you may upgrade to 2.1.17, then try again >>> >>> there where bugs solved >>> >>> http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail >>> >>> search list for patches >>> >>> and/or wait for Timo to answer >> >> Hi Robert, >> >> I'm alreay running 2.1.17, was a typo error: >> >> dovecot -n >> # 2.1.17: /etc/dovecot/dovecot.conf >> >> Thanks > > yes i see, sorry i missed it, but looking at your backtrace i dont wanna > speculate > > however why are using nfs for only one server ?, and why have you set > maildir_very_dirty_syncs I'm using NFS for HA and future scalability, I have two pop/imap/mx servers in Active/Passive configuration. I set maildir_very_dirty_syncs for "Optimizazion" since only Dovecot accesses cur/ directory (for POP/IMAP/Delivery). > also please reread > > http://wiki2.dovecot.org/NFS Yes I know ... in the next months I hope to switch to director. Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz Cloud Email Hosting -> http://www.qboxmail.com @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From michael at bigmichi1.de Thu Dec 12 11:17:06 2013 From: michael at bigmichi1.de (Michael Cramer) Date: Thu, 12 Dec 2013 10:17:06 +0100 Subject: [Dovecot] warning from managesieve Message-ID: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> when .dovecot.sieve is a symlink (which it is in my case) a warning is written to the error log file, but it still works. Dec 12 10:02:33 managesieve(tester at domain.com): Warning: sieve-storage: Active sieve script symlink /srv/vmail/sieve/domain.com/tester/.dovecot.sieve is broken: invalid/unknown path to storage (points to ingo.sieve). root at i920:/srv/vmail/sieve/domain.com/tester# ll insgesamt 20 drwx------ 3 mail mail 4096 Dez 12 10:03 ./ drwx------ 15 mail mail 4096 Dez 12 10:02 ../ lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/ From rs at sys4.de Thu Dec 12 11:19:01 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 12 Dec 2013 10:19:01 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A97E40.60906@skye.it> References: <52A96F78.3030706@skye.it> <52A971E0.2060803@sys4.de> <52A9769A.1070906@skye.it> <52A97A68.7060708@sys4.de> <52A97E40.60906@skye.it> Message-ID: <52A97F85.1070305@sys4.de> Am 12.12.2013 10:13, schrieb Alessio Cecchi: > Il 12/12/2013 09:57, Robert Schetterer ha scritto: >> Am 12.12.2013 09:40, schrieb Alessio Cecchi: >>> Il 12/12/2013 09:20, Robert Schetterer ha scritto: >>>> Am 12.12.2013 09:10, schrieb Alessio Cecchi: >>>>>> Hi, >>>>>> >>>>>> I'm running dovecot 2.1.7 >>>> you may upgrade to 2.1.17, then try again >>>> >>>> there where bugs solved >>>> >>>> http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail >>>> >>>> search list for patches >>>> >>>> and/or wait for Timo to answer >>> >>> Hi Robert, >>> >>> I'm alreay running 2.1.17, was a typo error: >>> >>> dovecot -n >>> # 2.1.17: /etc/dovecot/dovecot.conf >>> >>> Thanks >> >> yes i see, sorry i missed it, but looking at your backtrace i dont wanna >> speculate >> >> however why are using nfs for only one server ?, and why have you set >> maildir_very_dirty_syncs > > I'm using NFS for HA and future scalability, I have two pop/imap/mx > servers in Active/Passive configuration. perhaps switch to drbd > > I set maildir_very_dirty_syncs for "Optimizazion" since only Dovecot > accesses cur/ directory (for POP/IMAP/Delivery). i leave this to Timo, i am not using it > >> also please reread >> >> http://wiki2.dovecot.org/NFS > > Yes I know ... in the next months I hope to switch to director. > Thanks however ,you should always try to keep setup simple as possible Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From rs at sys4.de Thu Dec 12 11:21:07 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 12 Dec 2013 10:21:07 +0100 Subject: [Dovecot] warning from managesieve In-Reply-To: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> Message-ID: <52A98003.40209@sys4.de> Am 12.12.2013 10:17, schrieb Michael Cramer: > when .dovecot.sieve is a symlink (which it is in my case) a warning is > written to the error log file, but it still works. > > > Dec 12 10:02:33 managesieve(tester at domain.com): Warning: sieve-storage: > Active sieve script symlink > /srv/vmail/sieve/domain.com/tester/.dovecot.sieve is broken: > invalid/unknown path to storage (points to ingo.sieve). are you using horde/ingo if yes check that setup, or perhaps its left from a former horde install etc ? > > > root at i920:/srv/vmail/sieve/domain.com/tester# ll > insgesamt 20 > drwx------ 3 mail mail 4096 Dez 12 10:03 ./ > drwx------ 15 mail mail 4096 Dez 12 10:02 ../ > lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve > -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin > -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve > drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/ > > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From alessio at skye.it Thu Dec 12 11:27:59 2013 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 12 Dec 2013 10:27:59 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A97F85.1070305@sys4.de> References: <52A96F78.3030706@skye.it> <52A971E0.2060803@sys4.de> <52A9769A.1070906@skye.it> <52A97A68.7060708@sys4.de> <52A97E40.60906@skye.it> <52A97F85.1070305@sys4.de> Message-ID: <52A9819F.7010904@skye.it> Il 12/12/2013 10:19, Robert Schetterer ha scritto: > Am 12.12.2013 10:13, schrieb Alessio Cecchi: >> Il 12/12/2013 09:57, Robert Schetterer ha scritto: >>> Am 12.12.2013 09:40, schrieb Alessio Cecchi: >>>> Il 12/12/2013 09:20, Robert Schetterer ha scritto: >>>>> Am 12.12.2013 09:10, schrieb Alessio Cecchi: >>>>>>> Hi, >>>>>>> >>>>>>> I'm running dovecot 2.1.7 >>>>> you may upgrade to 2.1.17, then try again >>>>> >>>>> there where bugs solved >>>>> >>>>> http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail >>>>> >>>>> search list for patches >>>>> >>>>> and/or wait for Timo to answer >>>> >>>> Hi Robert, >>>> >>>> I'm alreay running 2.1.17, was a typo error: >>>> >>>> dovecot -n >>>> # 2.1.17: /etc/dovecot/dovecot.conf >>>> >>>> Thanks >>> >>> yes i see, sorry i missed it, but looking at your backtrace i dont wanna >>> speculate >>> >>> however why are using nfs for only one server ?, and why have you set >>> maildir_very_dirty_syncs >> >> I'm using NFS for HA and future scalability, I have two pop/imap/mx >> servers in Active/Passive configuration. > > perhaps switch to drbd I was using DRBD, on these servers, a year ago. But the data store was full and for better future scalability I prefer to switch to an external NAS. >> >> I set maildir_very_dirty_syncs for "Optimizazion" since only Dovecot >> accesses cur/ directory (for POP/IMAP/Delivery). > > i leave this to Timo, i am not using it > >> >>> also please reread >>> >>> http://wiki2.dovecot.org/NFS >> >> Yes I know ... in the next months I hope to switch to director. >> Thanks > > however ,you should always try to keep setup simple as possible Yes, you're right, but this installation could grow very quickly in the next few months and I have to be ready to add new servers. Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz Cloud Email Hosting -> http://www.qboxmail.com @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From stephan at rename-it.nl Thu Dec 12 11:38:05 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 12 Dec 2013 10:38:05 +0100 Subject: [Dovecot] warning from managesieve In-Reply-To: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> Message-ID: <52A983FD.6040700@rename-it.nl> On 12/12/2013 10:17 AM, Michael Cramer wrote: > when .dovecot.sieve is a symlink (which it is in my case) a warning is > written to the error log file, but it still works. > > > Dec 12 10:02:33 managesieve(tester at domain.com): Warning: > sieve-storage: Active sieve script symlink > /srv/vmail/sieve/domain.com/tester/.dovecot.sieve is broken: > invalid/unknown path to storage (points to ingo.sieve). > > > root at i920:/srv/vmail/sieve/domain.com/tester# ll > insgesamt 20 > drwx------ 3 mail mail 4096 Dez 12 10:03 ./ > drwx------ 15 mail mail 4096 Dez 12 10:02 ../ > lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve > -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin > -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve > drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/ > > What is your configuration? Show output from `dovecot -n`. Regards, Stephan. From rs at sys4.de Thu Dec 12 11:43:43 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 12 Dec 2013 10:43:43 +0100 Subject: [Dovecot] Dovecot 2.1.7 crash (with core dumped) In-Reply-To: <52A9819F.7010904@skye.it> References: <52A96F78.3030706@skye.it> <52A971E0.2060803@sys4.de> <52A9769A.1070906@skye.it> <52A97A68.7060708@sys4.de> <52A97E40.60906@skye.it> <52A97F85.1070305@sys4.de> <52A9819F.7010904@skye.it> Message-ID: <52A9854F.1060801@sys4.de> Am 12.12.2013 10:27, schrieb Alessio Cecchi: > Il 12/12/2013 10:19, Robert Schetterer ha scritto: >> Am 12.12.2013 10:13, schrieb Alessio Cecchi: >>> Il 12/12/2013 09:57, Robert Schetterer ha scritto: >>>> Am 12.12.2013 09:40, schrieb Alessio Cecchi: >>>>> Il 12/12/2013 09:20, Robert Schetterer ha scritto: >>>>>> Am 12.12.2013 09:10, schrieb Alessio Cecchi: >>>>>>>> Hi, >>>>>>>> >>>>>>>> I'm running dovecot 2.1.7 >>>>>> you may upgrade to 2.1.17, then try again >>>>>> >>>>>> there where bugs solved >>>>>> >>>>>> http://hg.dovecot.org/dovecot-2.1/log?rev=vpopmail >>>>>> >>>>>> search list for patches >>>>>> >>>>>> and/or wait for Timo to answer >>>>> >>>>> Hi Robert, >>>>> >>>>> I'm alreay running 2.1.17, was a typo error: >>>>> >>>>> dovecot -n >>>>> # 2.1.17: /etc/dovecot/dovecot.conf >>>>> >>>>> Thanks >>>> >>>> yes i see, sorry i missed it, but looking at your backtrace i dont >>>> wanna >>>> speculate >>>> >>>> however why are using nfs for only one server ?, and why have you set >>>> maildir_very_dirty_syncs >>> >>> I'm using NFS for HA and future scalability, I have two pop/imap/mx >>> servers in Active/Passive configuration. >> >> perhaps switch to drbd > > I was using DRBD, on these servers, a year ago. But the data store was > full and for better future scalability I prefer to switch to an external > NAS. i am not convinced nfs is a good choice, but however it should work with right config > >>> >>> I set maildir_very_dirty_syncs for "Optimizazion" since only Dovecot >>> accesses cur/ directory (for POP/IMAP/Delivery). >> >> i leave this to Timo, i am not using it >> >>> >>>> also please reread >>>> >>>> http://wiki2.dovecot.org/NFS >>> >>> Yes I know ... in the next months I hope to switch to director. >>> Thanks >> >> however ,you should always try to keep setup simple as possible > > Yes, you're right, but this installation could grow very quickly in the > next few months and I have to be ready to add new servers. so if youre going to grow ,better change to 2.2.x dove versions now > > Thanks Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Thu Dec 12 11:57:16 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 12 Dec 2013 10:57:16 +0100 (CET) Subject: [Dovecot] warning from managesieve In-Reply-To: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 12 Dec 2013, Michael Cramer wrote: > when .dovecot.sieve is a symlink (which it is in my case) a warning is > written to the error log file, but it still works. > > Dec 12 10:02:33 managesieve(tester at domain.com): Warning: sieve-storage: > Active sieve script symlink /srv/vmail/sieve/domain.com/tester/.dovecot.sieve > is broken: invalid/unknown path to storage (points to ingo.sieve). > > > root at i920:/srv/vmail/sieve/domain.com/tester# ll > insgesamt 20 > drwx------ 3 mail mail 4096 Dez 12 10:03 ./ > drwx------ 15 mail mail 4096 Dez 12 10:02 ../ > lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve > -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin > -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve > drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/ managesieve wants to have a directory to store all script in, is this file created by managesieve itself or did you migrated? Add a sieve_dir, e.g. sieve_dir ~/sieve. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqmIfV3r2wJMiz2NAQLczgf/Q6N29g5ccdwKCiomYii41gs58rv5QeJd C8vEFb7s84IiYSMGPygvZyghvsv1n1kRLTZeKk4Y6M44zutCN7WtwRN6UA63tOMD g33Ah3QYMJbNqbY0EUYib0jlK1Pjx5jCP57JDIPjuhAgTPNsxsV6nWRepxiCPqX0 rwOgzgjm8766ZI3NS9mnsIGFXarCj9m2JeMvLS0muM2H66XUhNyb2w0HVa0spymO jYJ9TGcwyUqtOigAe8BpYMRmRBCyuqg1XLl6RjTDtT9cbpMK+LY8Qb6E8a/Pa1ge +PNkjF+nGuqff8I0HZm/LCWwzOYrU/hEUWZTAPlRX+ckehsEjClGOQ== =0Z0U -----END PGP SIGNATURE----- From glance at acc.umu.se Thu Dec 12 12:26:19 2013 From: glance at acc.umu.se (Anton Lundin) Date: Thu, 12 Dec 2013 11:26:19 +0100 Subject: [Dovecot] Dovecot as caching proxy Message-ID: <20131212102618.GG5760@kennedy.acc.umu.se> Hi. I'm bin playing around with dovecot to try to setup it as a caching imap proxy. I manged to get dovecot to use both proxy=y and imapc: connections to the master server, but i haven't manged to get dovecot to cache any mails. The remote imap server is a quite hostile one, that i don't have any super/master user access to, and it only exposes imap. I've used tried both with the static passdb, nopassword=y, and imap authdb and with static and prefetch userdbs. I manage to produce the same results, eg. dovecot grabbing the password from the client and uses it to establish a imapc connection to the server and re-exposing it, and starts to write indexes. ( The later plan is probably to use pam as passdb to grab a and store a hashed copy of the password to allow offline access to the cached emails, but thats a later problem to solve.) What i haven't managed to get working is to trigger some replication of the remote emails to dovecot and using that as a cache to serve the emails to the client. I found some presentations and some emails that point in the direction that this should be possible to achieve, probably with the replication plugin, but never managed to get this to work. I'm using dovecot 2.2.9 Does anyone have manged to produce a working setup like this? //Anton -- Anton Lundin +46702-161604 From michael at bigmichi1.de Thu Dec 12 12:28:44 2013 From: michael at bigmichi1.de (Michael Cramer) Date: Thu, 12 Dec 2013 11:28:44 +0100 Subject: [Dovecot] warning from managesieve In-Reply-To: <52A983FD.6040700@rename-it.nl> References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> <52A983FD.6040700@rename-it.nl> Message-ID: <20131212112844.Horde.hkWM-q-p-Ekessw5TbCt0g1@horde.bigmichi1.de> # 2.2.9 (5c170e0786f3): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-14-generic x86_64 Ubuntu 13.10 ext4 auth_master_user_separator = * auth_mechanisms = plain login debug_log_path = /var/log/dovecot/debug.log dict { acl = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 8 first_valid_uid = 8 info_log_path = /var/log/dovecot/info.log last_valid_gid = 8 last_valid_uid = 8 log_path = /var/log/dovecot/error.log mail_gid = 8 mail_location = mdbox:/srv/vmail/mail/%d/%n:INDEX=/srv/vmail/indexes/shared/%d/%n mail_plugins = quota zlib acl expire virtual fts fts_solr mail_log notify mail_uid = 8 mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mdbox_preallocate_space = yes mdbox_rotate_size = 10 M namespace { list = children location = mdbox:/srv/vmail/mail/%%d/%%n:INDEX=/srv/vmail/indexes/shared/%%d/%%n:INDEXPVT=/srv/vmail/indexes/private/%d/%n/shared/%%u prefix = Shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { auto = subscribe special_use = \All } mailbox virtual/Flagged { auto = subscribe special_use = \Flagged } prefix = separator = / type = private } namespace virtual { location = virtual:/srv/vmail/virtual:INDEX=/srv/vmail/indexes/shared/%d/%n/virtual prefix = virtual/ separator = / } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } plugin { acl = vfile:/srv/vmail/acl:cache_secs=300 acl_anyone = allow acl_shared_dict = proxy::acl expire = Trash expire1 = Trash/* expire2 = Spam expire_dict = proxy::expire fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:28080/solr/dovecot/ quota = dict:User quota::proxy::quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = /srv/vmail/sieve/%d/%n/.dovecot.sieve sieve_default = /srv/vmail/sieve/default.sieve sieve_dir = /srv/vmail/sieve/%d/%n/ sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/sieve/global zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at domain.com protocols = " imap lmtp sieve" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0666 user = mail } } service dict { unix_listener dict { group = mail mode = 0660 user = mail } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = mail } user = dovecot } ssl_cert = : > On 12/12/2013 10:17 AM, Michael Cramer wrote: >> when .dovecot.sieve is a symlink (which it is in my case) a warning is >> written to the error log file, but it still works. >> >> >> Dec 12 10:02:33 managesieve(tester at domain.com): Warning: >> sieve-storage: Active sieve script symlink >> /srv/vmail/sieve/domain.com/tester/.dovecot.sieve is broken: >> invalid/unknown path to storage (points to ingo.sieve). >> >> >> root at i920:/srv/vmail/sieve/domain.com/tester# ll >> insgesamt 20 >> drwx------ 3 mail mail 4096 Dez 12 10:03 ./ >> drwx------ 15 mail mail 4096 Dez 12 10:02 ../ >> lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve >> -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin >> -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve >> drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/ >> >> > > What is your configuration? Show output from `dovecot -n`. > > Regards, > > Stephan. From saurabh.kumar at techblue.co.uk Thu Dec 12 12:28:39 2013 From: saurabh.kumar at techblue.co.uk (saurabh) Date: Thu, 12 Dec 2013 15:58:39 +0530 Subject: [Dovecot] managesieve error with dovecot In-Reply-To: References: <52A89846.6000709@techblue.co.uk> Message-ID: <52A98FD7.60407@techblue.co.uk> Hi Steffen, I am posting below the output of doveconf -n ############### Output of doveconf -n ###################### # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 base_dir = /var/run/dovecot/ disable_plaintext_auth = no login_greeting = ready login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_debug = yes mail_location = maildir:/mail/%d/%n/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl namespace { inbox = yes location = maildir:/mail/%d/%n/Maildir prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/lib/dovecot/sieve/global/ sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap lmtp sieve service auth { unix_listener auth-client { mode = 0666 user = dovecot } unix_listener auth-master { group = mail mode = 0664 user = mail } user = root } service lmtp { inet_listener lmtp { address = 210.7.64.62 127.0.0.1 ::1 port = 24 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 10 } ssl_cert = -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 11 Dec 2013, saurabh wrote: > >> I am using Dovecot version 2.0.9 on Centos 6.4. I have installed > > I'm not sure, if that version had old bugs, but > >> dovecot-pegionhole version 2.0.9 and Roundcube version 0.9.5 . After >> doing all the configurations. I am able to see the filters icon in >> roundcube setting. But whem I click it I get the error "could not >> connect to server" please help. >> >> >> Below are the error logs. >> >> >> ########### log from /var/log/maillog ########## >> >> Dec 11 21:41:06 eximtest dovecot: managesieve: Debug: Unknown userdb >> setting: plugin//mail/%d/%n/=/home/test > > this looks terrible wrong. > >> Dec 11 21:41:06 eximtest dovecot: managesieve(test at ayurve.co.uk): >> Debug: Effective uid=6006, gid=6000, home= > > There is no home dir for the user. > >> Dec 11 21:41:06 eximtest dovecot: managesieve(test at ayurve.co.uk): >> Debug: sieve-storage: using active sieve script path: (null) > > sieve needs a home dir. > > Post doveconf -n, or find the bug in it yourself. Maybe it's caused by > 1st error. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUqic1F3r2wJMiz2NAQLGFAf/Xh2bN6FH+9nyvUewENwFCYA8vGZxhUnQ > oH0aUWegow/X9aq+D5Q5/hKjt7OdELnnyf8qe9kED77nvAv8xvcPu19umUwpRj/g > jWdH0yl8SZH1kS7tEOhHNP8FDbTb8g2n+cB0HbKGyCPW2piUY0HcfNTLdrYjLU6Q > onnVqtmj4CDiAdRo9taB1BTmoSbadk3XRv9k8O8qdjLCF/UT0Ghq/dEua2iKARfR > LdT+pmGEIiVij0rkWpbXj+sIR5do2aoaS/W0KX5qhbxJzR64IsPem7AMsRlztnQA > eZEH9GR2u601ax7m5FWMwLw5fjLxyO+HfNx2XOvFURP8sRa6TqY1jw== > =XGTy > -----END PGP SIGNATURE----- -- Saurabh Kumar (RHCSA,RHCE,RHCVA) From voytek at sbt.net.au Thu Dec 12 12:36:10 2013 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Thu, 12 Dec 2013 21:36:10 +1100 Subject: [Dovecot] ot: tracking messages- luser troubleshooting Message-ID: <71b09c80b6ecf3a907c9f754fa0a4818.squirrel@emu.sbt.net.au> I had a user complaining of 'not getting emails' I've searched for sender in maillog, got two messages, both showed up as; Dec 12 15:51:29 emu postfix/pipe[9607]: 3F21C5E750: to=, relay=dovecot, delay=6.4, delays=6.3/0.01/0/0.12, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 12 15:51:29 emu postfix/qmgr[20178]: 3F21C5E750: removed yes the user claimed the message was not received, eventually, after traversing through severl directories, I found the message in '../Maildir/.Deleted Messages' it turns out it was inadvertenltly deleted on iphone. there has to be a better way to try to find / resolve such issues ? what's an optimal way of trying to trace such? I greped for the 3F21C5E750 string through several Maildirs tia, From giom87 at libero.it Thu Dec 12 12:37:54 2013 From: giom87 at libero.it (giom87 at libero.it) Date: Thu, 12 Dec 2013 11:37:54 +0100 (CET) Subject: [Dovecot] Panic: file buffer.c: assertion failed: (used_size <= buf->alloc) Message-ID: <726764911.4249691386844674476.JavaMail.defaultUser@defaultHost> Hi, We have a crash in dovecot 2.2.7 2013-12-11 10:38:44 imap(xxx at example.com): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) 2013-12-11 10:38:44 imap(xxx at example.com): Error: Raw backtrace: /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x672a2) [0x7f576b9742a2] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x67306) [0x7f576b974306] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f576b92eb4f] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x62d89) [0x7f576b96fd89] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x228) [0x7f576bc85488] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (mail_transaction_log_open+0xba) [0x7f576bc8229a] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(+0x8dc94) [0x7f576bc69c94] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) [0x7f576bc69ee0] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (index_storage_mailbox_open+0xad) [0x7f576bc5d0dd] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(+0x4432a) [0x7f576bc2032a] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x443ff) [0x7f576bc203ff] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x564e4) [0x7f576bc324e4] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (mailbox_open+0xf) [0x7f576bc3269f] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(mailbox_delete+0x1d) [0x7f576bc3287d] -> dovecot/imap(cmd_delete+0xb4) [0x40cc24] -> dovecot/imap(command_exec+0x3d) [0x416d0d] -> dovecot/imap() [0x415e30] -> dovecot/imap() [0x415f1d] -> dovecot/imap(client_handle_input+0x11d) [0x41619d] -> dovecot/imap (client_input+0x6f) [0x41650f] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 (io_loop_call_io+0x36) [0x7f576b983b96] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f576b984bf7] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f576b983b08] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 (master_service_run+0x13) [0x7f576b9338f3] -> dovecot/imap(main+0x2a7) [0x41fa27] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f576b598cdd] -> dovecot/imap() [0x40ab79] 2013-12-11 10:38:44 imap(xx at example.com): Fatal: master: service(imap): child 6214 killed with signal 6 (core dumped) We use CentOS 6.4: # cat /etc/issue CentOS release 6.4 (Final) The output of dovecot -n: # 2.2.7: /opt/dovecot-2.2.7/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_debug = yes auth_master_user_separator = * auth_username_format = disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = xxx.xxx.xxx.xxx port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = xxx.xxx.xxx.xxx port = 110 } inet_listener pop3s { address = xxx.xxx.xxx.xxx port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = References: <71b09c80b6ecf3a907c9f754fa0a4818.squirrel@emu.sbt.net.au> Message-ID: <52A99339.6060303@sys4.de> Am 12.12.2013 11:36, schrieb voytek at sbt.net.au: > I had a user complaining of 'not getting emails' > I've searched for sender in maillog, got two messages, both showed up as; > > Dec 12 15:51:29 emu postfix/pipe[9607]: 3F21C5E750: to=, > relay=dovecot, delay=6.4, delays=6.3/0.01/0/0.12, dsn=2.0.0, status=sent > (delivered via dovecot service) > Dec 12 15:51:29 emu postfix/qmgr[20178]: 3F21C5E750: removed > > yes the user claimed the message was not received, > > eventually, after traversing through severl directories, I found the > message in '../Maildir/.Deleted Messages' > it turns out it was inadvertenltly deleted on iphone. > > there has to be a better way to try to find / resolve such issues ? http://wiki2.dovecot.org/Plugins/MailLog > > what's an optimal way of trying to trace such? I greped for the 3F21C5E750 > string through several Maildirs > > tia, > > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Thu Dec 12 12:44:29 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 12 Dec 2013 11:44:29 +0100 (CET) Subject: [Dovecot] warning from managesieve In-Reply-To: <20131212112844.Horde.hkWM-q-p-Ekessw5TbCt0g1@horde.bigmichi1.de> References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> <52A983FD.6040700@rename-it.nl> <20131212112844.Horde.hkWM-q-p-Ekessw5TbCt0g1@horde.bigmichi1.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 12 Dec 2013, Michael Cramer wrote: > sieve = /srv/vmail/sieve/%d/%n/.dovecot.sieve > sieve_dir = /srv/vmail/sieve/%d/%n/ add a subdir to sieve_dir - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqmTjl3r2wJMiz2NAQIzEwf/TgBbqfj2L5RzYlGSy2eQpxLQYHHDwtm8 ozWoh9HBLYm3jJ9SKeubqDG82MBB8v0I2ToweMtvZh8GFcndTZf/Lvd4hapafKG0 SyLQ+vw7ZHbOzBNNnS/Sw1dF+KLw8rMNBIxbBkWiarMPTXsbzoK5CkKqJO/8U7Gr DjoGXbDQ9nwZByIjL7YRPB98ykzTVSKfMVSAQWaolPE8wMieq4enNk2Rt8+RkIO4 CjcQffspm5gnqCMzUN6ekwERRs/NankCOu95blfGjwjuUcYd0ZEdKYQ0tHGBS2X5 1CMcdRbaXJjEgLB7BGUoN4clCG2ftSgHQkKyrBUHf2Vgt9BEyzC1gQ== =eg2m -----END PGP SIGNATURE----- From rs at sys4.de Thu Dec 12 12:44:40 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 12 Dec 2013 11:44:40 +0100 Subject: [Dovecot] Panic: file buffer.c: assertion failed: (used_size <= buf->alloc) In-Reply-To: <726764911.4249691386844674476.JavaMail.defaultUser@defaultHost> References: <726764911.4249691386844674476.JavaMail.defaultUser@defaultHost> Message-ID: <52A99398.6080607@sys4.de> Am 12.12.2013 11:37, schrieb giom87 at libero.it: > Hi, > > We have a crash in dovecot 2.2.7 what about retry after upgrade to 2.2.9 ? > > 2013-12-11 10:38:44 imap(xxx at example.com): Panic: file buffer.c: line 307 > (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) > 2013-12-11 10:38:44 imap(xxx at example.com): Error: Raw backtrace: /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot.so.0(+0x672a2) [0x7f576b9742a2] -> /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot.so.0(+0x67306) [0x7f576b974306] -> /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f576b92eb4f] -> /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot.so.0(+0x62d89) [0x7f576b96fd89] -> /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x228) > [0x7f576bc85488] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 > (mail_transaction_log_open+0xba) [0x7f576bc8229a] -> /opt/dovecot-2.2.7 > /lib/dovecot/libdovecot-storage.so.0(+0x8dc94) [0x7f576bc69c94] -> /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) > [0x7f576bc69ee0] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 > (index_storage_mailbox_open+0xad) [0x7f576bc5d0dd] -> /opt/dovecot-2.2.7 > /lib/dovecot/libdovecot-storage.so.0(+0x4432a) [0x7f576bc2032a] -> /opt/dovecot- > 2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x443ff) [0x7f576bc203ff] -> > /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x564e4) > [0x7f576bc324e4] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 > (mailbox_open+0xf) [0x7f576bc3269f] -> /opt/dovecot-2.2.7 > /lib/dovecot/libdovecot-storage.so.0(mailbox_delete+0x1d) [0x7f576bc3287d] -> > dovecot/imap(cmd_delete+0xb4) [0x40cc24] -> dovecot/imap(command_exec+0x3d) > [0x416d0d] -> dovecot/imap() [0x415e30] -> dovecot/imap() [0x415f1d] -> > dovecot/imap(client_handle_input+0x11d) [0x41619d] -> dovecot/imap > (client_input+0x6f) [0x41650f] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 > (io_loop_call_io+0x36) [0x7f576b983b96] -> /opt/dovecot-2.2.7 > /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f576b984bf7] -> > /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) > [0x7f576b983b08] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 > (master_service_run+0x13) [0x7f576b9338f3] -> dovecot/imap(main+0x2a7) > [0x41fa27] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f576b598cdd] -> > dovecot/imap() [0x40ab79] > 2013-12-11 10:38:44 imap(xx at example.com): Fatal: master: service(imap): child > 6214 killed with signal 6 (core dumped) > > We use CentOS 6.4: > # cat /etc/issue > CentOS release 6.4 (Final) > > The output of dovecot -n: > > # 2.2.7: /opt/dovecot-2.2.7/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) > auth_debug = yes > auth_master_user_separator = * > auth_username_format = > disable_plaintext_auth = no > dotlock_use_excl = no > first_valid_gid = 101 > first_valid_uid = 102 > imap_id_send = > import_environment = TZ > info_log_path = /var/log/dovecot.log > log_path = /var/log/dovecot.log > log_timestamp = "%Y-%m-%d %H:%M:%S " > mail_fsync = always > mail_gid = 101 > mail_location = maildir:%h/Maildir > mail_nfs_index = yes > mail_nfs_storage = yes > mail_plugins = quota expire fts fts_lucene > mail_uid = 102 > maildir_broken_filename_sizes = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy > include variables body enotify environment mailbox date ihave > mbox_write_locks = fcntl > mmap_disable = yes > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = INBOX. > separator = . > subscriptions = yes > type = private > } > passdb { > args = /opt/dovecot-2.2.7/etc/dovecot/passwd.masterusers > driver = passwd-file > master = yes > } > passdb { > args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > passdb { > args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap-multiuser.conf > driver = ldap > master = yes > } > plugin { > fts = lucene > fts_lucene = > quota = maildir > quota_rule2 = INBOX.Trash:storage=+100M > } > protocols = imap pop3 > service anvil { > client_limit = 3000 > } > service auth { > client_limit = 4096 > unix_listener auth-userdb { > mode = 0600 > } > } > service imap-login { > inet_listener imap { > address = xxx.xxx.xxx.xxx > port = 143 > } > inet_listener imaps { > address = xxx.xxx.xxx.xxx > port = 993 > ssl = yes > } > process_limit = 2500 > process_min_avail = 5 > } > service imap { > drop_priv_before_exec = yes > process_limit = 2500 > process_min_avail = 5 > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 0 > service_count = 1 > vsz_limit = 64 M > } > service managesieve { > drop_priv_before_exec = yes > process_limit = 1024 > } > service pop3-login { > inet_listener pop3 { > address = xxx.xxx.xxx.xxx > port = 110 > } > inet_listener pop3s { > address = xxx.xxx.xxx.xxx > port = 995 > ssl = yes > } > process_limit = 300 > process_min_avail = 5 > } > service pop3 { > drop_priv_before_exec = yes > process_limit = 300 > process_min_avail = 5 > } > ssl_cert = ssl_key = userdb { > args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > protocol lmtp { > mail_plugins = quota expire fts fts_lucene sieve > } > protocol lda { > mail_plugins = quota expire fts fts_lucene sieve > } > protocol imap { > mail_plugins = quota imap_quota > } > protocol pop3 { > mail_plugins = quota > pop3_uidl_format = UID%u-%v > } > > Thanks > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Thu Dec 12 12:48:38 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 12 Dec 2013 11:48:38 +0100 (CET) Subject: [Dovecot] managesieve error with dovecot In-Reply-To: <52A98FD7.60407@techblue.co.uk> References: <52A89846.6000709@techblue.co.uk> <52A98FD7.60407@techblue.co.uk> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 12 Dec 2013, saurabh wrote: What's in /etc/dovecot/dovecot-ldap.conf.ext ? The erroreous Debug: Unknown userdb setting: plugin//mail/%d/%n/=/home/test seems to come from there. > I am posting below the output of doveconf -n > > > ############### Output of doveconf -n ###################### > > > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-358.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 > base_dir = /var/run/dovecot/ > disable_plaintext_auth = no > login_greeting = ready > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c > mail_debug = yes > mail_location = maildir:/mail/%d/%n/Maildir > mail_plugins = " quota" > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date > mbox_write_locks = fcntl > namespace { > inbox = yes > location = maildir:/mail/%d/%n/Maildir > prefix = > separator = / > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > sieve_global_dir = /var/lib/dovecot/sieve/global/ > sieve_global_path = /var/lib/dovecot/sieve/default.sieve > } > protocols = imap lmtp sieve > service auth { > unix_listener auth-client { > mode = 0666 > user = dovecot > } > unix_listener auth-master { > group = mail > mode = 0664 > user = mail > } > user = root > } > service lmtp { > inet_listener lmtp { > address = 210.7.64.62 127.0.0.1 ::1 > port = 24 > } > unix_listener lmtp { > mode = 0666 > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 1 > service_count = 1 > vsz_limit = 64 M > } > service managesieve { > process_limit = 10 > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol imap { > mail_plugins = " quota imap_quota" > } > protocol sieve { > info_log_path = /var/log/dovecot-sieve.log > log_path = /var/log/dovecot-sieve-errors.log > managesieve_implementation_string = dovecot > managesieve_max_line_length = 65536 > } > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > hostname = 210.7.64.62 > info_log_path = /var/log/dovecot-lda.log > log_path = /var/log/dovecot-lda-errors.log > mail_plugins = " quota sieve" > postmaster_address = test at ayurve.com > } > protocol lmtp { > info_log_path = /var/log/dovecot-lmtp.log > log_path = /var/log/dovecot-lmtp-errors.log > mail_plugins = " quota sieve" > } > > > Please suggest what changes shall I make in-order to get it working. > > > Thanks, > Saurabh. > > On Wednesday 11 December 2013 10:41 PM, Steffen Kaiser wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Wed, 11 Dec 2013, saurabh wrote: >> >>> I am using Dovecot version 2.0.9 on Centos 6.4. I have installed >> >> I'm not sure, if that version had old bugs, but >> >>> dovecot-pegionhole version 2.0.9 and Roundcube version 0.9.5 . After doing >>> all the configurations. I am able to see the filters icon in roundcube >>> setting. But whem I click it I get the error "could not connect to server" >>> please help. >>> >>> >>> Below are the error logs. >>> >>> >>> ########### log from /var/log/maillog ########## >>> >>> Dec 11 21:41:06 eximtest dovecot: managesieve: Debug: Unknown userdb >>> setting: plugin//mail/%d/%n/=/home/test >> >> this looks terrible wrong. >> >>> Dec 11 21:41:06 eximtest dovecot: managesieve(test at ayurve.co.uk): Debug: >>> Effective uid=6006, gid=6000, home= >> >> There is no home dir for the user. >> >>> Dec 11 21:41:06 eximtest dovecot: managesieve(test at ayurve.co.uk): Debug: >>> sieve-storage: using active sieve script path: (null) >> >> sieve needs a home dir. >> >> Post doveconf -n, or find the bug in it yourself. Maybe it's caused by 1st >> error. >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBUqic1F3r2wJMiz2NAQLGFAf/Xh2bN6FH+9nyvUewENwFCYA8vGZxhUnQ >> oH0aUWegow/X9aq+D5Q5/hKjt7OdELnnyf8qe9kED77nvAv8xvcPu19umUwpRj/g >> jWdH0yl8SZH1kS7tEOhHNP8FDbTb8g2n+cB0HbKGyCPW2piUY0HcfNTLdrYjLU6Q >> onnVqtmj4CDiAdRo9taB1BTmoSbadk3XRv9k8O8qdjLCF/UT0Ghq/dEua2iKARfR >> LdT+pmGEIiVij0rkWpbXj+sIR5do2aoaS/W0KX5qhbxJzR64IsPem7AMsRlztnQA >> eZEH9GR2u601ax7m5FWMwLw5fjLxyO+HfNx2XOvFURP8sRa6TqY1jw== >> =XGTy >> -----END PGP SIGNATURE----- > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqmUhl3r2wJMiz2NAQJSEwf+LYMQj7Uq+DclZ1wbzE5NxcelA+444HEM YCXC2xCSSOYNMeDO9p/nyDjP+T9uDSiNyEssTcTbG+PcC3lnWT6bfhoc08qF2kpi HzaU8SjD7ZynmBlzQF4Z1oAXp51S+wv6Cw4G40BwMHiQ7k/Y5i8DyzCG58b1xkvR rcBLbLFEDAMQX5munFkXogNECa+RorxOShUIyaOg1oFz7GRyzl1LDvyS9Mt7u2lN x2NYu0s/KErOJZCmooC1iOm8Cwlo7YXKPH3kM36/CTwEf64McHQ+Vl+Y4m7AT5a0 lX79Og4yReYafCd6ypCB2vw8dc7mAqxkk4Ju35x848Cb7X/u7P7LGA== =HVQU -----END PGP SIGNATURE----- From andreas.schulze at datev.de Thu Dec 12 13:05:43 2013 From: andreas.schulze at datev.de (Andreas Schulze) Date: Thu, 12 Dec 2013 12:05:43 +0100 Subject: [Dovecot] auth failures Message-ID: <20131212110543.GA4702@spider.services.datevnet.de> Hello, last week and today our dovecot pop3 server stopped responding. Without any other logentries dovecot start to log only this: Dec 12 09:14:12 mbox1 dovecot: auth: Error: ldap(testuser,192.0.2.110,): ldap_search(base=ou=accounts,dc=example,dc=de filter=(&(|(uid=testuser)(mail=testuser))(!(state=blocked)))) failed: Operations error For every pop3 Session, ~2000 per Minute ..., over 10 Minutes I send dovecot a SIGTERM. After dovecot was started again, all was fine again. # doveconf -n http://postmaster.datev.de/tmp/dovecot.conf The LDAP-Server itself did resond to queries in the same timeframe. I know this because the MTA on the same host was able to deliver messages into mailboxes. Any hints? Thanks Andreas -- Andreas Schulze Internetdienste | P252 DATEV eG 90329 N?rnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 N?rnberg, Paumgartnerstr. 6-14 | Registergericht N?rnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Dipl.-Kfm. Dr. Robert Mayr J?rg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen From saurabh.kumar at techblue.co.uk Thu Dec 12 13:11:53 2013 From: saurabh.kumar at techblue.co.uk (saurabh) Date: Thu, 12 Dec 2013 16:41:53 +0530 Subject: [Dovecot] managesieve error with dovecot In-Reply-To: References: <52A89846.6000709@techblue.co.uk> <52A98FD7.60407@techblue.co.uk> Message-ID: <52A999F9.7040406@techblue.co.uk> Hi, Here's what is written in dovecot-ldap.conf.ext file. hosts = 192.168.100.204 dn = cn=dovecot,ou=people,dc=techblue,dc=co,dc=uk dnpass = password ldap_version = 3 base = dc=techblue,dc=co,dc=uk deref = never scope = subtree user_attrs = homeDirectory=/mail/%d/%n/, uidNumber=uid, gidNumber=gid user_filter = (&(objectClass=inetOrgPerson)(mail=%u)) pass_attrs = userPassword=password pass_filter = (&(objectClass=inetOrgPerson)(mail=%u)) default_pass_scheme = SSHA Thanks, Saurabh On Thursday 12 December 2013 04:18 PM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 12 Dec 2013, saurabh wrote: > > What's in /etc/dovecot/dovecot-ldap.conf.ext ? > The erroreous Debug: Unknown userdb setting: > plugin//mail/%d/%n/=/home/test > seems to come from there. > >> I am posting below the output of doveconf -n >> >> >> ############### Output of doveconf -n ###################### >> >> >> # 2.0.9: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-358.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 >> base_dir = /var/run/dovecot/ >> disable_plaintext_auth = no >> login_greeting = ready >> login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c >> mail_debug = yes >> mail_location = maildir:/mail/%d/%n/Maildir >> mail_plugins = " quota" >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character vacation subaddress comparator-i;ascii-numeric >> relational regex imap4flags copy include variables body enotify >> environment mailbox date >> mbox_write_locks = fcntl >> namespace { >> inbox = yes >> location = maildir:/mail/%d/%n/Maildir >> prefix = >> separator = / >> type = private >> } >> passdb { >> args = /etc/dovecot/dovecot-ldap.conf.ext >> driver = ldap >> } >> plugin { >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> sieve_global_dir = /var/lib/dovecot/sieve/global/ >> sieve_global_path = /var/lib/dovecot/sieve/default.sieve >> } >> protocols = imap lmtp sieve >> service auth { >> unix_listener auth-client { >> mode = 0666 >> user = dovecot >> } >> unix_listener auth-master { >> group = mail >> mode = 0664 >> user = mail >> } >> user = root >> } >> service lmtp { >> inet_listener lmtp { >> address = 210.7.64.62 127.0.0.1 ::1 >> port = 24 >> } >> unix_listener lmtp { >> mode = 0666 >> } >> } >> service managesieve-login { >> inet_listener sieve { >> port = 4190 >> } >> process_min_avail = 1 >> service_count = 1 >> vsz_limit = 64 M >> } >> service managesieve { >> process_limit = 10 >> } >> ssl_cert = > ssl_key = > userdb { >> driver = prefetch >> } >> userdb { >> args = /etc/dovecot/dovecot-ldap.conf.ext >> driver = ldap >> } >> protocol imap { >> mail_plugins = " quota imap_quota" >> } >> protocol sieve { >> info_log_path = /var/log/dovecot-sieve.log >> log_path = /var/log/dovecot-sieve-errors.log >> managesieve_implementation_string = dovecot >> managesieve_max_line_length = 65536 >> } >> protocol lda { >> auth_socket_path = /var/run/dovecot/auth-master >> hostname = 210.7.64.62 >> info_log_path = /var/log/dovecot-lda.log >> log_path = /var/log/dovecot-lda-errors.log >> mail_plugins = " quota sieve" >> postmaster_address = test at ayurve.com >> } >> protocol lmtp { >> info_log_path = /var/log/dovecot-lmtp.log >> log_path = /var/log/dovecot-lmtp-errors.log >> mail_plugins = " quota sieve" >> } >> >> >> Please suggest what changes shall I make in-order to get it working. >> >> >> Thanks, >> Saurabh. >> >> On Wednesday 11 December 2013 10:41 PM, Steffen Kaiser wrote: >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Wed, 11 Dec 2013, saurabh wrote: >>> >>>> I am using Dovecot version 2.0.9 on Centos 6.4. I have installed >>> >>> I'm not sure, if that version had old bugs, but >>> >>>> dovecot-pegionhole version 2.0.9 and Roundcube version 0.9.5 . >>>> After doing all the configurations. I am able to see the filters >>>> icon in roundcube setting. But whem I click it I get the error >>>> "could not connect to server" please help. >>>> >>>> >>>> Below are the error logs. >>>> >>>> >>>> ########### log from /var/log/maillog ########## >>>> >>>> Dec 11 21:41:06 eximtest dovecot: managesieve: Debug: Unknown >>>> userdb setting: plugin//mail/%d/%n/=/home/test >>> >>> this looks terrible wrong. >>> >>>> Dec 11 21:41:06 eximtest dovecot: managesieve(test at ayurve.co.uk): >>>> Debug: Effective uid=6006, gid=6000, home= >>> >>> There is no home dir for the user. >>> >>>> Dec 11 21:41:06 eximtest dovecot: managesieve(test at ayurve.co.uk): >>>> Debug: sieve-storage: using active sieve script path: (null) >>> >>> sieve needs a home dir. >>> >>> Post doveconf -n, or find the bug in it yourself. Maybe it's caused >>> by 1st error. >>> >>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1.4.11 (GNU/Linux) >>> >>> iQEVAwUBUqic1F3r2wJMiz2NAQLGFAf/Xh2bN6FH+9nyvUewENwFCYA8vGZxhUnQ >>> oH0aUWegow/X9aq+D5Q5/hKjt7OdELnnyf8qe9kED77nvAv8xvcPu19umUwpRj/g >>> jWdH0yl8SZH1kS7tEOhHNP8FDbTb8g2n+cB0HbKGyCPW2piUY0HcfNTLdrYjLU6Q >>> onnVqtmj4CDiAdRo9taB1BTmoSbadk3XRv9k8O8qdjLCF/UT0Ghq/dEua2iKARfR >>> LdT+pmGEIiVij0rkWpbXj+sIR5do2aoaS/W0KX5qhbxJzR64IsPem7AMsRlztnQA >>> eZEH9GR2u601ax7m5FWMwLw5fjLxyO+HfNx2XOvFURP8sRa6TqY1jw== >>> =XGTy >>> -----END PGP SIGNATURE----- >> >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUqmUhl3r2wJMiz2NAQJSEwf+LYMQj7Uq+DclZ1wbzE5NxcelA+444HEM > YCXC2xCSSOYNMeDO9p/nyDjP+T9uDSiNyEssTcTbG+PcC3lnWT6bfhoc08qF2kpi > HzaU8SjD7ZynmBlzQF4Z1oAXp51S+wv6Cw4G40BwMHiQ7k/Y5i8DyzCG58b1xkvR > rcBLbLFEDAMQX5munFkXogNECa+RorxOShUIyaOg1oFz7GRyzl1LDvyS9Mt7u2lN > x2NYu0s/KErOJZCmooC1iOm8Cwlo7YXKPH3kM36/CTwEf64McHQ+Vl+Y4m7AT5a0 > lX79Og4yReYafCd6ypCB2vw8dc7mAqxkk4Ju35x848Cb7X/u7P7LGA== > =HVQU > -----END PGP SIGNATURE----- -- Saurabh Kumar System Admin (RHCSA,RHCE,RHCVA) FOR AND ON BEHALF OF: Techblue Software Pvt. Ltd. 73, Sector-5 IMT Manesar Haryana E: saurabh.kumar at techblue.co.uk W: www.techblue.co.uk The contents of this email are confidential and may be privileged, and are intended only for the use of the person or company named herein. Any views or opinions presented are solely those of the author and do not necessarily represent those of Technology Blueprint Limited. If you are not the intended recipient of this email or a person responsible for delivering it to the intended recipient, you are hereby notified that any distribution, copying or dissemination of the information herein is strictly prohibited From michael at bigmichi1.de Thu Dec 12 13:30:51 2013 From: michael at bigmichi1.de (Michael Cramer) Date: Thu, 12 Dec 2013 12:30:51 +0100 Subject: [Dovecot] warning from managesieve In-Reply-To: References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> <52A983FD.6040700@rename-it.nl> <20131212112844.Horde.hkWM-q-p-Ekessw5TbCt0g1@horde.bigmichi1.de> Message-ID: <20131212123051.Horde.ciEndHQl0Hp9FpR2lCWB9g1@horde.bigmichi1.de> after adding a dir the warning is gone, thx, i think i misread the wiki page Zitat von Steffen Kaiser : > On Thu, 12 Dec 2013, Michael Cramer wrote: > >> sieve = /srv/vmail/sieve/%d/%n/.dovecot.sieve >> sieve_dir = /srv/vmail/sieve/%d/%n/ > > add a subdir to sieve_dir > > - -- > Steffen Kaiser From stephan at rename-it.nl Thu Dec 12 13:37:29 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 12 Dec 2013 12:37:29 +0100 Subject: [Dovecot] warning from managesieve In-Reply-To: <20131212123051.Horde.ciEndHQl0Hp9FpR2lCWB9g1@horde.bigmichi1.de> References: <20131212101706.Horde.AoKOHrWPbl7TOfu4HQu3-Q1@horde.bigmichi1.de> <52A983FD.6040700@rename-it.nl> <20131212112844.Horde.hkWM-q-p-Ekessw5TbCt0g1@horde.bigmichi1.de> <20131212123051.Horde.ciEndHQl0Hp9FpR2lCWB9g1@horde.bigmichi1.de> Message-ID: <52A99FF9.3010803@rename-it.nl> Michael Cramer schreef op 12-12-2013 12:30: > after adding a dir the warning is gone, thx, i think i misread the > wiki page > The subdir solution is a good one; it is a bad idea to put the active symlink inside the script storage directory. However, this is not the direct cause of the warning. There was a bug in Pigeonhole that makes it sensitive to a trailing slash in the sieve_dir setting. Regards, Stephan. From rrosenfeld at netcologne.de Thu Dec 12 13:47:34 2013 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Thu, 12 Dec 2013 12:47:34 +0100 Subject: [Dovecot] Size detection/replair does not work with zlib Message-ID: <20131212114734.GA18852@sys-241.netcologne.de> Hi! Usually dovecot auto detects or repairs the size of a maildir message. So I can place a message named "foo" in the cur directory and dovecot uses it. Now I tried the same with a zlib compressed message but here dovecot doesn't recognize/repair the size of the message. When I access this folder via IMAP the connection is diconnected and in dovecot logs I see the following error messages: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read() failed: Input/output error (FETCH for mailbox INBOX UID 23) Disconnected: Internal error occurred. Refer to server log for more information. [2013-12-12 10:54:18] in=321 out=1977 As you can see in the first line, dovecot does know the compressed size of the file (805) as well as the uncompressed size (2666), but it isn't able to repair its index for this. If I modify the setup a little with a standard file naming but with a wrong file size in S-flag (compressed size instead of uncompressed size), the log entries become stranger: Error: Cached message size smaller than expected (805 < 2666) Error: Maildir filename has wrong S value, renamed the file from /somedir/cur/1386772057.M152553P9709.host,S=805:2, to /somedir/cur/1386772057.M152553P9709.host,S=805:2, So here dovecot detects the wrong S value, but instead of fixing it by using the uncompressed size, it renames to the same file name as before... All the above was tested with dovecot 2.1.17. We did a short cross test with 2.2.9 which gives somewhat different error messages, but also isn't able to detect/repair the (uncompressed) file size: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read(zlib(/somedir/cur/foo)) failed: Invalid argument We also noticed that on both dovecot versions after trying to access the above file, dovecot.index.cache is always deleted and not rebuild... Is all this intended behavior? It sounds different to the standard behavior of dovecot, that repairs broken folders if possible... Ciao Roland From jim.reid at uninett.no Thu Dec 12 13:50:38 2013 From: jim.reid at uninett.no (Jim Reid) Date: Thu, 12 Dec 2013 11:50:38 +0000 Subject: [Dovecot] what's wrong with this config file? Message-ID: Hi. I'm setting up a new IMAPS server. Mail users don't have login access to the box but will each have unique UNIX-style UIDs: no back-end database or LDAP thing. So far. Their mail will get delivered to UNIX-style mailboxes in /var/mail/%u (where %u is the UNIX username obviously). Their IMAP folders will go in /var/imap/%u. These will contain subfolders once everyone migrates to the new set-up and some folders will contain messages and subfolders. I think this is what I configured in dovecot. However when I try to set up a test account, dovecot reports the following error: Dec 12 02:22:00 shaun dovecot: imap-login: Login: user=, method=CRAM-MD5, rip=10.0.0.1, lip=10.1.1.1, mpid=14874, TLS, session=<8Hy1Ak3t+gDDNulD> Dec 12 02:22:00 shaun dovecot: imap(jim): Error: user jim: Initialization failed: namespace configuration error: Duplicate namespace prefix: "" Dec 12 02:22:00 shaun dovecot: imap(jim): Error: Invalid user settings. Refer to server log for more information. I've checked and re-checked the wiki. google was unable to suggest any explanation either. Any ideas what's wrong? There is no duplicate namespace (and/or prefix) that I can see below. # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.2-RELEASE amd64 auth_mechanisms = cram-md5 auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 120 director_username_hash = %Lu import_environment = TZ listen = *, [::] mail_debug = yes mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl namespace { disabled = no hidden = yes ignore_on_failure = no inbox = yes list = yes location = mbox:~/mail:INBOX=/var/mail/%u prefix = "#mbox/" separator = / subscriptions = yes type = private } namespace imapstuff { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/imap/%u:LAYOUT=fs prefix = separator = / subscriptions = yes type = private } namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Drafts { auto = no driver = special_use = \Drafts } mailbox Junk { auto = no driver = special_use = \Junk } mailbox Sent { auto = no driver = special_use = \Sent } mailbox "Sent Messages" { auto = no driver = special_use = \Sent } mailbox Trash { auto = no driver = special_use = \Trash } prefix = separator = subscriptions = yes type = private } passdb { driver = pam } passdb { driver = pam } passdb { args = /usr/local/etc/dovecot-md5 driver = passwd-file } protocols = imap service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 32 drop_priv_before_exec = no executable = /usr/local/libexec/dovecot/imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 0 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 8 process_min_avail = 3 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = /usr/local/libexec/dovecot/imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 32 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 32 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 8 process_min_avail = 3 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 32 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = mode = 00 user = $default_internal_user } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } unix_listener ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } ssl_cert = References: <52A89846.6000709@techblue.co.uk> <52A98FD7.60407@techblue.co.uk> <52A999F9.7040406@techblue.co.uk> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 12 Dec 2013, saurabh wrote: > user_attrs = homeDirectory=/mail/%d/%n/, uidNumber=uid, gidNumber=gid That's it, If you want to use a static home dir pattern, write: user_attrs = =home=/mail/%d/%n/, uidNumber=uid, gidNumber=gid Note the =home= syntax, one = in front of and one after "home". You said: "The value of the LDAP attribute homeDirectory is stored in setting /mail/%d/%n". If that fails, too, because I do not know, if %d and %n variables are accepted in that config file, use: user_attrs = uidNumber=uid, gidNumber=gid and update the userdb {} setting to: userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap # Default fields can be used to specify defaults that LDAP may override default_fields = home=/mail/%d/%n/ } Note: This time just home=, no = in front of "home". - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqmmoF3r2wJMiz2NAQKGbggAjUZMlSDgfeyLha856V+lZhCvS0b66IB7 7ZxP7Jxph3VzfbUUIJ61AjglHSPp4dud+9L5/NK0wJFylPUlqImctHjf3ucTwUmw TUvLQ6W2Fdu/wiSPd/h48VLuS09vFz760pvuCTUlP9eD3SzokmRatvTwhikcFkSI LCV2Mekzc/wxVtzcYejmBCnH0q0LMxNN2qN5P+AiSpVuYiTNQM5Dnjf+VfvmV5kl G2oVVihJ5eZqh4jeQs5XuiR/2cqgAi5lnGQekEBRqr0YEevbHFIlkxlqqx5xk2aV PqHrkE+f5AaXSCM3b4beScMnEEIhW0Egz//G3xlR3UGg1xF7zPDRDg== =gdr9 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Dec 12 14:16:55 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 12 Dec 2013 13:16:55 +0100 (CET) Subject: [Dovecot] what's wrong with this config file? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 12 Dec 2013, Jim Reid wrote: > I think this is what I configured in dovecot. However when I try to set up a test account, dovecot reports the following error: > > Dec 12 02:22:00 shaun dovecot: imap-login: Login: user=, method=CRAM-MD5, rip=10.0.0.1, lip=10.1.1.1, mpid=14874, TLS, session=<8Hy1Ak3t+gDDNulD> > Dec 12 02:22:00 shaun dovecot: imap(jim): Error: user jim: Initialization failed: namespace configuration error: Duplicate namespace prefix: "" See that error and > # 2.2.9: /usr/local/etc/dovecot/dovecot.conf > namespace imapstuff { > prefix = > type = private > } > namespace inbox { > prefix = > type = private > } Rename imapstuff to inbox, or something. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqmpN13r2wJMiz2NAQKYQAgAuhvxFLLUzLvD0B18D1KSuSZMrDE146w3 8kJWsG0ShMRz+DqFVQmMEiPnysgNzWp/ZPy0buBvzbtOqq5L/3QRycEudliwnUrw AUSPCZ+5AxsZqM582JS0U0+pz7yve8XYYPzJWm2gUOzqLmBiiGjCM6JbLUGd7VyG EUesXqcNOkSSfr89vfXa3d7/roxShhvD4Z7669UtNp5ttnl94BKG2fn/uOd6527U GqjtbUD2GAUlovhtbtvtmAguGEMS3Ym0UN9as/zd21NsBtyr8OoplO6rjsDI2qNu E74mP1Zi51yrO53mblFnmtz6IwicToNf+C6fwjt0+KUhm6Vf+GRP1A== =3OtW -----END PGP SIGNATURE----- From alanm at sics.se Thu Dec 12 14:32:14 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Thu, 12 Dec 2013 13:32:14 +0100 Subject: [Dovecot] =?utf-8?q?what=27s_wrong_with_this_config_file=3F?= In-Reply-To: References: Message-ID: <4c5a2bc4d7382177f76cf437c6615a96@sics.se> On 2013-12-12 13:16, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 12 Dec 2013, Jim Reid wrote: > > I think this is what I configured in dovecot. However when I try to > set up a test account, dovecot reports the following error: > > Dec 12 02:22:00 shaun dovecot: imap-login: Login: user=, > method=CRAM-MD5, rip=10.0.0.1, lip=10.1.1.1, mpid=14874, TLS, > session=<8Hy1Ak3t+gDDNulD> > Dec 12 02:22:00 shaun dovecot: imap(jim): Error: user jim: > Initialization failed: namespace configuration error: Duplicate > namespace prefix: "" > > See that error and > > # 2.2.9: /usr/local/etc/dovecot/dovecot.conf > namespace imapstuff { > prefix = > type = private > } > namespace inbox { > prefix = > type = private > } > > Rename imapstuff to inbox, or something. > Uh, isn't it just to add something to one of the prefix lines? prefix = whatever On one of the namespaces should fix the duplicate name (which is an empty string on both just now) From saurabh.kumar at techblue.co.uk Thu Dec 12 14:46:03 2013 From: saurabh.kumar at techblue.co.uk (saurabh) Date: Thu, 12 Dec 2013 18:16:03 +0530 Subject: [Dovecot] managesieve error with dovecot In-Reply-To: References: <52A89846.6000709@techblue.co.uk> <52A98FD7.60407@techblue.co.uk> <52A999F9.7040406@techblue.co.uk> Message-ID: <52A9B00B.5090100@techblue.co.uk> Hi Steffen, Thanks a ton. You idea helped me get out of the error. user_attrs = =home=/mail/%d/%n/, uidNumber=uid, gidNumber=gid this worked well without any error. Thanks for you valuable time and support. Regards, Saurabh On Thursday 12 December 2013 05:35 PM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 12 Dec 2013, saurabh wrote: > >> user_attrs = homeDirectory=/mail/%d/%n/, uidNumber=uid, gidNumber=gid > > That's it, > > If you want to use a static home dir pattern, write: > > user_attrs = =home=/mail/%d/%n/, uidNumber=uid, gidNumber=gid > > Note the =home= syntax, one = in front of and one after "home". You said: > "The value of the LDAP attribute homeDirectory is stored in setting > /mail/%d/%n". > > If that fails, too, because I do not know, if %d and %n variables > are accepted in that config file, use: > > user_attrs = uidNumber=uid, gidNumber=gid > > and update the userdb {} setting to: > > userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > > # Default fields can be used to specify defaults that LDAP may override > default_fields = home=/mail/%d/%n/ > > } > > Note: This time just home=, no = in front of "home". > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUqmmoF3r2wJMiz2NAQKGbggAjUZMlSDgfeyLha856V+lZhCvS0b66IB7 > 7ZxP7Jxph3VzfbUUIJ61AjglHSPp4dud+9L5/NK0wJFylPUlqImctHjf3ucTwUmw > TUvLQ6W2Fdu/wiSPd/h48VLuS09vFz760pvuCTUlP9eD3SzokmRatvTwhikcFkSI > LCV2Mekzc/wxVtzcYejmBCnH0q0LMxNN2qN5P+AiSpVuYiTNQM5Dnjf+VfvmV5kl > G2oVVihJ5eZqh4jeQs5XuiR/2cqgAi5lnGQekEBRqr0YEevbHFIlkxlqqx5xk2aV > PqHrkE+f5AaXSCM3b4beScMnEEIhW0Egz//G3xlR3UGg1xF7zPDRDg== > =gdr9 > -----END PGP SIGNATURE----- -- Saurabh Kumar System Admin (RHCSA,RHCE,RHCVA) From alanm at sics.se Thu Dec 12 15:21:07 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Thu, 12 Dec 2013 14:21:07 +0100 Subject: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam In-Reply-To: References: "\"\\\" <04d0a36b3fa63bf81111ecc4794bedec@sics.se>" "<50D02B1B-8357-4212-864D-9FA5043CE621@iki.fi>\" \"" <98b841413369cde2a3808c5c9722204f@sics.se>\" <5a8622be7f26e5bb242a17138036d72f@sics.se> " <52A6EE38.3090203@sys4.de>\"" Message-ID: <3007646f7135338c8711d3c023186f42@sics.se> On 2013-12-10 14:25, Alan McGinlay - SICS wrote: > On 2013-12-10 14:09, Alan McGinlay - SICS wrote: > On 2013-12-10 11:52, Alan McGinlay - SICS wrote: > On 2013-12-10 11:34, Robert Schetterer wrote: > Am 10.12.2013 11:25, schrieb Alan McGinlay - SICS: > On 2013-12-09 11:21, Alan McGinlay - SICS wrote: > On 2013-12-08 22:08, Alan McGinlay - SICS wrote: > Actually I do, /var/vmail (contains virtual domain mailboxes) is > owned by vmail:vmail > > On 2013-12-08 21:49, Timo Sirainen wrote: > On 5.12.2013, at 22.18, Alan McGinlay - SICS wrote: > > mail_privileged_group = vmail > .. > mail_location = maildir:~/Maildir > .. > dsync(alantestuser at whatever.com): Error: user > alantestuser at whatever.com: Couldn't drop privileges: getgrnam(vmail) > failed: No such file or directory (in mail_privileged_group setting) > > You don?t have vmail group in your system? Either create it or remove > this setting. Most likely you want to remove it, since this setting > was meant only for mbox format, while you?re using maildir. > > After much trial and error and following Timos advice, I managed to > get a sync to at least start and it lists folders, then it starts > spamming this: > > dsync(alantestuser at whatever.com): Error: > safe_mkstemp(/tmp/dovecot.doveadm.) failed: No such file or directory > dsync(alantestuser at whatever.com): Error: > safe_mkstemp(/tmp/dovecot.doveadm.) failed: No such file or directory > dsync(alantestuser at whatever.com): Error: > safe_mkstemp(/tmp/dovecot.doveadm.) failed: No such file or directory > ... > > /tmp/dovecot.doveadm. does indeed not exist but I can't find any > reference to it online or in the docs, > > Any ideas? > > > Still not able to get anywhere with this :( It really feels like a > permissions problem, either with the master user, the unix user i > start > the dsync with (root) or the user that dsync runs as (vmail). I tried > looking at the code for safe_mkstemp but still couldn't work out the > source of this problem. If anyone has an idea it would be great to > hear it! > > perhaps check > the dsync target directory must be writable by vmail:vmail > > > Best Regards > MfG Robert Schetterer > > Thanks, vmail:vmail owns all mail and parent directories up to > /var/vmail/. I tried changing mail_temp_dir in 10-mail.conf from /tmp/ > to /var/vmail/tmp (and i created that directory) but it made no > difference apart from changing the directory in the "safe_mkstemp" > error message. If I comment out mail_temp_dir then the error changes > to: > > dsync(alantestuser at whatever.com): Error: > safe_mkstemp(/tmp/dovecot.doveadm.) failed: Permission denied > dsync(alantestuser at whatever.com): Error: > stat(/tmp/dovecot.doveadm.3c303c239d223495) failed: Permission denied > > Interestingly, the synchronization actually does seem to work! I > hadn't noticed at first but in spite of the error, mails are synced > across and seemingly are completely intact! > > It would be really good to find out the source of this error though! > > /A > > Another update, only about 1900 of 25000~ mails are actually copied :/ Can't believe I'm the only one with this error, googled it and there is nothing. Sorry to whine but I am getting desperate here! I have upgraded to dovecot 2.1.7 but am still getting this error when performing a dsync: Error: safe_mkstemp(/var/vmail/tmp/dovecot.doveadm.) failed: No such file or directory It seems to fire that error only on some mails being synced but it's apparently random. If there are a lot of new mails then it gives that error a lot, if only one or two mails have come in since the last sync then it might give that error for both, one or none of them. If i change the dsync command to mirror instead of backup then the output becomes: Error: safe_mkstemp(/var/vmail/tmp/dovecot.doveadm.) failed: No such file or directory Error: Couldn't create temp file Error: Can't save message to mailbox DNS: Internal error occurred. Refer to server log for more information. [2013-12-12 13:16:46] Error: msg-get failed: box=Junk uid=87595 guid= Error: msg-get failed: box=Junk uid=87596 guid= Error: msg-get failed: box=Junk uid=87597 guid= Error: msg-get failed: box=Junk uid=87598 guid= Error: msg-get failed: box=Junk uid=87599 guid= Error: msg-get failed: box=Drafts uid=1339 guid= Warning: Mailbox changes caused a desync. You may want to run dsync again. syslog, mail.log and mail.err contain nothing except the master user logging in / out and no errors or warnings. Debug is enabled in 10-logging.conf. Please help! From benmunyaradzi at gmail.com Thu Dec 12 11:39:10 2013 From: benmunyaradzi at gmail.com (benson) Date: Thu, 12 Dec 2013 11:39:10 +0200 Subject: [Dovecot] Dovecot connection problem - Too many invalid commands (no auth attempts) - v2.0.19 In-Reply-To: References: Message-ID: <52A9843E.6020303@ict.co.zw> hie i am a newbie to using dovecot and have been experiencing the same problem ,can you please assist with the solution From skdovecot at smail.inf.fh-brs.de Thu Dec 12 16:25:28 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 12 Dec 2013 15:25:28 +0100 (CET) Subject: [Dovecot] userdb { prefetch } problem after upgrade (was Re: v2.2.9 released) In-Reply-To: <0B57B8E1-1802-47B9-B2BE-D6DABE2546E0@iki.fi> References: <0B57B8E1-1802-47B9-B2BE-D6DABE2546E0@iki.fi> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 25 Nov 2013, Timo Sirainen wrote: I test an upgrade from v2.2.5 to v2.2.9. I have built v2.2.9 from hg source, make clean, make install; now it looks like that userdb prefetch won't work, but returns successful without any data all the time. There is no LDAP query, even if I start Dovecot newly and issue the commands (see below) right away. The config works on v2.2.5 with prefetch, on v2.2.9 IMAP works, but doveadm only without prefetch. ==== These are my queries for LDAP user_attrs = =home=/home/%{ldap:uid},uid=user,mailLocationDovecot=mail,=quota_rule=*:bytes=%{ldap:mailQuotaBytes:300MB}, =quota_rule2=Trash:bytes=+%{ldap:mailQuotaBytesTrash:30MB},mail DovecotGeneral=userdb_import,displayName=gecos pass_attrs = uid=user,userPassword=password,=userdb_home=/home/%{ldap:uid},mailLocationDovecot=userdb_mail,uid=userdb_user,=userdb_quota_rule=*:bytes=%{ldap:mailQuotaBytes:300MB}, =userdb_quota_rule2=Trash:bytes=+%{ldap:mailQuotaBytesTrash:30MB},mailDovecotGeneral=userdb_userdb_import,displayName=userdb_gecos passdb { driver = ldap # Path for LDAP configuration file, see example-config/dovecot-ldap.conf.ext args = /usr/local/dovecot-2.2.9/etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } userdb { driver = ldap args = /usr/local/dovecot-2.2.9/etc/dovecot/dovecot-ldap.conf.ext # Default fields can be used to specify defaults that LDAP may override default_fields = home=/home/%u uid=vmail gid=vmail } They work in v2.2.5 whether userdb { prefetch } is enabled or not. In v2.2.9 without prefetch, everything works, with prefetch: + Login into IMAP and POP3 works, - - doveadm user dvtest1 just returns: field value uid vmail gid vmail home mail without prefetch: field value uid 30002 gid 30002 home /home/dvtest1 mail quota_rule *:bytes=300MB quota_rule2 Trash:bytes=+30MB gecos dvtest1 ==== Logentries: 2013-12-12 13:30:16 auth: Debug: master in: USER 1 dvtest1 service=doveadm 2013-12-12 13:30:16 auth: Debug: prefetch(dvtest1): success 2013-12-12 13:30:16 auth: Debug: userdb out: USER 1 dvtest1 - - LMTP fails With log entries: 2013-12-12 13:31:52 auth: Debug: master in: USER 5 dvtest1 service=lmtp 2013-12-12 13:31:52 auth: Debug: prefetch(dvtest1): success 2013-12-12 13:31:52 auth: Debug: userdb out: USER 5 dvtest1 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: Quota root: name=User quota backend=dict args=:proxy::quota 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: Quota rule: root=User quota mailbox=* bytes=314572800 messages=0 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: Quota rule: root=User quota mailbox=Trash bytes=+31457280 messages=0 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: Quota grace: root=User quota bytes=31457280 (10%) 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: dict quota: user=dvtest1, uri=proxy::quota, noenforcing=0 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location= 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: mdbox: couldn't find root dir 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: sdbox: couldn't find root dir 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: maildir: Home directory not set 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: maildir: couldn't find root dir 2013-12-12 13:31:52 lmtp(4573, dvtest1): Debug: maildir: Home directory not set ===== # 2.2.9 (c0236d1c4a04): /usr/local/dovecot-2.2.9/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.7 auth_cache_size = 10 M auth_debug = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot2.2/ default_client_limit = 2500 default_process_limit = 2500 deliver_log_format = msgid=%m: %$ %p/%w "%f" "%s" dict { acl = pgsql:/usr/local/dovecot-2.2.9/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/usr/local/dovecot-2.2.9/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = *pwd* instance_name = dovecot2.2 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot2.2.log log_timestamp = "%F %H:%M:%S " mail_debug = yes mail_gid = vmail mail_log_prefix = "%Us(%u) [%p]: " mail_plugins = " quota notify mail_log zlib acl" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = users.%%u. separator = . type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/dovecot-2.2.9/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = SPAM+ReportAsSPAM antispam_spool2dir_notspam = /tmp/spamspool/%%020lu-%%05lu-%u-H antispam_spool2dir_spam = /tmp/spamspool/%%020lu-%%05lu-%u-S antispam_trash = trash;TRASH;Trash;spam;SPAM;Spam;junk;JUNK;Junk;Deleted Items;Deleted Messages;Gel&APY-schte Elemente;Gel&APY-schte Objekte;Junk E-mail;Junk-E-Mail;INBOX.Trash;INBOX.TRASH;INBOX.trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject quota = dict:User quota::proxy::quota quota_rule = *:storage=300MB quota_rule2 = Trash:storage=+30M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_actions = 0 sieve_quota_max_storage = 3M } postmaster_address = postmaster at inf.h-brs.de protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service anvil { client_limit = 10003 } service auth { client_limit = 12500 unix_listener auth-client { mode = 0766 } unix_listener auth-userdb { mode = 0766 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { unix_listener doveadm-server { mode = 0666 } } service imap { vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_ca = References: <20131212091255.Horde.hFMpjUeIeV2fS0MSpYT-2Q4@horde.bigmichi1.de> Message-ID: <21169BD5-2D3D-4E39-B3CC-03AD4088C324@iki.fi> On 12.12.2013, at 10.12, Michael Cramer wrote: > i have enabled the zlib plugin with xz compression but on some new mails i got now a segfault and the following lines in dovecot error.log > > Dec 12 08:51:23 imap(tester at domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/root/storage/m.3): unexpected EOF at 136004 > Dec 12 08:51:23 imap(tester at domain.com): Error: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3)) failed: Invalid argument (uid=2985) > Dec 12 08:51:23 imap(tester at domain.com): Error: mail parser: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3), box=Shared/root at domain.com) failed: Invalid argument > Dec 12 08:52:33 indexer-worker(tester at domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/tester/storage/m.41): unexpected EOF at 4913758 > > the problem is that the mails can't be shown. this happens not with every mail i also got new mails that can be shown without any problem. i was not able to produce a coredump It was only a problem when reading: http://hg.dovecot.org/dovecot-2.2/rev/fb157c79473e From tss at iki.fi Thu Dec 12 18:09:53 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 12 Dec 2013 18:09:53 +0200 Subject: [Dovecot] userdb { prefetch } problem after upgrade (was Re: v2.2.9 released) In-Reply-To: References: <0B57B8E1-1802-47B9-B2BE-D6DABE2546E0@iki.fi> Message-ID: <9D6E4A58-3658-4C5A-ADF7-1ADF169FE1CD@iki.fi> On 12.12.2013, at 16.25, Steffen Kaiser wrote: > I test an upgrade from v2.2.5 to v2.2.9. > > I have built v2.2.9 from hg source, make clean, make install; now it looks like that userdb prefetch won't work, but returns successful without any data all the time. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/1600e97dabbb > # 2.2.9 (c0236d1c4a04): /usr/local/dovecot-2.2.9/etc/dovecot/dovecot.conf This isn't the v2.2.9 release though, the bug was added after v2.2.9 was released. From spork at bway.net Thu Dec 12 22:38:10 2013 From: spork at bway.net (Charles Sprickman) Date: Thu, 12 Dec 2013 15:38:10 -0500 Subject: [Dovecot] Size detection/replair does not work with zlib In-Reply-To: <20131212114734.GA18852@sys-241.netcologne.de> References: <20131212114734.GA18852@sys-241.netcologne.de> Message-ID: <2EE58EEA-1772-4862-B36D-0B6186302F9D@bway.net> Sorry for the top post, but this is a quick one. While I wasn't using compressed mailboxes, I ran into a similar bug, and I can't help but wonder if there's some commonality here. There was no resolution (can't find a bug tracker to add the issue to), but have a look: http://thr3ads.net/dovecot/2013/10/2693193-cached-message-size-errors (note: gmane seems down, hence the oddball archive service) Charles On Dec 12, 2013, at 6:47 AM, Roland Rosenfeld wrote: > Hi! > > Usually dovecot auto detects or repairs the size of a maildir > message. So I can place a message named "foo" in the cur directory > and dovecot uses it. > > Now I tried the same with a zlib compressed message but here dovecot > doesn't recognize/repair the size of the message. > > When I access this folder via IMAP the connection is diconnected and > in dovecot logs I see the following error messages: > > Error: Cached message size smaller than expected (805 < 2666) > Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 > Error: read() failed: Input/output error (FETCH for mailbox INBOX UID 23) > Disconnected: Internal error occurred. Refer to server log for more information. [2013-12-12 10:54:18] in=321 out=1977 > > As you can see in the first line, dovecot does know the compressed > size of the file (805) as well as the uncompressed size (2666), but it > isn't able to repair its index for this. > > If I modify the setup a little with a standard file naming but with a > wrong file size in S-flag (compressed size instead of uncompressed > size), the log entries become stranger: > > Error: Cached message size smaller than expected (805 < 2666) > Error: Maildir filename has wrong S value, renamed the file from /somedir/cur/1386772057.M152553P9709.host,S=805:2, to /somedir/cur/1386772057.M152553P9709.host,S=805:2, > > So here dovecot detects the wrong S value, but instead of fixing it by > using the uncompressed size, it renames to the same file name as > before... > > All the above was tested with dovecot 2.1.17. > We did a short cross test with 2.2.9 which gives somewhat different > error messages, but also isn't able to detect/repair the > (uncompressed) file size: > > Error: Cached message size smaller than expected (805 < 2666) > Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 > Error: read(zlib(/somedir/cur/foo)) failed: Invalid argument > > We also noticed that on both dovecot versions after trying to access > the above file, dovecot.index.cache is always deleted and not > rebuild... > > Is all this intended behavior? It sounds different to the standard > behavior of dovecot, that repairs broken folders if possible... > > Ciao > Roland From raabe at froglogic.com Thu Dec 12 23:01:36 2013 From: raabe at froglogic.com (Frerich Raabe) Date: Thu, 12 Dec 2013 22:01:36 +0100 Subject: [Dovecot] Size detection/replair does not work with zlib In-Reply-To: <20131212114734.GA18852@sys-241.netcologne.de> References: <20131212114734.GA18852@sys-241.netcologne.de> Message-ID: <96e186c9c6fde572e7dd93b9b900ab97@roundcube.froglogic.com> On 2013-12-12 12:47, Roland Rosenfeld wrote: > Hi! > > Usually dovecot auto detects or repairs the size of a maildir > message. So I can place a message named "foo" in the cur directory > and dovecot uses it. > > Now I tried the same with a zlib compressed message but here dovecot > doesn't recognize/repair the size of the message. > > When I access this folder via IMAP the connection is diconnected and > in dovecot logs I see the following error messages: [..] > Error: Cached message size smaller than expected (805 < 2666) > Error: Maildir filename has wrong S value, renamed the file from > /somedir/cur/1386772057.M152553P9709.host,S=805:2, to > /somedir/cur/1386772057.M152553P9709.host,S=805:2, > > So here dovecot detects the wrong S value, but instead of fixing it > by > using the uncompressed size, it renames to the same file name as > before... I observed exactly the same issue ever since I enabled the zlib plugin on our IMAP server, running dovecot 2.1.7. For what it's worth, I wrote a small shell script which, given a Maildir directory, looks for all files for which the S= value doesn't match the effective file size (i.e. for zlib-compressed files, the S= value should match the *uncompressed* file size, for plain files the S= value should match the physical file sie). The script the attempts to print appropriate 'mv' commands for renaming the files as needed. Maybe it helps, I attached it to this mail. -- Frerich Raabe - raabe at froglogic.com www.froglogic.com - Multi-Platform GUI Testing -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: fixup-compressed-maildir.sh URL: From andrew at infinet.net Thu Dec 12 23:41:17 2013 From: andrew at infinet.net (Andrew Obertas) Date: Thu, 12 Dec 2013 13:41:17 -0800 Subject: [Dovecot] Locking down master user to certain domains through passwd-file auth In-Reply-To: References: <528E8817.6000506@infinet.net> Message-ID: <52AA2D7D.5040801@infinet.net> Yeah, I had screwed up and completely missed the segment at the bottom of the variables section that showed how to use them. Felt pretty bad after spending a few days trying to get SQL working, noticing how a long variable name was referenced in one of the auth lines, and then going back to find out that I could have saved myself a lot of trouble by reading more thoroughly. I do have a new issue that I'm trying to fix, though it's probably best for me to update Dovecot and see if it persists. For whatever reason, I'm starting to see the Dovecot auth worker reporting passwd auth attempts without an IP and the log lines don't match up with how a normal failed login attempt should look. I'll do that in a separate thread though. Best regards, Andrew Obertas Technical Support Representative Infinet Communications Group On 12/8/2013 1:47 PM, Timo Sirainen wrote: > On 22.11.2013, at 0.24, Andrew Obertas wrote: > >> Hello, >> >> I know it is possible to lock down a master user to only have access to certain domains through SQL login but I was wondering if the same was possible with a passwd-based system. I currently have a master-passwd file residing in the /etc/virtual/domain.com/ directories I want the master user to be able to log in to. Is there a way to tell passdb to only allow the master user login to proceed if they can auth to the master-passwd file in the same folder as the user? Alternatively, is there a better way to go about this? >> >> What I assumed would be the easy approach, where the domain from the user's e-mail is fetched, doesn't seem to work as %d fetches the master user's domain and, unless I'm doing something wrong, the login_domain variable cannot be used as this is outside Dovecot-auth. > What do you mean outside Dovecot-auth? Master user login is done in auth process. %{login_domain} should work I think.. > > From jtam.home at gmail.com Fri Dec 13 02:10:22 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 12 Dec 2013 16:10:22 -0800 (PST) Subject: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam In-Reply-To: References: Message-ID: Alan McGinlay wrote: > Can't believe I'm the only one with this error, googled it and there is > nothing. Sorry to whine but I am getting desperate here! I googled "safe_mkstemp permission denied" and first hit is this thread dovecot.org/list/dovecot/2010-August/052319.html which mentions this error coming about from chrooting users. Looking back on your post, I see http://www.dovecot.org/list/dovecot/2013-December/093900.html mail_chroot = /var/vmail As long as your desperate, maybe try leaving this setting empty? (This doesn't explain why it's not deterministic though.) Try process traces -- I do when I'm stumped. Joseph Tam From Nikolaus at rath.org Fri Dec 13 04:22:13 2013 From: Nikolaus at rath.org (Nikolaus Rath) Date: Thu, 12 Dec 2013 18:22:13 -0800 Subject: [Dovecot] dovecot-imapd eating 100% cpu every once in a while In-Reply-To: (Timo Sirainen's message of "Wed, 11 Dec 2013 19:39:56 +0200") References: <87txel9wxv.fsf@vostro.rath.org> <8761qvs48j.fsf@rath.org> Message-ID: <87ob4lfq22.fsf@vostro.rath.org> Hi, I've applied the patch and will report back if the problem occurs again. Thanks! Best, Nikolaus Timo Sirainen writes: > Hmh. Can you try if this patch fixes it? http://hg.dovecot.org/dovecot-2.2/rev/c0236d1c4a04 > > On 11.12.2013, at 19.10, Nikolaus Rath wrote: > >> Hello, >> >> *ping* >> >> Really no one able to help with the issue below? >> >> Best, >> Nikolaus >> >> >> Nikolaus Rath writes: >>> Hello, >>> >>> About once or twice a week, dovecot's imap-login process on my system >>> seems gets out of control, eating 100% CPU for about 2 hours. Afterwards >>> everything seems to go back to normal. >>> >>> I am using Dovecot 2.1.7 on a 64 bit Debian wheezy system. >>> >>> When running gdb on the process in this stage, I get the following >>> traceback: >>> >>> #0 0x00007fcba50c5a90 in read () from /lib/x86_64-linux-gnu/libc.so.6 >>> #1 0x00007fcba4aa01aa in ?? () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 >>> #2 0x00007fcba4a9df09 in BIO_read () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 >>> #3 0x00007fcba4dbac8c in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 >>> #4 0x00007fcba4dbbe75 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 >>> #5 0x00007fcba4dbd8d0 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 >>> #6 0x00007fcba4dad07a in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 >>> #7 0x00007fcba4db143b in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 >>> #8 0x00007fcba5622b61 in ssl_handshake (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:465 >>> #9 ssl_step (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:528 >>> #10 0x00007fcba53d2016 in io_loop_call_io (io=0x7fcba786fc80) at ioloop.c:379 >>> #11 0x00007fcba53d2cc7 in io_loop_handler_run (ioloop=ioloop at entry=0x7fcba778c6e0) >>> at ioloop-epoll.c:213 >>> #12 0x00007fcba53d1a28 in io_loop_run (ioloop=0x7fcba778c6e0) at ioloop.c:398 >>> #13 0x00007fcba53be483 in master_service_run (service=0x7fcba778c590, >>> callback=callback at entry=0x7fcba5620100 ) at master-service.c:544 >>> #14 0x00007fcba562079e in login_binary_run (binary=, argc=1, argv=0x7fcba778c370) >>> at main.c:406 >>> #15 0x00007fcba5015ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 >>> #16 0x00007fcba5a52b2d in _start () >>> >>> strace -tt says: >>> >>> 16:14:19.693378 gettimeofday({1381421659, 693415}, NULL) = 0 >>> 16:14:19.693490 time(NULL) = 1381421659 >>> 16:14:19.693588 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) >>> 16:14:19.693688 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 >>> 16:14:19.693796 gettimeofday({1381421659, 693823}, NULL) = 0 >>> 16:14:19.693890 time(NULL) = 1381421659 >>> 16:14:19.693984 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) >>> 16:14:19.694084 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 >>> 16:14:19.694177 gettimeofday({1381421659, 694203}, NULL) = 0 >>> 16:14:19.694269 time(NULL) = 1381421659 >>> 16:14:19.694399 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) >>> 16:14:19.694563 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 >>> 16:14:19.694706 gettimeofday({1381421659, 694757}, NULL) = 0 >>> 16:14:19.694849 time(NULL) = 1381421659 >>> 16:14:19.694976 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) >>> 16:14:19.695091 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 >>> 16:14:19.695201 gettimeofday({1381421659, 695230}, NULL) = 0 >>> 16:14:19.695300 time(NULL) = 1381421659 >>> 16:14:19.695420 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) >>> 16:14:19.695555 epoll_wait(14, >>> >>> dovecot -n output is: >>> >>> # 2.1.7: /etc/dovecot/dovecot.conf >>> # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext3 >>> first_valid_uid = 8 >>> last_valid_uid = 8 >>> mail_access_groups = spamd-clients >>> mail_gid = mail >>> mail_location = mdbox:/var/spool/mail/%n/mdbox >>> mail_plugins = fts quota fts_lucene >>> mail_uid = mail >>> managesieve_notify_capability = mailto >>> managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave >>> namespace inbox { >>> inbox = yes >>> location = >>> mailbox Drafts { >>> special_use = \Drafts >>> } >>> mailbox Sent { >>> special_use = \Sent >>> } >>> mailbox "Sent Messages" { >>> special_use = \Sent >>> } >>> mailbox Spam { >>> special_use = \Junk >>> } >>> mailbox Trash { >>> special_use = \Trash >>> } >>> prefix = >>> } >>> passdb { >>> args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users >>> driver = passwd-file >>> } >>> plugin { >>> antispam_backend = pipe >>> antispam_pipe_program = /usr/local/bin/spamc_wrapper >>> antispam_pipe_program_notspam_args = -L;ham >>> antispam_pipe_program_spam_args = -L;spam >>> antispam_spam = Spam >>> antispam_trash = Trash;Papierkorb >>> fts = lucene >>> fts_lucene = whitespace_chars=@. >>> quota = dict:User quota::file:%h/quota >>> quota_rule = *:storage=1G >>> quota_rule2 = Trash:storage=+100M >>> sieve = ~/.dovecot.sieve >>> sieve_dir = ~/sieve >>> } >>> protocols = " imap lmtp sieve" >>> service auth { >>> unix_listener auth-client { >>> mode = 0600 >>> user = Debian-exim >>> } >>> } >>> service lmtp { >>> inet_listener lmtp { >>> address = 127.0.0.1 >>> port = 2003 >>> } >>> } >>> service managesieve-login { >>> inet_listener sieve { >>> port = 4190 >>> } >>> process_min_avail = 0 >>> service_count = 1 >>> } >>> ssl_cert = >> ssl_key = >> userdb { >>> args = username_format=%n /etc/dovecot/users >>> driver = passwd-file >>> override_fields = home=/var/spool/mail/%n >>> } >>> protocol lmtp { >>> mail_plugins = fts quota fts_lucene sieve >>> } >>> protocol lda { >>> mail_plugins = fts quota fts_lucene sieve >>> } >>> protocol imap { >>> mail_max_userip_connections = 50 >>> mail_plugins = fts quota fts_lucene imap_quota antispam >>> } >>> >>> >>> Is this a bug in dovecot, or am I doing something wrong? Is there >>> something I can do to debug this further? >>> >>> >>> Best, >>> Nikolaus >>> >>> -- >>> Encrypted emails preferred. >>> PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C >>> >>> ?Time flies like an arrow, fruit flies like a Banana.? >> >> >> -- >> Encrypted emails preferred. >> PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C >> >> ?Time flies like an arrow, fruit flies like a Banana.? >> -- Encrypted emails preferred. PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C ?Time flies like an arrow, fruit flies like a Banana.? From skdovecot at smail.inf.fh-brs.de Fri Dec 13 12:06:20 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 13 Dec 2013 11:06:20 +0100 (CET) Subject: [Dovecot] userdb { prefetch } problem after upgrade (was Re: v2.2.9 released) In-Reply-To: <9D6E4A58-3658-4C5A-ADF7-1ADF169FE1CD@iki.fi> References: <0B57B8E1-1802-47B9-B2BE-D6DABE2546E0@iki.fi> <9D6E4A58-3658-4C5A-ADF7-1ADF169FE1CD@iki.fi> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 12 Dec 2013, Timo Sirainen wrote: > On 12.12.2013, at 16.25, Steffen Kaiser wrote: > >> I have built v2.2.9 from hg source, make clean, make install; now it looks like that userdb prefetch won't work, but returns successful without any data all the time. > > Fixed: http://hg.dovecot.org/dovecot-2.2/rev/1600e97dabbb Many thanks, works like charm, I've updated to changeset 17062:3535659d6cc2. I noticed a change between my current install v2.2.5+ and the current hg version, the ids are symbolic now rather than numeric: old# doveadm user dvtest1 field value uid 30002 gid 30002 home /home/dvtest1 cur# doveadm user dvtest1 field value uid vmail gid vmail home /home/dvtest1 >> # 2.2.9 (c0236d1c4a04): /usr/local/dovecot-2.2.9/etc/dovecot/dovecot.conf > > This isn't the v2.2.9 release though, the bug was added after v2.2.9 was released. Yeah, I forgot that thread - I did not meant it so strictly. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqrcHV3r2wJMiz2NAQKpawgAh3guYkBegP4QjHul9ZElF7opWKcmB7hQ 5RF1gTIUi1JjduBruKEqMsSoG3uIB7D2wF1crPtZHBsPvKSPhDZfEfflc3/XOyXY 6pZmjpu0/vAa8ly/8Uqhkzbc5gJo3iuTdeGwfMi7b1C36iHchPHfmk5VqoTYOVBv 8QzFDxh+RZyVnwUN+fM3/joQLcPXJ9SI6hGrRI9HVcBmjW9uOFDOgVf7lCgPnhmK JYGvF4zqlEIXP1+LQkVhLPj1/QWDFo5LS19UCQd7E1NB6AQXjjI02/kKJ2P35iNK joKKCHI11Zj/gXAwZymGXrwrH42eHzv11UAaswOiM48COE1ZUkFl8w== =pQmC -----END PGP SIGNATURE----- From alanm at sics.se Fri Dec 13 14:14:50 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Fri, 13 Dec 2013 13:14:50 +0100 Subject: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam In-Reply-To: References: Message-ID: <3f6ce2bbc0159216fa98e10deeeabefd@sics.se> On 2013-12-13 01:10, Joseph Tam wrote: > Alan McGinlay wrote: > > Can't believe I'm the only one with this error, googled it and there > is > nothing. Sorry to whine but I am getting desperate here! > > I googled "safe_mkstemp permission denied" and first hit is this > thread > > dovecot.org/list/dovecot/2010-August/052319.html Hah! thank you so much, I have been pretty stressed the past week or so and of course I googled it, my brain must have been mushed however :) > > which mentions this error coming about from chrooting users. Looking > back > on your post, I see > > http://www.dovecot.org/list/dovecot/2013-December/093900.html > > mail_chroot = /var/vmail It makes immediate sense when you mention the chroot! Annoying that dsync and the chroot wont work together however > > As long as your desperate, maybe try leaving this setting empty? Yep, this worked once I changed the maildir location to include /var/vmail > (This doesn't explain why it's not deterministic though.) Try > process traces -- I do when I'm stumped. > > Joseph Tam Thanks! This is a really helpful mailing list! From kirill.shutemov at linux.intel.com Fri Dec 13 03:07:51 2013 From: kirill.shutemov at linux.intel.com (Kirill A. Shutemov) Date: Fri, 13 Dec 2013 03:07:51 +0200 (EET) Subject: [Dovecot] File descriptor leak in sieve-extprograms Message-ID: <20131213010751.AD240E0090@blue.fi.intel.com> I've tried to use sieve-filter for my inbox (~6000 messages). It failed after some work with this backtrace: sieve-filter(kas): Error: socketpair() failed: Too many open files sieve-filter(kas): Panic: file script-client-local.c: line 155 (script_client_local_disconnect): assertion failed: (pid >= 0) sieve-filter(kas): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x66a71) [0x7f020e717a71] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f020e717ada] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f020e6d32ee] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x4baf) [0x7f020dae0baf] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x58ca) [0x7f020dae18ca] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_fail+0x2f) [0x7f020dae199f] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_run+0xc4) [0x7f020dae1fd4] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x6134) [0x7f020dae2134] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x3ac) [0x7f020ecd1adc] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x4a) [0x7f020ece05aa] -> /usr/bin/sieve-filter(main+0x6a9) [0x403b49] -> /usr/lib/libc.so.6(__libc_start_ma in+0xf5) [0x7f020e327bc5] -> /usr/bin/sieve-filter() [0x404111] The reason is file descriptor leak in "script client local". script_client_local_close_output() shutdowns write side of descriptor and sets sclient->fd_out to -1, but never closes the descriptor. I've tried to fix this by the patch below. Tests works fine, but sieve-filter crashed in other way: sieve-filter(kas): Panic: epoll_ctl(del, 13) failed: Bad file descriptor sieve-filter(kas): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x66a71) [0x7f0ed406fa71] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f0ed406fada] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0ed402b2ee] -> /usr/lib/dovecot/libdovecot.so.0(+0x776f5) [0x7f0ed40806f5] -> /usr/lib/dovecot/libdovecot.so.0(+0x8009a) [0x7f0ed408909a] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_unref+0x25) [0x7f0ed40764c5] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_unref+0x26) [0x7f0ed4088136] -> /usr/lib/dovecot/libdovecot.so.0(+0x80e48) [0x7f0ed4089e48] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f0ed407fa47] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f0ed40807d7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f0ed407f5e8] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_run+0x9c) [0x7f0ed343af8c] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x6114) [0x 7f0ed343b114] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x3ac) [0x7f0ed4629adc] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x4a) [0x7f0ed46385aa] -> /usr/bin/sieve-filter(main+0x6a9) [0x403b49] -> /usr/lib/libc.so.6(__libc_start_main+0xf5) [0x7f0ed3c7fbc5] -> /usr/bin/sieve-filter() [0x404111] I failed to unfold this in a reasonable time. Any ideas? diff --git a/src/plugins/sieve-extprograms/script-client-local.c b/src/plugins/sieve-extprograms/script-client-local.c index 56d32f707c09..f54ef82132cf 100644 --- a/src/plugins/sieve-extprograms/script-client-local.c +++ b/src/plugins/sieve-extprograms/script-client-local.c @@ -139,7 +139,6 @@ static int script_client_local_close_output(struct script_client *sclient) i_error("shutdown(%s, SHUT_WR) failed: %m", sclient->path); return -1; } - sclient->fd_out = -1; return 1; } diff --git a/src/plugins/sieve-extprograms/script-client.c b/src/plugins/sieve-extprograms/script-client.c index 06a5d5d54ba9..6fefca4c9f26 100644 --- a/src/plugins/sieve-extprograms/script-client.c +++ b/src/plugins/sieve-extprograms/script-client.c @@ -68,7 +68,8 @@ static void script_client_disconnect if (sclient->fd_in != -1 && close(sclient->fd_in) < 0) i_error("close(%s) failed: %m", sclient->path); - if (sclient->fd_out != -1 && sclient->fd_out != sclient->fd_out) + if (sclient->fd_out != -1 && sclient->fd_out != sclient->fd_in + && close(sclient->fd_out) < 0) i_error("close(%s/out) failed: %m", sclient->path); sclient->fd_in = sclient->fd_out = -1; -- Kirill A. Shutemov From s.sabatier at pobox.com Fri Dec 13 16:37:56 2013 From: s.sabatier at pobox.com (Stanislas SABATIER) Date: Fri, 13 Dec 2013 15:37:56 +0100 Subject: [Dovecot] Accessing plain text password from memory Message-ID: Is there a way to retrieve the client's password in plain text from memory ? I don't store the password in plain text in my postgreSQL but I need it when the client is connected to make crypto computation. If I write a plugin to do the job, how could I retrieve the plain text password from master ? Thank you for your help, Regards, Stan. --------------------------------------------------------------- Stanislas SABATIER s.sabatier at pobox.com --------------------------------------------------------------- From alanm at sics.se Fri Dec 13 16:46:11 2013 From: alanm at sics.se (Alan McGinlay - SICS) Date: Fri, 13 Dec 2013 15:46:11 +0100 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: Message-ID: <9f9e7b47975c01a31934c06b3192eff2@sics.se> On 2013-12-13 15:37, Stanislas SABATIER wrote: > Is there a way to retrieve the client's password in plain text from > memory ? > > I don't store the password in plain text in my postgreSQL but I need > it > when the client is connected to make crypto computation. > > If I write a plugin to do the job, how could I retrieve the plain text > password from master ? > > Thank you for your help, > > Regards, > Stan. > > --------------------------------------------------------------- > Stanislas SABATIER > s.sabatier at pobox.com > --------------------------------------------------------------- If you enable auth_debug you can also enable auth_debug_passwords and that will show the plaintext password in the logfile when the user connects. I can't say I would recommend it though. /A From tss at iki.fi Fri Dec 13 16:47:23 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 13 Dec 2013 16:47:23 +0200 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: Message-ID: On 13.12.2013, at 16.37, Stanislas SABATIER wrote: > Is there a way to retrieve the client's password in plain text from memory ? > > I don't store the password in plain text in my postgreSQL but I need it > when the client is connected to make crypto computation. > > If I write a plugin to do the job, how could I retrieve the plain text > password from master ? Assuming you you're using passdb sql and userdb prefetch and you want to access the password in imap/pop3/etc process, you can do: password_query = '%w' as userdb_password, ... Then the password will be available the same way as plugin { password } would be available (mail_user_plugin_getenv()). You could also write a passdb plugin you could access the password directly from auth_request->mech_password. From rick at havokmon.com Fri Dec 13 17:05:14 2013 From: rick at havokmon.com (Rick Romero) Date: Fri, 13 Dec 2013 09:05:14 -0600 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: Message-ID: <20131213090514.Horde.OCAiFKKXSqVG_MX0pYesZA1@www.vfemail.net> Quoting Stanislas SABATIER : > Is there a way to retrieve the client's password in plain text from memory ? > > I don't store the password in plain text in my postgreSQL but I need it > when the client is connected to make crypto computation. Hi Stan, I hope you're not trying to copy Lavabit. Saying you don't have access to mailbox contents on your own equipment would be a flat out lie. 1. You have the password in memory. Simply set the debug flags and you can retrieve the password, as Lavabit did, to decrypt the mailbox. Their claim of 'our policy is not to run in debug mode, therefore we can't access your data' is not actually a form of security. 2. SMTP is in plain text. After the existing mail is read, any incoming or outgoing mail is easily CC'd to a 'monitoring' mailbox based on SMTP Auth or RCPT TO. If it's not mailbox encryption, sorry (you have no idea how much I detest that Lavabit guy for his lies), but if it is then it's nothing more than a programming exercise. Rick From msmith at datafoundry.com Fri Dec 13 17:49:07 2013 From: msmith at datafoundry.com (Michael Smith (DF)) Date: Fri, 13 Dec 2013 15:49:07 +0000 Subject: [Dovecot] Mailbox with .broken files Message-ID: We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp... files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = References: Message-ID: Hi rick, I DO want to encrypt/decrypt mails on the fly without ?lying ? to my customers. It's better to have encrypted mail that are difficult to decrypt than plain text files within plain text folders. (Yes, it would be possible to get the user password on the fly, but my system is not design this way) I agree that it's not panacea, but it's better than no encryption at all. Isn't it ? As soon as a new email protocol will be available, I'll be the first to switch to it ! Regards, Stan. --------------------------------------------------------------- Stanislas SABATIER s.sabatier at pobox.com --------------------------------------------------------------- 2013/12/13 Stanislas SABATIER > Is there a way to retrieve the client's password in plain text from memory > ? > > I don't store the password in plain text in my postgreSQL but I need it > when the client is connected to make crypto computation. > > If I write a plugin to do the job, how could I retrieve the plain text > password from master ? > > Thank you for your help, > > Regards, > Stan. > > --------------------------------------------------------------- > Stanislas SABATIER > s.sabatier at pobox.com > --------------------------------------------------------------- > > From rick at havokmon.com Fri Dec 13 19:09:09 2013 From: rick at havokmon.com (Rick Romero) Date: Fri, 13 Dec 2013 11:09:09 -0600 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: Message-ID: <20131213110909.Horde.VE_5TXFw5jMsGmxssNEpbw1@www.vfemail.net> As long as you're not claiming that you can't access the data, then I won't get uppity :) Though I honestly don't see any advantage to the approach you're taking. It was useless for Lavabit, it's a poor method that's not going to fair any better under anyone else's watch. Why not just zip all the files up and rename the extension? That'll be 'difficult' to defeat too, and the plugins already exist. A rogue agent with local access will be able to access the mailboxes, encrypted or not. Are you running a FAM? Centralized SIEM? If not, they just set the debug flag and reload the service without you ever even knowing. IMHO, your time is better spent creating a PGP plugin that uses public keys to encrypt the email contents. Of course you lose indexing and searches.. It's just _not_ going to be secure if a local service can decrypt the data. I agree the core problem is SMTP. I'd be willing to use a new email protocol as well, but I don't have high hopes from 'that' group. It's like they've got Einstein and PT Barnum... Rick Quoting Stanislas SABATIER : > Hi rick, > > I DO want to encrypt/decrypt mails on the fly without ?lying ? to my > customers. > > > It's better to have encrypted mail that are difficult to decrypt than plain > text files within plain text folders. (Yes, it would be possible to get the > user password on the fly, but my system is not design this way) > > I agree that it's not panacea, but it's better than no encryption at all. > Isn't it ? > > As soon as a new email protocol will be available, I'll be the first to > switch to it ! > > Regards, > Stan. > > > --------------------------------------------------------------- > Stanislas SABATIER > s.sabatier at pobox.com > --------------------------------------------------------------- > > > > 2013/12/13 Stanislas SABATIER > >> Is there a way to retrieve the client's password in plain text from memory >> ? >> >> I don't store the password in plain text in my postgreSQL but I need it >> when the client is connected to make crypto computation. >> >> If I write a plugin to do the job, how could I retrieve the plain text >> password from master ? >> >> Thank you for your help, >> >> Regards, >> Stan. >> >> --------------------------------------------------------------- >> Stanislas SABATIER >> s.sabatier at pobox.com >> --------------------------------------------------------------- >> >> From s.sabatier at pobox.com Fri Dec 13 19:25:32 2013 From: s.sabatier at pobox.com (Stanislas SABATIER) Date: Fri, 13 Dec 2013 18:25:32 +0100 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: <20131213110909.Horde.VE_5TXFw5jMsGmxssNEpbw1@www.vfemail.net> References: <20131213110909.Horde.VE_5TXFw5jMsGmxssNEpbw1@www.vfemail.net> Message-ID: 2013/12/13 Rick Romero > > ?(?) > > IMHO, your time is better spent creating a PGP plugin that uses public > keys to encrypt the email contents. > Rick > > > > ?That's exactly what I'm doing. Inbound mails are all encrypted with each client's public key. Then, clients can either decrypt mails on their own personal computer, or have their mails decrypted on-the-fly server side. In the later case, I store an encrypted private key for each client. To open the private key, I need client's password. Stan From rick at havokmon.com Fri Dec 13 19:33:36 2013 From: rick at havokmon.com (Rick Romero) Date: Fri, 13 Dec 2013 11:33:36 -0600 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: <20131213110909.Horde.VE_5TXFw5jMsGmxssNEpbw1@www.vfemail.net> Message-ID: <20131213113336.Horde.qmLpVIEDhLRtqpSFfmuCyQ1@www.vfemail.net> Quoting Stanislas SABATIER : > 2013/12/13 Rick Romero > >> >> ?(?) >> >> IMHO, your time is better spent creating a PGP plugin that uses public >> keys to encrypt the email contents. >> Rick >> >> >> >> ?That's exactly what I'm doing. Inbound mails are all encrypted with each > client's public key. > > Then, clients can either decrypt mails on their own personal computer, or > have their mails decrypted on-the-fly server side. > In the later case, I store an encrypted private key for each client. To > open the private key, I need client's password. > > Stan Oh! I feel so much better now :) Rick From marcin at mejor.pl Fri Dec 13 21:57:45 2013 From: marcin at mejor.pl (=?ISO-8859-2?Q?Marcin_Miros=B3aw?=) Date: Fri, 13 Dec 2013 20:57:45 +0100 Subject: [Dovecot] v2.2.9 released / service(imap):child 6167 killed with signal 11 In-Reply-To: <528E875A.90106@mejor.pl> References: <66D0C060-387D-4460-B00C-3E939694B2A6@iki.fi> <528DD54D.1090908@mejor.pl> <528E875A.90106@mejor.pl> Message-ID: <52AB66B9.3070807@mejor.pl> W dniu 2013-11-21 23:21, Marcin Miros?aw pisze: > Another one coredump: >> # gdb -q /usr/libexec/dovecot/imap 'core-1385046907-8-11-!usr!libexec!dovecot!imap-22603' >> Reading symbols from /usr/libexec/dovecot/imap...Reading symbols from /usr/lib64/debug/usr/libexec/dovecot/imap.debug...done. >> done. >> [New LWP 22603] >> >> warning: Could not load shared library symbols for linux-vdso.so.1. >> Do you need "set solib-search-path" or "set sysroot"? >> b[Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib64/libthread_db.so.1". >> tCore was generated by `dovecot/imap'. >> Program terminated with signal 11, Segmentation fault. >> #0 array_count_i (array=0x501010df786488e) at array.h:140 >> 140 return array->buffer->used / array->element_size; >> (gdb) bt >> #0 array_count_i (array=0x501010df786488e) at array.h:140 >> #1 array_get_modifiable_i (count_r=, array=0x501010df786488e) at array.h:206 >> #2 priorityq_remove_idx (pq=0x501010df7864886, idx=2660296736) at priorityq.c:121 >> #3 0x00006e2b586ac78f in priorityq_remove (pq=, item=item at entry=0x7c69e989370) at priorityq.c:138 >> #4 0x00006e2b5869b6bf in timeout_remove (_timeout=) at ioloop.c:189 >> #5 0x00006e2b587455c7 in imapc_client_mailbox_close (_box=_box at entry=0x7c69e9728f8) at imapc-client.c:341 >> #6 0x00006e2b58744837 in imapc_mailbox_close (box=0x7c69e972650) at imapc-storage.c:536 >> #7 0x00006e2b587578d2 in mailbox_close (box=0x7c69e972650) at mail-storage.c:1184 >> #8 0x00006e2b587579a7 in mailbox_free (_box=_box at entry=0x7a0f60c375d0) at mail-storage.c:1199 >> #9 0x000007c69e5aecc5 in close_selected_mailbox (client=0x7c69e8f11b0) at cmd-select.c:387 >> #10 close_selected_mailbox (client=0x7c69e8f11b0) at cmd-select.c:376 >> #11 0x000007c69e5af3f4 in cmd_select_full (cmd=, readonly=) at cmd-select.c:431 >> #12 0x000007c69e5b646c in command_exec (cmd=cmd at entry=0x7c69e8f19c0) at imap-commands.c:158 >> #13 0x000007c69e5b4e20 in client_command_input (cmd=0x7c69e8f19c0) at imap-client.c:780 >> #14 0x000007c69e5b4f22 in client_command_input (cmd=0x7c69e8f19c0) at imap-client.c:841 >> #15 0x000007c69e5b52e5 in client_handle_next_command (remove_io_r=, client=0x7c69e8f11b0) at imap-client.c:879 >> #16 client_handle_input (client=client at entry=0x7c69e8f11b0) at imap-client.c:891 >> #17 0x000007c69e5b57ae in client_input (client=0x7c69e8f11b0) at imap-client.c:933 >> #18 0x00006e2b5869be37 in io_loop_call_io (io=0x7c69e8e4630) at ioloop.c:388 >> #19 0x00006e2b5869d2ef in io_loop_handler_run (ioloop=ioloop at entry=0x7c69e89e760) at ioloop-epoll.c:220 >> #20 0x00006e2b5869b738 in io_loop_run (ioloop=0x7c69e89e760) at ioloop.c:412 >> #21 0x00006e2b58631957 in master_service_run (service=0x7c69e89e5f0, callback=callback at entry=0x7c69e5c1f50 ) at master-service.c:566 >> #22 0x000007c69e5c2604 in main (argc=1, argv=0x7c69e89e3b0) at main.c:400 Hi! Is this the same reason as described here http://www.dovecot.org/list/dovecot/2012-July/067181.html ? Marcin From stephan at rename-it.nl Fri Dec 13 22:40:12 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 13 Dec 2013 21:40:12 +0100 Subject: [Dovecot] File descriptor leak in sieve-extprograms In-Reply-To: <20131213010751.AD240E0090@blue.fi.intel.com> References: <20131213010751.AD240E0090@blue.fi.intel.com> Message-ID: <52AB70AC.1030201@rename-it.nl> On 12/13/2013 2:07 AM, Kirill A. Shutemov wrote: > I've tried to use sieve-filter for my inbox (~6000 messages). It failed after > some work with this backtrace: > > sieve-filter(kas): Error: socketpair() failed: Too many open files > sieve-filter(kas): Panic: file script-client-local.c: line 155 (script_client_local_disconnect): assertion failed: (pid >= 0) > sieve-filter(kas): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x66a71) [0x7f020e717a71] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f020e717ada] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f020e6d32ee] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x4baf) [0x7f020dae0baf] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x58ca) [0x7f020dae18ca] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_fail+0x2f) [0x7f020dae199f] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_run+0xc4) [0x7f020dae1fd4] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x6134) [0x7f020dae2134] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x3ac) [0x7f020ecd1adc] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x4a) [0x7f020ece05aa] -> /usr/bin/sieve-filter(main+0x6a9) [0x403b49] -> /usr/lib/libc.so.6(__libc_ > start_ma > in+0xf5) [0x7f020e327bc5] -> /usr/bin/sieve-filter() [0x404111] > > The reason is file descriptor leak in "script client local". > script_client_local_close_output() shutdowns write side of descriptor > and sets sclient->fd_out to -1, but never closes the descriptor. > > I've tried to fix this by the patch below. Tests works fine, but sieve-filter > crashed in other way: Wow, this is a very interesting stupidity on my part, especially the `sclient->fd_out != sclient->fd_out`. This probably fixes it, although I am not entirely sure. I am mainly a bit puzzled on how this causes the fd leak; the fd_in and fd_out are for the current backends always the same fd. Regards, Stephan. From kirill.shutemov at linux.intel.com Sat Dec 14 00:14:30 2013 From: kirill.shutemov at linux.intel.com (Kirill A. Shutemov) Date: Sat, 14 Dec 2013 00:14:30 +0200 (EET) Subject: [Dovecot] File descriptor leak in sieve-extprograms In-Reply-To: <52AB70AC.1030201@rename-it.nl> References: <20131213010751.AD240E0090@blue.fi.intel.com> <52AB70AC.1030201@rename-it.nl> Message-ID: <20131213221430.EDA5BE0090@blue.fi.intel.com> Stephan Bosch wrote: > On 12/13/2013 2:07 AM, Kirill A. Shutemov wrote: > > I've tried to use sieve-filter for my inbox (~6000 messages). It failed after > > some work with this backtrace: > > > > sieve-filter(kas): Error: socketpair() failed: Too many open files > > sieve-filter(kas): Panic: file script-client-local.c: line 155 (script_client_local_disconnect): assertion failed: (pid >= 0) > > sieve-filter(kas): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x66a71) [0x7f020e717a71] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f020e717ada] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f020e6d32ee] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x4baf) [0x7f020dae0baf] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x58ca) [0x7f020dae18ca] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_fail+0x2f) [0x7f020dae199f] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(script_client_run+0xc4) [0x7f020dae1fd4] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x6134) [0x7f020dae2134] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x3ac) [0x7f020ecd1adc] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x4a) [0x7f020ece05aa] -> /usr/bin/sieve-filter(main+0x6a9) [0x403b49] -> /usr/lib/libc.so.6(__libc_ > > start_ma > > in+0xf5) [0x7f020e327bc5] -> /usr/bin/sieve-filter() [0x404111] > > > > The reason is file descriptor leak in "script client local". > > script_client_local_close_output() shutdowns write side of descriptor > > and sets sclient->fd_out to -1, but never closes the descriptor. > > > > I've tried to fix this by the patch below. Tests works fine, but sieve-filter > > crashed in other way: > > Wow, this is a very interesting stupidity on my part, especially the > `sclient->fd_out != sclient->fd_out`. > > This probably fixes it, although I am not entirely sure. I am mainly a > bit puzzled on how this causes the fd leak; the fd_in and fd_out are for > the current backends always the same fd. fd_in is not opened in my case: -1 all the way. I use vnd.dovecot.pipe. I've hackaround sieve-filter crash with the ugly patch. I don't know how to fix this properly. diff --git a/src/plugins/sieve-extprograms/script-client-local.c b/src/plugins/sieve-extprograms/script-client-local.c index 56d32f707c09..f54ef82132cf 100644 --- a/src/plugins/sieve-extprograms/script-client-local.c +++ b/src/plugins/sieve-extprograms/script-client-local.c @@ -139,7 +139,6 @@ static int script_client_local_close_output(struct script_client *sclient) i_error("shutdown(%s, SHUT_WR) failed: %m", sclient->path); return -1; } - sclient->fd_out = -1; return 1; } diff --git a/src/plugins/sieve-extprograms/script-client.c b/src/plugins/sieve-extprograms/script-client.c index 06a5d5d54ba9..b94d2029c176 100644 --- a/src/plugins/sieve-extprograms/script-client.c +++ b/src/plugins/sieve-extprograms/script-client.c @@ -47,13 +47,10 @@ static void script_client_disconnect if ( sclient->ioloop != NULL ) io_loop_stop(sclient->ioloop); - if ( sclient->disconnected ) - return; - if ( (ret=sclient->close_output(sclient)) < 0 ) error = TRUE; - - if ( (ret=sclient->disconnect(sclient, force)) < 0 ) + + if (!sclient->disconnected && (ret=sclient->disconnect(sclient, force)) < 0 ) error = TRUE; if ( sclient->script_input != NULL ) @@ -68,10 +65,13 @@ static void script_client_disconnect if (sclient->fd_in != -1 && close(sclient->fd_in) < 0) i_error("close(%s) failed: %m", sclient->path); - if (sclient->fd_out != -1 && sclient->fd_out != sclient->fd_out) - i_error("close(%s/out) failed: %m", sclient->path); - sclient->fd_in = sclient->fd_out = -1; - + sclient->fd_in = -1; + if (force && sclient->fd_out != -1 && sclient->fd_out != sclient->fd_in) { + if (close(sclient->fd_out) < 0) + i_error("close(%s/out) failed: %m", sclient->path); + sclient->fd_out = -1; + } + sclient->disconnected = TRUE; if (error && sclient->error == SCRIPT_CLIENT_ERROR_NONE ) { sclient->error = SCRIPT_CLIENT_ERROR_UNKNOWN; -- Kirill A. Shutemov From stephan at rename-it.nl Sat Dec 14 12:07:04 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 14 Dec 2013 11:07:04 +0100 Subject: [Dovecot] File descriptor leak in sieve-extprograms In-Reply-To: <20131213221430.EDA5BE0090@blue.fi.intel.com> References: <20131213010751.AD240E0090@blue.fi.intel.com> <52AB70AC.1030201@rename-it.nl> <20131213221430.EDA5BE0090@blue.fi.intel.com> Message-ID: <52AC2DC8.4030508@rename-it.nl> On 12/13/2013 11:14 PM, Kirill A. Shutemov wrote: > Stephan Bosch wrote: >> This probably fixes it, although I am not entirely sure. I am mainly a >> bit puzzled on how this causes the fd leak; the fd_in and fd_out are for >> the current backends always the same fd. > fd_in is not opened in my case: -1 all the way. I use vnd.dovecot.pipe. Ah right, that explains it. > I've hackaround sieve-filter crash with the ugly patch. I don't know how to fix > this properly. Could you provide more details of your setup (configuration, sieve-filter command line, Sieve script), so that I can reproduce the problem at this end? Regards, Stephan. From scottg at particlesoftware.com Sat Dec 14 12:37:01 2013 From: scottg at particlesoftware.com (Scott Galambos) Date: Sat, 14 Dec 2013 05:37:01 -0500 Subject: [Dovecot] Turn of mount point adding? Message-ID: <52AC34CD.5020805@particlesoftware.com> I'm running dovecot 2.2.5 and would like to completely turn off all automatic adding of mount points. So var/lib/dovecot/mounts would be empty essentially. Is this possible? Somehow dovecot always adds a mount point that does not exist and was removed a long time ago. I've dove: doveadm mount add '/my custom path/*' ignore but it still will add mount points in the "mounts" file and flag them as online. for example: ignore /apps/proftp/servers/ftp.domain.ca/* ignore /mnt/* online / online /apps/proftp/servers/ftp.domain.ca/www.site1.com online /apps/proftp/servers/ftp.domain.ca/www.site2.com online /apps/proftp/servers/ftp.domain.ca/www.site3.com what does it list site1, 2 and 3 if its suppose to ignore the root path with the first line? I would to completely disable all mountpoints. Even "doveadm mount add '/*' ignore" should render a mounts file empty on reboot correct? It doesn't and keeps rebuilding it. From h.reindl at thelounge.net Sat Dec 14 12:52:34 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 14 Dec 2013 11:52:34 +0100 Subject: [Dovecot] Turn of mount point adding? In-Reply-To: <52AC34CD.5020805@particlesoftware.com> References: <52AC34CD.5020805@particlesoftware.com> Message-ID: <52AC3872.6000803@thelounge.net> Am 14.12.2013 11:37, schrieb Scott Galambos: > I'm running dovecot 2.2.5 and would like to completely turn off all automatic adding of mount points. So > var/lib/dovecot/mounts would be empty essentially. i wonder if Timo sooner or later accepts that this is a *major bug* no userland-software on this planet needs to track mount-points at least not as default, at least not this way the last time i borught this up the excuse was "dovecot can not know if the missing mount point contains mail-data" uhm - it knows by config and not by presence of a OS mount-point -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From scottg at particlesoftware.com Sat Dec 14 13:18:00 2013 From: scottg at particlesoftware.com (Scott Galambos) Date: Sat, 14 Dec 2013 06:18:00 -0500 Subject: [Dovecot] Turn of mount point adding? In-Reply-To: <52AC3872.6000803@thelounge.net> References: <52AC34CD.5020805@particlesoftware.com> <52AC3872.6000803@thelounge.net> Message-ID: <52AC3E68.2050502@particlesoftware.com> There needs to be a way at compile time or in the config to turn the whole thing off. The best I could come up with is: doveadm mount add '/custompath/*' ignore doveadm mount add '/custompath*' ignore I had to do both to get it to finally stop adding them. On 12/14/2013 5:52 AM, Reindl Harald wrote: > Am 14.12.2013 11:37, schrieb Scott Galambos: > i wonder if Timo sooner or later accepts that this is a *major bug* > no userland-software on this planet needs to track mount-points > at least not as default, at least not this way > > the last time i borught this up the excuse was "dovecot > can not know if the missing mount point contains mail-data" > > uhm - it knows by config and not by presence of a OS mount-point From martijn.list at gmail.com Sat Dec 14 17:19:06 2013 From: martijn.list at gmail.com (martijn.list) Date: Sat, 14 Dec 2013 16:19:06 +0100 Subject: [Dovecot] mail-filter always results in corrupted indexes Message-ID: <52AC76EA.2000704@gmail.com> Hi, I'm experimenting with the mail-filter plugin but whenever I add anything to a message, it always results in an corrupted cache: from the logs: Dec 14 16:09:55 ciphermail-webmail dovecot: imap(martijn=djigzo.com at ciphermail.private): Error: Corrupted index cache file /var/vmail/martijn=djigzo.com at ciphermail.private/dovecot.index.cache: Broken physical size for mail UID 76 Dec 14 16:09:55 ciphermail-webmail dovecot: imap(martijn=djigzo.com at ciphermail.private): Error: read() failed: Invalid argument Dec 14 16:10:02 ciphermail-webmail dovecot: imap(martijn=djigzo.com at ciphermail.private): Error: Cached message size smaller than expected (773 < 777) Dec 14 16:10:02 ciphermail-webmail dovecot: imap(martijn=djigzo.com at ciphermail.private): Error: Maildir filename has wrong S value, renamed the file from /var/vmail/martijn=djigzo.com at ciphermail.private/cur/1387033802.M114583P9631.ciphermail-webmail,S=773,W=791:2, t A do-nothing filter that just sends the input to the output works but whenever I add something trivial to the message, the cache is always corrupted. I using Dovecot 2.2.9.1 (from the deb archives). I use the following trivial test to add some XXX chars and and later remove them. In mail-filter.sh I append some chars and in mail-filter-out I filter these chars out (this is just a test) cat > /tmp/dovecot-in.txt echo "XXX" >> /tmp/dovecot-in.txt cat /tmp/dovecot-in.txt mail-filter-out: cat > /tmp/dovecot-out.txt sed -i /XXX/d /tmp/dovecot-out.txt cat /tmp/dovecot-out.txt Any idea what I'm doing wrong? Kind regards, Martijn Brinkers From tss at iki.fi Sat Dec 14 17:21:54 2013 From: tss at iki.fi (Timo Sirainen) Date: Sat, 14 Dec 2013 17:21:54 +0200 Subject: [Dovecot] mail-filter always results in corrupted indexes In-Reply-To: <52AC76EA.2000704@gmail.com> References: <52AC76EA.2000704@gmail.com> Message-ID: On 14.12.2013, at 17.19, martijn.list wrote: > I'm experimenting with the mail-filter plugin but whenever I add > anything to a message, it always results in an corrupted cache: You can't currently change the message with mail-filter plugin. That would require some additional changes to it. From wdehoog at exalondelft.nl Sat Dec 14 17:27:38 2013 From: wdehoog at exalondelft.nl (W. de Hoog) Date: Sat, 14 Dec 2013 16:27:38 +0100 Subject: [Dovecot] search gives variable/different results Message-ID: <52AC78EA.2070404@exalondelft.nl> Hi, When I perform a search using doveadm every time it returns different results. For example: $ doveadm search mailbox shared/\* TO stromvers 938ff10527d6be515f5900007b46f991 6 938ff10527d6be515f5900007b46f991 7 938ff10527d6be515f5900007b46f991 8 $ doveadm search mailbox shared/\* TO stromvers 6a8ff10527d6be515f5900007b46f991 1 6a8ff10527d6be515f5900007b46f991 3 6a8ff10527d6be515f5900007b46f991 4 938ff10527d6be515f5900007b46f991 1 938ff10527d6be515f5900007b46f991 2 938ff10527d6be515f5900007b46f991 3 938ff10527d6be515f5900007b46f991 6 938ff10527d6be515f5900007b46f991 7 938ff10527d6be515f5900007b46f991 8 $ doveadm search mailbox shared/\* TO stromvers 938ff10527d6be515f5900007b46f991 6 938ff10527d6be515f5900007b46f991 7 938ff10527d6be515f5900007b46f991 8 $ doveadm search mailbox shared/\* TO stromvers 938ff10527d6be515f5900007b46f991 7 938ff10527d6be515f5900007b46f991 8 $ doveadm search mailbox shared/\* TO stromvers 6a8ff10527d6be515f5900007b46f991 1 6a8ff10527d6be515f5900007b46f991 3 6a8ff10527d6be515f5900007b46f991 4 $ dovecot -n # 2.2.9 (5c170e0786f3): /etc/dovecot/dovecot.conf # OS: Linux 3.12.0-031200-generic x86_64 Ubuntu 13.10 auth_verbose = yes disable_plaintext_auth = no log_path = /var/log/dovecot.log mail_debug = yes mail_plugins = fts fts_squat mail_privileged_group = mail namespace { hidden = yes inbox = yes list = no location = mbox:~/mail:INBOX=/var/mail/%u prefix = "#mbox/" separator = / } namespace { list = yes location = sdbox:/home/imapshared-sdbox prefix = shared/ separator = / subscriptions = no type = public } namespace inbox { location = sdbox:~/sdboxmail mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { driver = pam } plugin { fts = squat fts_autoindex = yes fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap" ssl_cert = Hi there, I've started work on a side project that I've been long wanting to do; better HTML archives of email. https://github.com/kaihendry/imap2json I'm just designing the JSON schema atm, and I thought it would be good to get your feedback (Esp Timo) before I make a horrible mistake. https://github.com/kaihendry/imap2json/blob/master/JSON-design.mdwn Is it a good idea to base the id of a converation by the sha1sum of the first message for example? Any other tips or words of encouragement would be great. Kind regards, From kirill.shutemov at linux.intel.com Sat Dec 14 18:39:30 2013 From: kirill.shutemov at linux.intel.com (Kirill A. Shutemov) Date: Sat, 14 Dec 2013 18:39:30 +0200 (EET) Subject: [Dovecot] File descriptor leak in sieve-extprograms In-Reply-To: <52AC2DC8.4030508@rename-it.nl> References: <20131213010751.AD240E0090@blue.fi.intel.com> <52AB70AC.1030201@rename-it.nl> <20131213221430.EDA5BE0090@blue.fi.intel.com> <52AC2DC8.4030508@rename-it.nl> Message-ID: <20131214163930.96645E0090@blue.fi.intel.com> Stephan Bosch wrote: > On 12/13/2013 11:14 PM, Kirill A. Shutemov wrote: > > Stephan Bosch wrote: > >> This probably fixes it, although I am not entirely sure. I am mainly a > >> bit puzzled on how this causes the fd leak; the fd_in and fd_out are for > >> the current backends always the same fd. > > fd_in is not opened in my case: -1 all the way. I use vnd.dovecot.pipe. > > Ah right, that explains it. > > > I've hackaround sieve-filter crash with the ugly patch. I don't know how to fix > > this properly. > > Could you provide more details of your setup (configuration, > sieve-filter command line, Sieve script), so that I can reproduce the > problem at this end? Command: sieve-filter -e -v -W ~/.dovecot.sieve INBOX expunge Script: # vim: set ft=sieve : require ["date", "variables", "fileinto", "mailbox", "vnd.dovecot.pipe"]; if date :matches :originalzone "date" "day" "*" { set "day" "${1}"; } if date :matches :originalzone "date" "month" "*" { set "month" "${1}"; } if date :matches :originalzone "date" "year" "*" { set "year" "${1}"; } if anyof ( exists "List-id", address :matches :domain "from" "*plus.google.com", header :contains "Message-Id" "forum.ixbt.com", address :matches :domain "from" "*livejournal.com", address :matches :domain "from" "*youtube.com", address :is "to" "git-update-subscribers at altlinux.org" ) { pipe "notmuch" [ "insert", "--folder=${year}/${month}/${day}", "--create-folder", "-new", "-inbox", "+unread", "+lists" ]; } else { pipe "notmuch" [ "insert", "--folder=${year}/${month}/${day}", "--create-folder", "-new", "+inbox", "+unread" ]; } -- Kirill A. Shutemov From martijn.list at gmail.com Sat Dec 14 18:49:18 2013 From: martijn.list at gmail.com (martijn.list) Date: Sat, 14 Dec 2013 17:49:18 +0100 Subject: [Dovecot] mail-filter always results in corrupted indexes In-Reply-To: <52AC76EA.2000704@gmail.com> References: <52AC76EA.2000704@gmail.com> Message-ID: <52AC8C0E.9050105@gmail.com> It turns out that I was ding it wrong. The mail filter should return the exact same message as it was received including CR/LF endings. After some changes of my code it works. Kind regards, Martijn On 12/14/2013 04:19 PM, martijn.list wrote: > Hi, > > I'm experimenting with the mail-filter plugin but whenever I add > anything to a message, it always results in an corrupted cache: > > from the logs: > > Dec 14 16:09:55 ciphermail-webmail dovecot: > imap(martijn=djigzo.com at ciphermail.private): Error: Corrupted index > cache file > /var/vmail/martijn=djigzo.com at ciphermail.private/dovecot.index.cache: > Broken physical size for mail UID 76 > Dec 14 16:09:55 ciphermail-webmail dovecot: > imap(martijn=djigzo.com at ciphermail.private): Error: read() failed: > Invalid argument > Dec 14 16:10:02 ciphermail-webmail dovecot: > imap(martijn=djigzo.com at ciphermail.private): Error: Cached message size > smaller than expected (773 < 777) > Dec 14 16:10:02 ciphermail-webmail dovecot: > imap(martijn=djigzo.com at ciphermail.private): Error: Maildir filename has > wrong S value, renamed the file from > /var/vmail/martijn=djigzo.com at ciphermail.private/cur/1387033802.M114583P9631.ciphermail-webmail,S=773,W=791:2, > t > > A do-nothing filter that just sends the input to the output works but > whenever I add something trivial to the message, the cache is always > corrupted. > > I using Dovecot 2.2.9.1 (from the deb archives). > > I use the following trivial test to add some XXX chars and and later > remove them. > > In mail-filter.sh I append some chars and in mail-filter-out I filter > these chars out (this is just a test) > > cat > /tmp/dovecot-in.txt > > echo "XXX" >> /tmp/dovecot-in.txt > > cat /tmp/dovecot-in.txt > > mail-filter-out: > > cat > /tmp/dovecot-out.txt > > sed -i /XXX/d /tmp/dovecot-out.txt > > cat /tmp/dovecot-out.txt > > > Any idea what I'm doing wrong? > > Kind regards, > > Martijn Brinkers > -- DJIGZO email encryption From stan at email-prive.net Fri Dec 13 17:00:24 2013 From: stan at email-prive.net (Stanislas SABATIER) Date: Fri, 13 Dec 2013 16:00:24 +0100 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: Message-ID: <25D9A6EB-74E9-4948-9C17-7D95D6C12FCE@email-prive.net> Thanks for the info, I'll dig this option. Regards, Stan. Le 13 d?c. 2013 ? 15:47, Timo Sirainen a ?crit : > On 13.12.2013, at 16.37, Stanislas SABATIER wrote: > >> Is there a way to retrieve the client's password in plain text from memory ? >> >> I don't store the password in plain text in my postgreSQL but I need it >> when the client is connected to make crypto computation. >> >> If I write a plugin to do the job, how could I retrieve the plain text >> password from master ? > > Assuming you you're using passdb sql and userdb prefetch and you want to access the password in imap/pop3/etc process, you can do: > > password_query = '%w' as userdb_password, ... > > Then the password will be available the same way as plugin { password } would be available (mail_user_plugin_getenv()). > > You could also write a passdb plugin you could access the password directly from auth_request->mech_password. > From sam at tacomatelematics.com Sat Dec 14 20:05:54 2013 From: sam at tacomatelematics.com (Sam Mulvey) Date: Sat, 14 Dec 2013 10:05:54 -0800 Subject: [Dovecot] Possible pigeonhole dealing with negative numerical values Message-ID: <52AC9E02.50602@tacomatelematics.com> Using dovecot 2.2.9 and pigeonhole 0.4.2 The system is a Xen VM running Arch Linux x86_64, presently up to date, on an XFS filesystem in an LVM2 partition. After recently updating my mail server, I found that a sieve rule I had which would check X-Spam-Score for a value over a certain number, in my case 2.5. In my most recent update, negative values would trip the rule. Here's the rule in question: # rule:[Spam Filter Subject] if anyof (header :contains "Subject" "[SPAM]", header :value "gt" :comparator "i;as cii-numeric" "X-Spam-Score" "2.5") { fileinto "Spam Box"; stop; } I have a successful work-around by checking the numerical value and also insuring that the header doesn't contain a '-', and things work as they should. Possible the bug could be in my Sieve interface, which is a RoundCube plugin. Otherwise things are working great. If there's anything I can add, please let me know. Thanks! -Sam dovecot -n output: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.12.4-1-ARCH x86_64 xfs auth_cache_size = 512 k auth_cache_ttl = 10 mins auth_mechanisms = plain login auth_verbose = yes default_internal_user = mailstore first_valid_gid = 50 first_valid_uid = 50 hostname = tacomatelematics.com last_valid_gid = 50 last_valid_uid = 50 lda_mailbox_autocreate = yes mail_gid = 50 mail_location = maildir:/var/spool/mail/%d/%n/Maildir/ mail_privileged_group = postfix mail_uid = 50 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at tacomatelematics.com protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = mailstore mode = 01130 user = mailstore } unix_listener auth-userdb { group = mailstore mode = 0600 user = mailstore } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = References: <52AC9E02.50602@tacomatelematics.com> Message-ID: <52ACCF88.2060309@rename-it.nl> On 12/14/2013 7:05 PM, Sam Mulvey wrote: > Using dovecot 2.2.9 and pigeonhole 0.4.2 > > The system is a Xen VM running Arch Linux x86_64, presently up to date, > on an XFS filesystem in an LVM2 partition. After recently updating my > mail server, I found that a sieve rule I had which would check > X-Spam-Score for a value over a certain number, in my case 2.5. In my > most recent update, negative values would trip the rule. > > Here's the rule in question: > > # rule:[Spam Filter Subject] > if anyof (header :contains "Subject" "[SPAM]", header :value "gt" > :comparator "i;as > cii-numeric" "X-Spam-Score" "2.5") > { > fileinto "Spam Box"; > stop; > } http://tools.ietf.org/html/rfc5231#section-3 : `Note: the "i;ascii-numeric" comparator does not support negative numbers.` > I have a successful work-around by checking the numerical value and also > insuring that the header doesn't contain a '-', and things work as they > should. Possible the bug could be in my Sieve interface, which is a > RoundCube plugin. Otherwise things are working great. > > If there's anything I can add, please let me know. Thanks! Checking for a minus is a good workaround. However, there is also a special set of nice Sieve extensions for the purpose of checking spam score: http://tools.ietf.org/html/rfc5235 . It requires some configuration at the server (http://wiki2.dovecot.org/Pigeonhole/Sieve/Extensions/SpamtestVirustest), so it may not always be available. Of course, Roundcube also needs to support it for it to be useful, but I am not sure whether it can normally use those extensions. A quick peek at the sources of the managesieve plugin shows that it probably doesn't support the spamtest extension: https://github.com/roundcube/roundcubemail/blob/master/plugins/managesieve/lib/Roundcube/rcube_sieve_script.php#L29 I also took a quick peek at the source code of JohnDoh's sieverules plugin for RoundCube, and it looks like that one does have support for it. Note that that is a different (more feature-rich) Sieve plugin than the managesieve plugin included in the RoundCube distribution itself. Regards, Stephan. From sm at sami-mantysaari.biz Sun Dec 15 00:45:19 2013 From: sm at sami-mantysaari.biz (=?ISO-8859-1?Q?Sami_M=E4ntysaari?=) Date: Sun, 15 Dec 2013 00:45:19 +0200 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem Message-ID: <52ACDF7F.8040003@sami-mantysaari.biz> Hello all readers of the list, I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. Logs when trying to setup accaunt in Microsoft Outlook 2010: ec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:32 ip-172-31-7-147 dovecot: pop3-login: Aborted login (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:39:17 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:18 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after STARTTLS from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after STARTTLS from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after EHLO from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after EHLO from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:40:13 ip-172-31-7-147 dovecot: imap-login: Login: user=, method=PLAIN, rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, mpid=8243, TLS Dec 14 22:40:57 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:57 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:44 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection rate 3/60s for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:24 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection count 1 for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:22 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max cache size 2 at Dec 14 22:39:22 Telnet log while connected over IPV6 to port 587 on mail server: Trying 2001:470:1f08:ddd::2... Connected to 2001:470:1f08:ddd::2. Escape character is '^]'. 220 mail.sami-mantysaari.biz ESMTP Postfix ehlo samip537.tk 250-mail.sami-mantysaari.biz 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN quit 221 2.0.0 Bye Connection closed by foreign host. Any seggestions what to try in order to get this to work? From h.reindl at thelounge.net Sun Dec 15 00:50:15 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 14 Dec 2013 23:50:15 +0100 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACDF7F.8040003@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> Message-ID: <52ACE0A7.7000905@thelounge.net> Am 14.12.2013 23:45, schrieb Sami M?ntysaari: > Hello all readers of the list, > > I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. > > Logs when trying to setup accaunt in Microsoft Outlook 2010: whatever "mail-stack-delivery" is meant to be Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth) don't disable plaintext authentication *or* configure the client to *not* use plaintext auth there is nothing between -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From sm at sami-mantysaari.biz Sun Dec 15 00:52:58 2013 From: sm at sami-mantysaari.biz (=?ISO-8859-1?Q?Sami_M=E4ntysaari?=) Date: Sun, 15 Dec 2013 00:52:58 +0200 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACE0A7.7000905@thelounge.net> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE0A7.7000905@thelounge.net> Message-ID: <52ACE14A.2070309@sami-mantysaari.biz> Hello, mail-stack-delivery is from of integration of Dovecot + Postfix for easier setup. 15.12.2013 0:50, Reindl Harald kirjoitti: > > Am 14.12.2013 23:45, schrieb Sami M?ntysaari: >> Hello all readers of the list, >> >> I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. >> >> Logs when trying to setup accaunt in Microsoft Outlook 2010: > whatever "mail-stack-delivery" is meant to be > > Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried > to use disabled plaintext auth) > > don't disable plaintext authentication *or* configure > the client to *not* use plaintext auth > > there is nothing between > From sm at sami-mantysaari.biz Sun Dec 15 01:04:43 2013 From: sm at sami-mantysaari.biz (=?ISO-8859-1?Q?Sami_M=E4ntysaari?=) Date: Sun, 15 Dec 2013 01:04:43 +0200 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACE14A.2070309@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE0A7.7000905@thelounge.net> <52ACE14A.2070309@sami-mantysaari.biz> Message-ID: <52ACE40B.60606@sami-mantysaari.biz> Also the Microsoft Outlook 2010 was not able to find ANY auth methods that it could log in with and i have no clue how to solve that. 15.12.2013 0:52, Sami M?ntysaari kirjoitti: > Hello, > > mail-stack-delivery is from of integration of Dovecot + Postfix for > easier setup. > > 15.12.2013 0:50, Reindl Harald kirjoitti: >> Am 14.12.2013 23:45, schrieb Sami M?ntysaari: >>> Hello all readers of the list, >>> >>> I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. >>> >>> Logs when trying to setup accaunt in Microsoft Outlook 2010: >> whatever "mail-stack-delivery" is meant to be >> >> Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried >> to use disabled plaintext auth) >> >> don't disable plaintext authentication *or* configure >> the client to *not* use plaintext auth >> >> there is nothing between >> From d.parthey at metaways.de Sun Dec 15 01:20:15 2013 From: d.parthey at metaways.de (Daniel Parthey) Date: Sun, 15 Dec 2013 00:20:15 +0100 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACDF7F.8040003@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> Message-ID: <52ACE7AF.6070106@metaways.de> Hi Sami, please read carefully: http://www.dovecot.org/mailinglists.html You're missing some points: * Mention the Dovecot version number. Use dovecot --version to get it. * Use dovecot -n output when showing your configuration * How does your network setup look like? Which service connects where? * What would you expect dovecot to do? * What happens actually? Regards Daniel -- Dipl.-Inf. Daniel Parthey System Engineer Metaways Infosystems GmbH Pickhuben 2, D-20457 Hamburg E-Mail: d.parthey at metaways.de Web: http://www.metaways.de Metaways Infosystems GmbH - Sitz: D-22967 Tremsb?ttel Handelsregister: Amtsgericht L?beck HRB 4508 AH Gesch?ftsf?hrung: Hermann Thaele, L?der-H.Thaele From rs at sys4.de Sun Dec 15 09:20:29 2013 From: rs at sys4.de (Robert Schetterer) Date: Sun, 15 Dec 2013 08:20:29 +0100 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACE14A.2070309@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE0A7.7000905@thelounge.net> <52ACE14A.2070309@sami-mantysaari.biz> Message-ID: <52AD583D.3000101@sys4.de> Am 14.12.2013 23:52, schrieb Sami M?ntysaari: > Hello, > > mail-stack-delivery is from of integration of Dovecot + Postfix for > easier setup. > > 15.12.2013 0:50, Reindl Harald kirjoitti: >> >> Am 14.12.2013 23:45, schrieb Sami M?ntysaari: >>> Hello all readers of the list, >>> >>> I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. >>> >>> Logs when trying to setup accaunt in Microsoft Outlook 2010: >> whatever "mail-stack-delivery" is meant to be >> >> Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried >> to use disabled plaintext auth) >> >> don't disable plaintext authentication *or* configure >> the client to *not* use plaintext auth >> >> there is nothing between >> > mail-stack-delivery sounds like buzz word, however i confirm dovecot/postfix working Outlook 2010 with it, so bug is in your setup post your config etc Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From martijn.list at gmail.com Sun Dec 15 11:53:29 2013 From: martijn.list at gmail.com (martijn.list) Date: Sun, 15 Dec 2013 10:53:29 +0100 Subject: [Dovecot] Is mail deleted when mail-filter fails? Message-ID: <52AD7C19.3000807@gmail.com> Hi, While experimenting with the mail-filter, during some tests my filter failed with a non-zero exit code and did not write any data to the output. This seems to result in a lost email. Is this correct? Is there a way to gracefully handle error from a mail-filter out script? Kind regards, Martijn Brinkers From martijn.list at gmail.com Sun Dec 15 12:11:58 2013 From: martijn.list at gmail.com (martijn.list) Date: Sun, 15 Dec 2013 11:11:58 +0100 Subject: [Dovecot] Is mail deleted when mail-filter fails? In-Reply-To: <52AD7C19.3000807@gmail.com> References: <52AD7C19.3000807@gmail.com> Message-ID: <52AD806E.8080705@gmail.com> Hmm I seems to have the habit of answering my own emails on this list due to my own stupidity ;) (note to self: wait some time before asking a question). It turns out that the LDA delivery agent did not succeed so the email was still in the MTA queue. In other words, the email was not delivered and was retried. Kind regards, Martijn Brinkers On 12/15/2013 10:53 AM, martijn.list wrote: > Hi, > > While experimenting with the mail-filter, during some tests my filter > failed with a non-zero exit code and did not write any data to the > output. This seems to result in a lost email. Is this correct? Is there > a way to gracefully handle error from a mail-filter out script? > > Kind regards, > > Martijn Brinkers > From sm at sami-mantysaari.biz Sun Dec 15 14:29:58 2013 From: sm at sami-mantysaari.biz (=?ISO-8859-1?Q?Sami_M=E4ntysaari?=) Date: Sun, 15 Dec 2013 14:29:58 +0200 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACE7AF.6070106@metaways.de> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE7AF.6070106@metaways.de> Message-ID: <52ADA0C6.8060700@sami-mantysaari.biz> Providing the info requested now. dovecot --version: 2.0.19 dovecot -n: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-54-virtual x86_64 Ubuntu 12.04.3 LTS ext4 mail_location = maildir:/var/spool/mail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = was automatically rejected:%n%r } Mail server has IPV4/IPV6 address of: 54.193.41.94 / 2001:470:1f08:ddd::2 Client IPV4 / IPV6 address: 88.195.204.203 / 2001:470:28:743:4923:c01c:c89a:567a Dovecot should allow Microsoft Outlook 2010 Email Client to connect, but it wont. Outlook tries to use disabled plaintext authenication when it's not able to find encrypted method to log in. Hope this helps. 15.12.2013 1:20, Daniel Parthey kirjoitti: > Hi Sami, > > please read carefully: > http://www.dovecot.org/mailinglists.html > > You're missing some points: > > * Mention the Dovecot version number. Use dovecot --version to get it. > * Use dovecot -n output when showing your configuration > * How does your network setup look like? Which service connects where? > * What would you expect dovecot to do? > * What happens actually? > > Regards > Daniel From martijn.list at gmail.com Sun Dec 15 15:05:44 2013 From: martijn.list at gmail.com (martijn.list) Date: Sun, 15 Dec 2013 14:05:44 +0100 Subject: [Dovecot] mail-filter always results in corrupted indexes In-Reply-To: References: <52AC76EA.2000704@gmail.com> Message-ID: <52ADA928.30309@gmail.com> On 12/14/2013 04:21 PM, Timo Sirainen wrote: > On 14.12.2013, at 17.19, martijn.list wrote: > >> I'm experimenting with the mail-filter plugin but whenever I add >> anything to a message, it always results in an corrupted cache: > > You can't currently change the message with mail-filter plugin. That would require some additional changes to it. Would be nice if the email could be changed. Right now you need to be absolutely certain that the email is not changed in any way. even accidentally changing CR/LF to LF results in cache corruption. To support modifying the email, does it require changes to the plugin or to Dovecot core? Kind regards, Martijn Brinkers From openmsk at gmail.com Mon Dec 16 09:40:46 2013 From: openmsk at gmail.com (John Smith) Date: Mon, 16 Dec 2013 11:40:46 +0400 Subject: [Dovecot] letters local filter duplicated In-Reply-To: References: <529F0B20.6000002@Media-Brokers.com> Message-ID: two servers with replicated master/master. with this setup letters processed local filter duplicated. ?ie when the mail client receives a letter begins processing using rules (filters) to move the letters in a different folder. summarized in this folder is two duplicate letters.? if you disable the filter, the message is not duplicated. But does not move to another location. both servers are configured identically, except "mail_replica = tcp:ip_server2:4092" # doveconf -n # 2.2.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_mechanisms = plain login auth_use_winbind = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no doveadm_password = pa$$word dsync_remote_cmd = doveadm dsync-server -u%u hostname = s1mx1ls.city.local listen = * mail_access_groups = vmail mail_gid = 5000 mail_location = mdbox:~/:LAYOUT=fs mail_plugins = " quota acl notify replication" mail_privileged_group = vmail mail_uid = 5000 mbox_write_locks = fcntl namespace { hidden = no list = children location = mdbox:~/:INDEX=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = dovecot driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/acls acl_shared_dict = file:/home/vmail/shared-mailboxes.db mail_replica = tcp:192.168.3.14:4092 quota = dirsize:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+10%% quota_rule3 = Sent:storage=+20%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u replication_full_sync_interval = 1 hours } service aggregator { fifo_listener replication-notify-fifo { user = vmail } process_limit = 100 process_min_avail = 3 unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { mode = 0666 user = vmail } } service config { unix_listener config { mode = 0600 user = vmail } } service doveadm { inet_listener { port = 4092 } process_limit = 100 process_min_avail = 3 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service replicator { process_limit = 100 process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 } } ssl_cert = Hello, I am trying to setup samba4/openchange and dovecot. Does anyone has experiences concering dovecot connecting to samba4 ?? I tried the following: /etc/dovecot.conf: protocols = imap sieve mail_location = maildir:/data/mail/%d/%n/Maildir mail_access_groups = vmail mail_privileged_group = vmail first_valid_uid = 110 last_valid_uid = 110 first_valid_gid = 115 last_valid_gid = 115 log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Welcome to domain.local. service imap { inet_listener { port=143 } } protocol lda { log_path = /var/log/mail/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster at domain.local mail_plugins = sieve } service managesieve { inet_listener { port=12000 } } auth_verbose = yes auth_debug = yes service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } } #service auth-userdb { # user = vmail # } #user = root #} passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } plugin { sieve = /data/mail/%d/%n/sieverc sieve_storage=/data/mail/%d/%n/sieve sieve_max_redirects = 20 } debug_log_path = /var/log/dovecot-debug.log dict { } /etc/dovecot/dovecot-ldap-passdb.conf hosts = localhost auth_bind = yes auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local ldap_version = 3 base = cn=Users,dc=domain,dc=local pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) /etc/dovecot/dovecot-ldap-userdb.conf: hosts = localhost dn = cn=ldap,cn=Users,DC=domain,DC=local dnpass = password ldap_version = 3 base = cn=Users,DC=domain,DC=local #user_attrs = user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir user_filter = (&(objectClass=person)(cn=%u)(mail=*)) iterate_attrs = cn=user iterate_filter = (objectClass=person) When I try to login with useraccountadministrator I get the following error messages: 2013-12-16 11:28:29 auth: Info: ldap(ldap,127.0.0.1,): unknown user 2013-12-16 11:28:29 auth: Error: userdb(ldap,127.0.0.1,): user not found from userdb ldap 2013-12-16 11:28:29 imap: Error: Authenticated user not found from userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) 2013-12-16 11:28:29 imap-login: Info: Internal login failure (pid=3809 id=1) (internal failure, 1 succesful auths): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, session= Can someone tell me what I am doing wrong, or is there way to test to dovecot ldap connection string ?? Cheers, - Pascal -- Pascal den Bekker Linux System Administrator Affinitas GmbH | Kohlfurter Stra?e 41/43 | 10999 Berlin | Germany email: pascal_den.bekker at affinitas.de | tel: +49 30 868 000 140 www.edarling.de | www.shopaman.de Gesch?ftsf?hrer: Lukas Brosseder, David Khalil, Michael Schrezenmaier Eingetragen beim Amtsgericht Berlin-Charlottenburg, HRB 115958 From CMarcus at Media-Brokers.com Mon Dec 16 15:20:17 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 16 Dec 2013 08:20:17 -0500 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ACE7AF.6070106@metaways.de> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE7AF.6070106@metaways.de> Message-ID: <52AEFE11.1080903@Media-Brokers.com> On 2013-12-14 6:20 PM, Daniel Parthey wrote: > * Mention the Dovecot version number. Use dovecot --version to get it. > * Use dovecot -n output when showing your configuration Don't need the first - dovecot version is included with doveconf -n output. From CMarcus at Media-Brokers.com Mon Dec 16 15:24:20 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 16 Dec 2013 08:24:20 -0500 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52ADA0C6.8060700@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE7AF.6070106@metaways.de> <52ADA0C6.8060700@sami-mantysaari.biz> Message-ID: <52AEFF04.4090406@Media-Brokers.com> On 2013-12-15 7:29 AM, Sami M?ntysaari wrote: > dovecot -n: > # 2.0.19: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-54-virtual x86_64 Ubuntu 12.04.3 LTS ext4 > mail_location = maildir:/var/spool/mail/%u > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > passdb { > driver = pam > } I don't see anything for auth_mechanism or ports to listen on... Also, 2.0.xxx is no longer supported, best to upgrade at least to latest 2.1, but if you're going to do that might as well go to latest 2.2... From CMarcus at Media-Brokers.com Mon Dec 16 15:29:20 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 16 Dec 2013 08:29:20 -0500 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AEDB43.3020807@affinitas.de> References: <52AEDB43.3020807@affinitas.de> Message-ID: <52AF0030.8030308@Media-Brokers.com> On 2013-12-16 5:51 AM, Pascal den Bekker wrote: > I am trying to setup samba4/openchange and dovecot. Does anyone has > experiences concering dovecot connecting to samba4 ?? Have you heard of SOGo? It is a full blown integrated solution exactly like what you are trying to do yourself... It would probably be a lot easier using their packages, and you can ask questions on their support forums/lists... http://www.sogo.nu/ From pascal_den.bekker at affinitas.de Mon Dec 16 15:33:47 2013 From: pascal_den.bekker at affinitas.de (Pascal den Bekker) Date: Mon, 16 Dec 2013 14:33:47 +0100 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AF0030.8030308@Media-Brokers.com> References: <52AEDB43.3020807@affinitas.de> <52AF0030.8030308@Media-Brokers.com> Message-ID: <52AF013B.1010309@affinitas.de> Hey Marcus, well.. I am trying to that :-).. But somehow dovecot doesnt connect to samba4 :-) Cheers, - Pascal On 12/16/2013 02:29 PM, Charles Marcus wrote: > On 2013-12-16 5:51 AM, Pascal den Bekker > wrote: >> I am trying to setup samba4/openchange and dovecot. Does anyone has >> experiences concering dovecot connecting to samba4 ?? > > Have you heard of SOGo? > > It is a full blown integrated solution exactly like what you are > trying to do yourself... > > It would probably be a lot easier using their packages, and you can > ask questions on their support forums/lists... > > http://www.sogo.nu/ > -- Pascal den Bekker Linux System Administrator Affinitas GmbH | Kohlfurter Stra?e 41/43 | 10999 Berlin | Germany email: pascal_den.bekker at affinitas.de | tel: +49 30 868 000 140 www.edarling.de | www.shopaman.de Gesch?ftsf?hrer: Lukas Brosseder, David Khalil, Michael Schrezenmaier Eingetragen beim Amtsgericht Berlin-Charlottenburg, HRB 115958 From CMarcus at Media-Brokers.com Mon Dec 16 15:43:00 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 16 Dec 2013 08:43:00 -0500 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AF013B.1010309@affinitas.de> References: <52AEDB43.3020807@affinitas.de> <52AF0030.8030308@Media-Brokers.com> <52AF013B.1010309@affinitas.de> Message-ID: <52AF0364.6080909@Media-Brokers.com> On 2013-12-16 8:33 AM, Pascal den Bekker wrote: > Hey Marcus, > > well.. I am trying to that :-).. But somehow dovecot doesnt connect to > samba4 :-) Oh, ok... so, you've asked on their support forums/email lists, and no help? I'm surprised... From achim at ag-web.biz Mon Dec 16 16:37:21 2013 From: achim at ag-web.biz (Achim Gottinger) Date: Mon, 16 Dec 2013 15:37:21 +0100 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AEDB43.3020807@affinitas.de> References: <52AEDB43.3020807@affinitas.de> Message-ID: <52AF1021.2060004@ag-web.biz> Hi, Added a few corrections to your config below. Hope it works. achim~ Am 16.12.2013 11:51, schrieb Pascal den Bekker: > Hello, > > I am trying to setup samba4/openchange and dovecot. Does anyone has > experiences concering dovecot connecting to samba4 ?? > > I tried the following: > > /etc/dovecot.conf: > > protocols = imap sieve > mail_location = maildir:/data/mail/%d/%n/Maildir > mail_access_groups = vmail > mail_privileged_group = vmail > first_valid_uid = 110 > last_valid_uid = 110 last_valid_uid = 5000 > first_valid_gid = 115 > last_valid_gid = 115 last_valid_gid = 5000 Your vmail user/group seems to have the uid/gid 5000 so it must be in the valid range. > log_path = /var/log/dovecot > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_greeting = Welcome to domain.local. > > service imap { > inet_listener { > port=143 > } > } > > protocol lda { > log_path = /var/log/mail/dovecot-deliver.log > auth_socket_path = /var/run/dovecot/auth-master > postmaster_address = postmaster at domain.local > mail_plugins = sieve > } > > service managesieve { > inet_listener { > port=12000 > } > } > > auth_verbose = yes > auth_debug = yes > > service auth { > unix_listener /var/spool/postfix/private/auth { > group = vmail > mode = 0660 > user = postfix > } > } > > #service auth-userdb { > # user = vmail > # } > #user = root > #} > > passdb { > args = /etc/dovecot/dovecot-ldap-passdb.conf > driver = ldap > } > > userdb { > args = /etc/dovecot/dovecot-ldap-userdb.conf > driver = ldap > } > > plugin { > sieve = /data/mail/%d/%n/sieverc > sieve_storage=/data/mail/%d/%n/sieve > sieve_max_redirects = 20 > } > > > debug_log_path = /var/log/dovecot-debug.log > > dict { > } > > /etc/dovecot/dovecot-ldap-passdb.conf > > hosts = localhost > auth_bind = yes > auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local > ldap_version = 3 > base = cn=Users,dc=domain,dc=local > pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) > hosts = localhost auth_bind = yes dn = cn=ldap,cn=Users,DC=domain,DC=local dnpass = password #auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local ldap_version = 3 base = cn=Users,dc=domain,dc=local pass_filter = (&(objectClass=person)(sAMAccountName=%u)(mail=*)) user_attrs=uid=5000 This way dovecot connects as user ldap does the user lookup according to pass_filter and uses the resulting dn for authetification. If you create users via the Windows Remote Management tools the dn for an user normaly uses the Full Name as cn and not the user id which is stored as sAMAccountName. > /etc/dovecot/dovecot-ldap-userdb.conf: > > hosts = localhost > dn = cn=ldap,cn=Users,DC=domain,DC=local > dnpass = password > ldap_version = 3 > base = cn=Users,DC=domain,DC=local > > #user_attrs = > user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir > > user_filter = (&(objectClass=person)(cn=%u)(mail=*)) > iterate_attrs = cn=user > iterate_filter = (objectClass=person) user_filter = (&(objectClass=person)(sAMAccountName=%u)(mail=*)) iterate_attrs = sAMAccountName=user > > When I try to login with useraccountadministrator I get the following > error messages: > > 2013-12-16 11:28:29 auth: Info: > ldap(ldap,127.0.0.1,): unknown user > 2013-12-16 11:28:29 auth: Error: > userdb(ldap,127.0.0.1,): user not found from userdb > ldap > 2013-12-16 11:28:29 imap: Error: Authenticated user not found from > userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) > 2013-12-16 11:28:29 imap-login: Info: Internal login failure (pid=3809 > id=1) (internal failure, 1 succesful auths): user=, > method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, > session= > > Can someone tell me what I am doing wrong, or is there way to test to > dovecot ldap connection string ?? > > Cheers, > > - Pascal > From pascal_den.bekker at affinitas.de Mon Dec 16 17:14:41 2013 From: pascal_den.bekker at affinitas.de (Pascal den Bekker) Date: Mon, 16 Dec 2013 16:14:41 +0100 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AF1021.2060004@ag-web.biz> References: <52AEDB43.3020807@affinitas.de> <52AF1021.2060004@ag-web.biz> Message-ID: <52AF18E1.8040206@affinitas.de> Hey Achim, thank you for your help :-) Unfortunately it did not work :-( I changed the lines in the dovecot config you sent me.. When I try to login into the sogo gui, im getting the following error message: 2013-12-16 16:10:07 auth: Info: ldap(administrator,127.0.0.1,): unknown user 2013-12-16 16:10:07 auth: Error: userdb(administrator,127.0.0.1,): user not found from userdb ldap 2013-12-16 16:10:07 imap: Error: Authenticated user not found from userdb, auth lookup id=4126670849 (client-pid=5503 client-id=1) 2013-12-16 16:10:07 imap-login: Info: Internal login failure (pid=5503 id=1) (internal failure, 1 succesful auths): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=5504, secured, session= When I look in samba4: samba-tool user list Administrator krbtgt Guest ldap The user seems to be there..:-( Cheers, - Pascal On 12/16/2013 03:37 PM, Achim Gottinger wrote: > Hi, > > Added a few corrections to your config below. Hope it works. > > achim~ > > > Am 16.12.2013 11:51, schrieb Pascal den Bekker: >> Hello, >> >> I am trying to setup samba4/openchange and dovecot. Does anyone has >> experiences concering dovecot connecting to samba4 ?? >> >> I tried the following: >> >> /etc/dovecot.conf: >> >> protocols = imap sieve >> mail_location = maildir:/data/mail/%d/%n/Maildir >> mail_access_groups = vmail >> mail_privileged_group = vmail >> first_valid_uid = 110 >> last_valid_uid = 110 > last_valid_uid = 5000 >> first_valid_gid = 115 >> last_valid_gid = 115 > last_valid_gid = 5000 > > Your vmail user/group seems to have the uid/gid 5000 so it must be in > the valid range. >> log_path = /var/log/dovecot >> log_timestamp = "%Y-%m-%d %H:%M:%S " >> login_greeting = Welcome to domain.local. >> >> service imap { >> inet_listener { >> port=143 >> } >> } >> >> protocol lda { >> log_path = /var/log/mail/dovecot-deliver.log >> auth_socket_path = /var/run/dovecot/auth-master >> postmaster_address = postmaster at domain.local >> mail_plugins = sieve >> } >> >> service managesieve { >> inet_listener { >> port=12000 >> } >> } >> >> auth_verbose = yes >> auth_debug = yes >> >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = vmail >> mode = 0660 >> user = postfix >> } >> } >> >> #service auth-userdb { >> # user = vmail >> # } >> #user = root >> #} >> >> passdb { >> args = /etc/dovecot/dovecot-ldap-passdb.conf >> driver = ldap >> } >> >> userdb { >> args = /etc/dovecot/dovecot-ldap-userdb.conf >> driver = ldap >> } >> >> plugin { >> sieve = /data/mail/%d/%n/sieverc >> sieve_storage=/data/mail/%d/%n/sieve >> sieve_max_redirects = 20 >> } >> >> >> debug_log_path = /var/log/dovecot-debug.log >> >> dict { >> } >> >> /etc/dovecot/dovecot-ldap-passdb.conf >> >> hosts = localhost >> auth_bind = yes >> auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local >> ldap_version = 3 >> base = cn=Users,dc=domain,dc=local >> pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) >> > hosts = localhost > auth_bind = yes > dn = cn=ldap,cn=Users,DC=domain,DC=local > dnpass = password > #auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local > ldap_version = 3 > base = cn=Users,dc=domain,dc=local > pass_filter = (&(objectClass=person)(sAMAccountName=%u)(mail=*)) > user_attrs=uid=5000 > > This way dovecot connects as user ldap does the user lookup according > to pass_filter and uses the resulting dn for authetification. If you > create users via the Windows Remote Management tools the dn for an > user normaly uses the Full Name as cn and not the user id which is > stored as sAMAccountName. >> /etc/dovecot/dovecot-ldap-userdb.conf: >> >> hosts = localhost >> dn = cn=ldap,cn=Users,DC=domain,DC=local >> dnpass = password >> ldap_version = 3 >> base = cn=Users,DC=domain,DC=local >> >> #user_attrs = >> user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir >> >> user_filter = (&(objectClass=person)(cn=%u)(mail=*)) >> iterate_attrs = cn=user >> iterate_filter = (objectClass=person) > user_filter = (&(objectClass=person)(sAMAccountName=%u)(mail=*)) > iterate_attrs = sAMAccountName=user >> >> When I try to login with useraccountadministrator I get the following >> error messages: >> >> 2013-12-16 11:28:29 auth: Info: >> ldap(ldap,127.0.0.1,): unknown user >> 2013-12-16 11:28:29 auth: Error: >> userdb(ldap,127.0.0.1,): user not found from userdb >> ldap >> 2013-12-16 11:28:29 imap: Error: Authenticated user not found from >> userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) >> 2013-12-16 11:28:29 imap-login: Info: Internal login failure >> (pid=3809 id=1) (internal failure, 1 succesful auths): user=, >> method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, >> session= >> >> Can someone tell me what I am doing wrong, or is there way to test to >> dovecot ldap connection string ?? >> >> Cheers, >> >> - Pascal >> > -- Pascal den Bekker Linux System Administrator Affinitas GmbH | Kohlfurter Stra?e 41/43 | 10999 Berlin | Germany email: pascal_den.bekker at affinitas.de | tel: +49 30 868 000 140 www.edarling.de | www.shopaman.de Gesch?ftsf?hrer: Lukas Brosseder, David Khalil, Michael Schrezenmaier Eingetragen beim Amtsgericht Berlin-Charlottenburg, HRB 115958 From Christian.Schmidt at chemie.uni-hamburg.de Mon Dec 16 17:35:23 2013 From: Christian.Schmidt at chemie.uni-hamburg.de (Christian Schmidt) Date: Mon, 16 Dec 2013 16:35:23 +0100 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AF18E1.8040206@affinitas.de> References: <52AEDB43.3020807@affinitas.de> <52AF1021.2060004@ag-web.biz> <52AF18E1.8040206@affinitas.de> Message-ID: <52AF1DBB.3000408@chemie.uni-hamburg.de> 16.12.2013 16:14, Pascal den Bekker: > I changed the lines in the dovecot config you sent me.. When I try to > login into the sogo gui, im getting the following error message: > > 2013-12-16 16:10:07 auth: Info: > ldap(administrator,127.0.0.1,): unknown user > 2013-12-16 16:10:07 auth: Error: > userdb(administrator,127.0.0.1,): user not found from > userdb ldap > 2013-12-16 16:10:07 imap: Error: Authenticated user not found from > userdb, auth lookup id=4126670849 (client-pid=5503 client-id=1) > 2013-12-16 16:10:07 imap-login: Info: Internal login failure (pid=5503 > id=1) (internal failure, 1 succesful auths): user=, > method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=5504, secured, > session= > > When I look in samba4: > > samba-tool user list > Administrator > krbtgt > Guest > ldap > > The user seems to be there..:-( Administrator is not the same as administrator - at least in the Unix part of the world... Regards, Christian -- No signature available. From achim at ag-web.biz Mon Dec 16 18:07:50 2013 From: achim at ag-web.biz (Achim Gottinger) Date: Mon, 16 Dec 2013 17:07:50 +0100 Subject: [Dovecot] connection Dovecot to samba4 In-Reply-To: <52AF18E1.8040206@affinitas.de> References: <52AEDB43.3020807@affinitas.de> <52AF1021.2060004@ag-web.biz> <52AF18E1.8040206@affinitas.de> Message-ID: <52AF2556.3000808@ag-web.biz> Am 16.12.2013 16:14, schrieb Pascal den Bekker: > Hey Achim, > > thank you for your help :-) Unfortunately it did not work :-( > > I changed the lines in the dovecot config you sent me.. When I try to > login into the sogo gui, im getting the following error message: > > 2013-12-16 16:10:07 auth: Info: > ldap(administrator,127.0.0.1,): unknown user > 2013-12-16 16:10:07 auth: Error: > userdb(administrator,127.0.0.1,): user not found > from userdb ldap > 2013-12-16 16:10:07 imap: Error: Authenticated user not found from > userdb, auth lookup id=4126670849 (client-pid=5503 client-id=1) > 2013-12-16 16:10:07 imap-login: Info: Internal login failure (pid=5503 > id=1) (internal failure, 1 succesful auths): user=, > method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=5504, secured, > session= > > When I look in samba4: > > samba-tool user list > Administrator > krbtgt > Guest > ldap > > The user seems to be there..:-( > > > Cheers, > > - Pascal > > On 12/16/2013 03:37 PM, Achim Gottinger wrote: >> Hi, >> >> Added a few corrections to your config below. Hope it works. >> >> achim~ >> >> >> Am 16.12.2013 11:51, schrieb Pascal den Bekker: >>> Hello, >>> >>> I am trying to setup samba4/openchange and dovecot. Does anyone has >>> experiences concering dovecot connecting to samba4 ?? >>> >>> I tried the following: >>> >>> /etc/dovecot.conf: >>> >>> protocols = imap sieve >>> mail_location = maildir:/data/mail/%d/%n/Maildir >>> mail_access_groups = vmail >>> mail_privileged_group = vmail >>> first_valid_uid = 110 >>> last_valid_uid = 110 >> last_valid_uid = 5000 >>> first_valid_gid = 115 >>> last_valid_gid = 115 >> last_valid_gid = 5000 >> >> Your vmail user/group seems to have the uid/gid 5000 so it must be in >> the valid range. >>> log_path = /var/log/dovecot >>> log_timestamp = "%Y-%m-%d %H:%M:%S " >>> login_greeting = Welcome to domain.local. >>> >>> service imap { >>> inet_listener { >>> port=143 >>> } >>> } >>> >>> protocol lda { >>> log_path = /var/log/mail/dovecot-deliver.log >>> auth_socket_path = /var/run/dovecot/auth-master >>> postmaster_address = postmaster at domain.local >>> mail_plugins = sieve >>> } >>> >>> service managesieve { >>> inet_listener { >>> port=12000 >>> } >>> } >>> >>> auth_verbose = yes >>> auth_debug = yes >>> >>> service auth { >>> unix_listener /var/spool/postfix/private/auth { >>> group = vmail >>> mode = 0660 >>> user = postfix >>> } >>> } >>> >>> #service auth-userdb { >>> # user = vmail >>> # } >>> #user = root >>> #} >>> >>> passdb { >>> args = /etc/dovecot/dovecot-ldap-passdb.conf >>> driver = ldap >>> } >>> >>> userdb { >>> args = /etc/dovecot/dovecot-ldap-userdb.conf >>> driver = ldap >>> } >>> >>> plugin { >>> sieve = /data/mail/%d/%n/sieverc >>> sieve_storage=/data/mail/%d/%n/sieve >>> sieve_max_redirects = 20 >>> } >>> >>> >>> debug_log_path = /var/log/dovecot-debug.log >>> >>> dict { >>> } >>> >>> /etc/dovecot/dovecot-ldap-passdb.conf >>> >>> hosts = localhost >>> auth_bind = yes >>> auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local >>> ldap_version = 3 >>> base = cn=Users,dc=domain,dc=local >>> pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) >>> >> hosts = localhost >> auth_bind = yes >> dn = cn=ldap,cn=Users,DC=domain,DC=local >> dnpass = password >> #auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local >> ldap_version = 3 >> base = cn=Users,dc=domain,dc=local >> pass_filter = (&(objectClass=person)(sAMAccountName=%u)(mail=*)) >> user_attrs=uid=5000 >> >> This way dovecot connects as user ldap does the user lookup according >> to pass_filter and uses the resulting dn for authetification. If you >> create users via the Windows Remote Management tools the dn for an >> user normaly uses the Full Name as cn and not the user id which is >> stored as sAMAccountName. >>> /etc/dovecot/dovecot-ldap-userdb.conf: >>> >>> hosts = localhost >>> dn = cn=ldap,cn=Users,DC=domain,DC=local >>> dnpass = password >>> ldap_version = 3 >>> base = cn=Users,DC=domain,DC=local >>> >>> #user_attrs = >>> user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir >>> >>> user_filter = (&(objectClass=person)(cn=%u)(mail=*)) >>> iterate_attrs = cn=user >>> iterate_filter = (objectClass=person) >> user_filter = (&(objectClass=person)(sAMAccountName=%u)(mail=*)) >> iterate_attrs = sAMAccountName=user >>> >>> When I try to login with useraccountadministrator I get the >>> following error messages: >>> >>> 2013-12-16 11:28:29 auth: Info: >>> ldap(ldap,127.0.0.1,): unknown user >>> 2013-12-16 11:28:29 auth: Error: >>> userdb(ldap,127.0.0.1,): user not found from >>> userdb ldap >>> 2013-12-16 11:28:29 imap: Error: Authenticated user not found from >>> userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) >>> 2013-12-16 11:28:29 imap-login: Info: Internal login failure >>> (pid=3809 id=1) (internal failure, 1 succesful auths): user=, >>> method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, >>> session= >>> >>> Can someone tell me what I am doing wrong, or is there way to test >>> to dovecot ldap connection string ?? >>> >>> Cheers, >>> >>> - Pascal >>> >> > > I'd test it with an different user than Administrator, and make sure the user has an E-Mail adress assigned. From sm at sami-mantysaari.biz Mon Dec 16 18:28:06 2013 From: sm at sami-mantysaari.biz (=?ISO-8859-1?Q?Sami_M=E4ntysaari?=) Date: Mon, 16 Dec 2013 18:28:06 +0200 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52AEFF04.4090406@Media-Brokers.com> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE7AF.6070106@metaways.de> <52ADA0C6.8060700@sami-mantysaari.biz> <52AEFF04.4090406@Media-Brokers.com> Message-ID: <52AF2A16.4090604@sami-mantysaari.biz> 16.12.2013 15:24, Charles Marcus kirjoitti: > On 2013-12-15 7:29 AM, Sami M?ntysaari wrote: >> dovecot -n: >> # 2.0.19: /etc/dovecot/dovecot.conf >> # OS: Linux 3.2.0-54-virtual x86_64 Ubuntu 12.04.3 LTS ext4 >> mail_location = maildir:/var/spool/mail/%u >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character vacation subaddress comparator-i;ascii-numeric >> relational regex imap4flags copy include variables body enotify >> environment mailbox date ihave >> passdb { >> driver = pam >> } > > I don't see anything for auth_mechanism or ports to listen on... > > Also, 2.0.xxx is no longer supported, best to upgrade at least to > latest 2.1, but if you're going to do that might as well go to latest > 2.2... > Just FYI: I'm using Ubuntu and I wish NOT to build it from source so unless it's in the Ubuntu's Package Repos then I'm not going to upgrade. From sm at sami-mantysaari.biz Mon Dec 16 18:32:20 2013 From: sm at sami-mantysaari.biz (=?ISO-8859-1?Q?Sami_M=E4ntysaari?=) Date: Mon, 16 Dec 2013 18:32:20 +0200 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52AF2A16.4090604@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE7AF.6070106@metaways.de> <52ADA0C6.8060700@sami-mantysaari.biz> <52AEFF04.4090406@Media-Brokers.com> <52AF2A16.4090604@sami-mantysaari.biz> Message-ID: <52AF2B14.7000309@sami-mantysaari.biz> 16.12.2013 18:28, Sami M?ntysaari kirjoitti: > 16.12.2013 15:24, Charles Marcus kirjoitti: >> On 2013-12-15 7:29 AM, Sami M?ntysaari wrote: >>> dovecot -n: >>> # 2.0.19: /etc/dovecot/dovecot.conf >>> # OS: Linux 3.2.0-54-virtual x86_64 Ubuntu 12.04.3 LTS ext4 >>> mail_location = maildir:/var/spool/mail/%u >>> managesieve_notify_capability = mailto >>> managesieve_sieve_capability = fileinto reject envelope >>> encoded-character vacation subaddress comparator-i;ascii-numeric >>> relational regex imap4flags copy include variables body enotify >>> environment mailbox date ihave >>> passdb { >>> driver = pam >>> } >> I don't see anything for auth_mechanism or ports to listen on... >> >> Also, 2.0.xxx is no longer supported, best to upgrade at least to >> latest 2.1, but if you're going to do that might as well go to latest >> 2.2... >> > Just FYI: I'm using Ubuntu and I wish NOT to build it from source so > unless it's in the Ubuntu's Package Repos then I'm not going to upgrade. Also I'm using Postifx + Dovecot integration called: mail-stack-delivery. I have no clue why there are no ports or auth_mechanism mayb 'cuz Dovecot does NOT know where to look for the configs? From h.reindl at thelounge.net Mon Dec 16 18:47:17 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 16 Dec 2013 17:47:17 +0100 Subject: [Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem In-Reply-To: <52AF2B14.7000309@sami-mantysaari.biz> References: <52ACDF7F.8040003@sami-mantysaari.biz> <52ACE7AF.6070106@metaways.de> <52ADA0C6.8060700@sami-mantysaari.biz> <52AEFF04.4090406@Media-Brokers.com> <52AF2A16.4090604@sami-mantysaari.biz> <52AF2B14.7000309@sami-mantysaari.biz> Message-ID: <52AF2E95.4070508@thelounge.net> Am 16.12.2013 17:32, schrieb Sami M?ntysaari: >> Just FYI: I'm using Ubuntu and I wish NOT to build it from source so >> unless it's in the Ubuntu's Package Repos then I'm not going to upgrade. > Also I'm using Postifx + Dovecot integration called: > mail-stack-delivery. I have no clue why there are no ports or > auth_mechanism mayb 'cuz Dovecot does NOT know where to look for the > configs? ask the "mail-stack-delivery" integrators how they did the config while ask yourself if you may have changed things at the wrong place you are here on the *upstream* list i use a SINGLE config file and already posted you yesterday the needed value, working this way on any local/development/production server i maintain [root at rh:~]$ cat /etc/dovecot/dovecot.conf | grep mech auth_mechanisms = CRAM-MD5 DIGEST-MD5 APOP LOGIN PLAIN SCRAM-SHA-1 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From nick.z.edwards at gmail.com Mon Dec 16 09:18:01 2013 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 16 Dec 2013 17:18:01 +1000 Subject: [Dovecot] Turn of mount point adding? In-Reply-To: <52AC3E68.2050502@particlesoftware.com> References: <52AC34CD.5020805@particlesoftware.com> <52AC3872.6000803@thelounge.net> <52AC3E68.2050502@particlesoftware.com> Message-ID: On 12/14/13, Scott Galambos wrote: > There needs to be a way at compile time or in the config to turn the > whole thing off. The best I could come up with is: > > doveadm mount add '/custompath/*' ignore > doveadm mount add '/custompath*' ignore > > I had to do both to get it to finally stop adding them. > Exactly, I have no idea what Timo was thinking when he added this, it should be defined by config, and nothing more. adding ignore is a lazy and rediculous workaround. CC'd direct because my posts are no longer accepted on mailing list, you may of course reply via the list. > > On 12/14/2013 5:52 AM, Reindl Harald wrote: >> Am 14.12.2013 11:37, schrieb Scott Galambos: >> i wonder if Timo sooner or later accepts that this is a *major bug* >> no userland-software on this planet needs to track mount-points >> at least not as default, at least not this way >> >> the last time i borught this up the excuse was "dovecot >> can not know if the missing mount point contains mail-data" >> >> uhm - it knows by config and not by presence of a OS mount-point > From adi at ente.limmat.ch Mon Dec 16 21:36:18 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Mon, 16 Dec 2013 20:36:18 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively Message-ID: <52AF5632.5050104@ente.limmat.ch> Dear List Using dovecot 2.1.7 with LMTP and exim4 I want to accept local parts regardless of their case. Exim does all virtual alias handling and delivers the messages to dovecot LMTP addressed to the right mailbox name. This works well except for addresses which do not need to be resolved by exim and which do have the "wrong" case in the local part. For example: There is a mailbox and a user on the mailsystem "example.org" called "user". Mails to "user at example.org" get delivered just as they should. If an incoming message is addressed to "USER at example.org" with upper case local part, exim passes the message to LMTP with the case unaltered (RFC 2821 conform), but LMTP fails with: LMTP error after RCPT TO:: 550 5.1.1 User doesn't exist: USER at example.org How can I tell dovecot to deliver "USER" to the mailbox "user" aswell? Thank you for your help. Best regards, Adrian. (I have tried to use %Ln and %Lu in mail_location setting with no success.) From CMarcus at Media-Brokers.com Mon Dec 16 22:25:55 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 16 Dec 2013 15:25:55 -0500 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52AF5632.5050104@ente.limmat.ch> References: <52AF5632.5050104@ente.limmat.ch> Message-ID: <52AF61D3.3030403@Media-Brokers.com> On 2013-12-16 2:36 PM, Adrian Zaugg wrote: > How can I tell dovecot to deliver "USER" to the mailbox "user" aswell? "Username LDAP lookups are case-insensitive. Unless you somehow normalize the username, it's possible that a user logging in as "user", "User" and "uSer" are treated differently. The easiest way to handle this is to tell Dovecot to change the username to the same case as it's in the LDAP database. You can do this by returning "user" field in the pass_attrs, as shown in the above example. If you can't normalize the username in LDAP, you can alternatively lowercase the username in dovecot.conf: auth_username_format = %Lu" See: http://wiki2.dovecot.org/AuthDatabase/LDAP/PasswordLookups This really should be the default... -- Best regards, */Charles/* From adi at ente.limmat.ch Mon Dec 16 23:32:25 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Mon, 16 Dec 2013 22:32:25 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52AF61D3.3030403@Media-Brokers.com> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> Message-ID: <52AF7169.9040608@ente.limmat.ch> Hi Marcus The change of adding an L to auth_username_format = %Ln" indeed has the side effect, that LMTP delivers wrongly cased addresses. But the main effect and disadvantage is, that authenticating logins with wrongly cased usernames do also succeed, which I actually do not like to happen. Isn't there another solution? A feature request for a new option lmtp_username_format? Regards, Adrian. Am 16.12.13 21:25 schrieb Charles Marcus: > On 2013-12-16 2:36 PM, Adrian Zaugg wrote: >> How can I tell dovecot to deliver "USER" to the mailbox "user" aswell? > > "Username > > LDAP lookups are case-insensitive. Unless you somehow normalize the > username, it's possible that a user logging in as "user", "User" and > "uSer" are treated differently. The easiest way to handle this is to > tell Dovecot to change the username to the same case as it's in the LDAP > database. You can do this by returning "user" field in the pass_attrs, > as shown in the above example. > > If you can't normalize the username in LDAP, you can alternatively > lowercase the username in dovecot.conf: > > auth_username_format = %Lu" > > See: http://wiki2.dovecot.org/AuthDatabase/LDAP/PasswordLookups > > This really should be the default... > > From cr at sys4.de Mon Dec 16 23:46:58 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Mon, 16 Dec 2013 22:46:58 +0100 Subject: [Dovecot] Errors in log file Message-ID: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> Hi, just wonder about some errors I found with: doveadm log errors: ? Dec 16 17:21:55 imap(roessner@****): Error: stat(/srv/mail/virtual/*****/roessner/.dovecot.sieve/tmp) failed: Not a directory ? And this is correct, it is a link: .dovecot.sieve -> sieve/default.sieve I do not see, where I have an error in my config ;) root at mx ~ # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes default_vsz_limit = 512 M disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl fts fts_lucene zlib mail_log notify listescape mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:%%h prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_grace = 10%% quota_rule = *:storage=2G:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = From CMarcus at Media-Brokers.com Mon Dec 16 23:55:10 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 16 Dec 2013 16:55:10 -0500 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52AF7169.9040608@ente.limmat.ch> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> Message-ID: <52AF76BE.7090600@Media-Brokers.com> On 2013-12-16 4:32 PM, Adrian Zaugg wrote: > The change of adding an L to > > auth_username_format = %Ln" > > indeed has the side effect, that LMTP delivers wrongly cased addresses. > But the main effect and disadvantage is, that authenticating logins with > wrongly cased usernames do also succeed, which I actually do not like to > happen. Trying very hard to understand why this would be a problem. > Isn't there another solution? A feature request for a new option > lmtp_username_format? No idea, as I see no value in differentiating... -- Best regards, */Charles/* From adi at ente.limmat.ch Tue Dec 17 00:53:56 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Mon, 16 Dec 2013 23:53:56 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52AF76BE.7090600@Media-Brokers.com> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> Message-ID: <52AF8484.2050704@ente.limmat.ch> Am 16.12.13 22:55 schrieb Charles Marcus: > On 2013-12-16 4:32 PM, Adrian Zaugg wrote: >> But the main effect and disadvantage is, that authenticating logins with >> wrongly cased usernames do also succeed, which I actually do not like to >> happen. > > Trying very hard to understand why this would be a problem. On *nix hosts login names are always case sensitive. Why should this change with the same login name for eMails when it doesn't for for ssh, FTP, Webserver-Login, Database-Login ... ? It's nicer if a system acts consistent. Regards, Adrian. From adi at ente.limmat.ch Tue Dec 17 04:04:15 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Tue, 17 Dec 2013 03:04:15 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> Message-ID: <52AFB11F.3040409@ente.limmat.ch> Hi David > I believe RFC822 email addresses are case-insensitive, and (in some RFC 2821, Page 13, 1st paragraph: "The local-part of a mailbox MUST BE treated as case sensitive. Therefore, SMTP implementations MUST take care to preserve the case of mailbox local-parts. Mailbox domains are not case sensitive. In particular, for some hosts the user "smith" is different from the user "Smith". However, exploiting the case sensitivity of mailbox local-parts impedes interoperability and is discouraged." (http://tools.ietf.org/html/rfc2821#section-2.4) > cases, especially ones where there's just a mail server) it's entirely > possible that people remember their account names with some capital > letters that aren't in user db. (System knows you as > "mrsmithy at mail.domain", while the user may remember the account as > "MrSmithy at mail.domain" or "MrsMithy at mail.domain"...). Also, people with I just want login names to be case sensitive but not email addresses, and in spite of being treated as case insensitive email addresses should retain their case, just like defined and suggested in the RFC. This reduces support calls because it's con-formant and we have a clear policy: Usernames are always lower case, non-email addresses, the same simple and short name for all our services. There is nothing easier than this. We use this since 17 years and it works without confusion. If a user now spots that suddendly any capitalization of usernames is working when logging in to the webmail, how can I explain that this doesn't work with other services like FTP? > smartphones may not notice that the phone "helpfully" uppercased the > first letter of a lowercase user name. Forcing case reduces support > calls, which is always a good thing. That's why email addresses should be allowed containing capitalizations. On smartphone people tend to use MUAs and there the username is saved and not entered each and every time, so for the username this is less true, I think. Back to dovecot: Using LDA as a transport for the dovecot store, it used to work perfectly (with dovecot 1.x). It's just LMTP that spits, because it looks up the local part in the userdb, which is PAM in our case. I won't change PAM to act case insensitive: I'm not in the position to change a common sense in the computing world as it always was. It's enough Microsoft did that and probably just because of that we're having this discussion here... However, it's maybe best to lowercase the local part in the exim lmtp-transport and leave dovecot's LMTP in peace. Best regards, Adrian. From andreas.schulze at datev.de Tue Dec 17 09:39:26 2013 From: andreas.schulze at datev.de (Andreas Schulze) Date: Tue, 17 Dec 2013 08:39:26 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52AF61D3.3030403@Media-Brokers.com> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> Message-ID: <20131217073926.GA31926@spider.services.datevnet.de> Am 16.12.2013 15:25 schrieb Charles Marcus: > auth_username_format = %Lu" > This really should be the default... I disagree. That solve a symptom, not the problem. As of rfc3522 a localpart *may* be used case sensitive or not. I suggest a switch "my_local_parts_are_casesensitive = yes/no" or "my_local_parts_are_caseINsensitive = no/yes" The name and default must be well selected and not break existing behaviour. I think that's more transparent then changing an mostly unvisible setting. Andreas -- Andreas Schulze Internetdienste | P252 DATEV eG 90329 N?rnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 N?rnberg, Paumgartnerstr. 6-14 | Registergericht N?rnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Dipl.-Kfm. Dr. Robert Mayr J?rg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen From skdovecot at smail.inf.fh-brs.de Tue Dec 17 10:35:36 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 17 Dec 2013 09:35:36 +0100 (CET) Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52AFB11F.3040409@ente.limmat.ch> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 17 Dec 2013, Adrian Zaugg wrote: > RFC 2821, Page 13, 1st paragraph: > "The local-part of a mailbox > MUST BE treated as case sensitive. Therefore, SMTP implementations > However, it's maybe best to lowercase the local part in the exim > lmtp-transport and leave dovecot's LMTP in peace. that's what I wanted to suggest :) More or less, it is the duty of the MTA, IMHO. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUrAM2V3r2wJMiz2NAQLscQf9FC88YCmpCib9J2THqZlSUs8ctuf6pD08 VvS4GqU5fujt0rwJkGTvcxk/bSSGhX6onQouL6KJrW7Dp6JDaZaheOYPufLEyK3R oLRR9E+2twGmmJ45lDiqxO9REjwaNrtaINcHk6x+OREf+1Z0xk3juUNtz63TzdoG e2JYxhWaYbotky+Tzj7yQScqXYEfq8isTYTIW9+2rZalPjgUK6JaknOwqVpGrhgG XkE5WlEJJePbUqalhVzKJ+MrRkNUplPtbkEkgOxfraOd6h7H0dyprohQokkFPgbB 5pZ6vdqCDS0epS/hzCedZ5s/onmgpAQlMdyu6Zgz+R/v+jhyn8KZvQ== =/1EB -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Dec 17 10:38:09 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 17 Dec 2013 09:38:09 +0100 (CET) Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 17 Dec 2013, Steffen Kaiser wrote: >> However, it's maybe best to lowercase the local part in the exim >> lmtp-transport and leave dovecot's LMTP in peace. > > that's what I wanted to suggest :) > > More or less, it is the duty of the MTA, IMHO. Um, sorry, forgot the link: http://www.gossamer-threads.com/lists/exim/users/4551 that looks promising. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUrANcV3r2wJMiz2NAQI1rQf/Q4Uo1qehJBOEJ3eMkzdyzbAFw2dEOgA0 UYnVLBihEU6Ubta5X/4JiNR6dBWwf+D7w8IKkUfoUUw2HxqpXrrls8Mzl4DJC9DO ID2IABClDAqe+mK75+mjAUb9duaXHwqr3nFKV6iQ1jIqQzEVw+yMXOm2CwTa1+uu JNyy0CoSu7rw+AmsqDMdpN7F+IjgwLHF8qKBGIm0FTfjmlYc3chePjIaD0GjSj9m +aztbs1jnB0PizfCd1jxfsxLIfDRbE1CbrQOhTIWaHLzZnv8YFPIc+d/LD7jtnSl 1k2Beg0LRFXwa2f0p9LwmB52s8yTxOrvwNjNS5wepjRYvArN7ra1HA== =dapR -----END PGP SIGNATURE----- From pbopbo at freemail.hu Tue Dec 17 11:54:51 2013 From: pbopbo at freemail.hu (Peter Benko) Date: Tue, 17 Dec 2013 10:54:51 +0100 (CET) Subject: [Dovecot] reproducible dsync backup panic (dovecot 2.2.7) Message-ID: Hi all, I'm receiving a reproducible dsync backup panic for some of my users. The error message is as follows: dsync-remote(user@): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) dsync-remote(user@): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x69b70) [0x7f922dad9b70] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f922dad9c4a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f922da94725] -> /usr/bin/dsync(dsync_brain_mailbox_tree_sync_change+0x382) [0x42f912] -> /usr/bin/dsync(dsync_brain_recv_mailbox_tree_deletes+0x10b) [0x42f4db] -> /usr/bin/dsync(dsync_brain_run+0x305) [0x42c6f5] -> /usr/bin/dsync() [0x42cbe8] -> /usr/bin/dsync() [0x43e040] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f922daea066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f922daeaf07] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f922dae9b78] -> /usr/bin/dsync() [0x4297f9] -> /usr/bin/dsync() [0x4133cd] -> /usr/bin/dsync(doveadm_mail_try_run+0x251) [0x414091] -> /usr/bin/dsync(main+0x3c8) [0x412f78] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f922d704ead] -> /usr/bin/dsync() [0x413191] dsync-local(user@): Error: read() failed: EOF dsync-local(user@): Error: Remote command returned error 134 The command I'm using to back up individual user's mail is something like: sudo -u vmail dsync -v -u user at server.com -R backup ssh -i sshid-file login at server.com sudo -u vmail dsync -v -u user at server.com I use the above command at the backup server. The error started to appear a few weeks after we started using the new mail system. First it appeared for a single user, now it appears for some more users as well. It is deterministic and reproducible. Any ideas? I included the relevant part of my config below. Best regards, Peter ------------------------------------------------------------------- # 2.2.7 (5c876ed0c3e0): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_master_user_separator = * auth_mechanisms = plain login hostname = listen = * login_greeting = $hostname IMAP server mail_attachment_dir = /mail/mailboxes/%d/_attachments_ mail_attachment_fs = sis-queue $mail_attachment_dir/queue:posix mail_attachment_min_size = 16 k mail_location = mdbox:~ mail_plugins = " zlib acl" mdbox_rotate_interval = 5 days mdbox_rotate_size = 5 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = mdbox:/mail/mailboxes/%%d/%%n:INDEX=/mail/mailboxes/%%d/%%n prefix = Accounts/%%n/ separator = / subscriptions = no type = shared } passdb { args = /mail/config/dovecot/passwd driver = passwd-file } passdb { args = /mail/config/dovecot/passwd-master driver = passwd-file master = yes pass = yes } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/mail/mailboxes/%d/shared-mailboxes.db zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster@ protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } syslog_facility = local6 userdb { args = uid=vmail gid=vmail master_user=%u home=/mail/mailboxes/%d/%n driver = static } protocol imap { mail_plugins = " zlib acl imap_acl" } From andreas at cymail.eu Tue Dec 17 14:48:33 2013 From: andreas at cymail.eu (Andreas Kasenides) Date: Tue, 17 Dec 2013 14:48:33 +0200 Subject: [Dovecot] Dovecot proxy and Postfix SASL Message-ID: Can somebody please verify that currently (v 2.2.9) SMTP AUTH using SASL from Postfix with Dovecot proxy is still not supported as discussed in these threads (especially the first one)? http://www.dovecot.org/list/dovecot/2012-August/067977.html http://www.dovecot.org/list/dovecot/2011-May/059107.html As I understand it is possible to use saslauthd to do this by using the remote imap option (rimap). Such a facility is important since I am attempting to separate the outward facing servers (dovecot proxy, postfix relay) that have no knowledge of user databases from the backends. thanx Andreas From andreas at cymail.eu Tue Dec 17 15:22:13 2013 From: andreas at cymail.eu (Andreas Kasenides) Date: Tue, 17 Dec 2013 15:22:13 +0200 Subject: [Dovecot] Dovecot proxy and Postfix SASL In-Reply-To: References: Message-ID: <87da823fb0e512a57e83cdaa3beb2d72@cymail.eu> To be fair on this: The main driver behind this is security and having front end systems in a DMZ with only minimal (if any) access to the back end servers. Of course saslauthd will need SOME access to the remote (back-end) IMAP (one IP port?). But this can also be accomplished by having the front end Postfix authenticate on the Dovecot back-end by setting it up to talk to the auth process via an ip-listener ALSO on just one IP port. Does this make sense? AM I missing something? Andreas On 17-12-2013 14:48, Andreas Kasenides wrote: > Can somebody please verify that currently (v 2.2.9) SMTP AUTH using > SASL > from Postfix with Dovecot proxy is still not supported as discussed in > these threads > (especially the first one)? > > http://www.dovecot.org/list/dovecot/2012-August/067977.html > http://www.dovecot.org/list/dovecot/2011-May/059107.html > > As I understand it is possible to use saslauthd to do this by using the > remote > imap option (rimap). Such a facility is important since I am > attempting to separate the > outward facing servers (dovecot proxy, postfix relay) that have no > knowledge of user databases > from the backends. > > thanx > Andreas From philippbruell at gmail.com Tue Dec 17 14:29:37 2013 From: philippbruell at gmail.com (=?ISO-8859-1?Q?Philipp_Br=FCll?=) Date: Tue, 17 Dec 2013 13:29:37 +0100 Subject: [Dovecot] Accessing plain text password from memory In-Reply-To: References: Message-ID: <52B043B1.5030001@gmail.com> Hi Timo, thanks for the answer. I'm working on a plug in with an similar architecture. Is there also a way to pass that plain password to a mail filter script? Obviously, the %w option as mail filter script argument does not work. Kind regards, Philipp On 13/12/13 15:47, Timo Sirainen wrote: > On 13.12.2013, at 16.37, Stanislas SABATIER wrote: > >> Is there a way to retrieve the client's password in plain text from memory ? >> >> I don't store the password in plain text in my postgreSQL but I need it >> when the client is connected to make crypto computation. >> >> If I write a plugin to do the job, how could I retrieve the plain text >> password from master ? > > Assuming you you're using passdb sql and userdb prefetch and you want to access the password in imap/pop3/etc process, you can do: > > password_query = '%w' as userdb_password, ... > > Then the password will be available the same way as plugin { password } would be available (mail_user_plugin_getenv()). > > You could also write a passdb plugin you could access the password directly from auth_request->mech_password. > -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4261 bytes Desc: S/MIME Cryptographic Signature URL: From CMarcus at Media-Brokers.com Tue Dec 17 17:55:11 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 17 Dec 2013 10:55:11 -0500 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <20131217073926.GA31926@spider.services.datevnet.de> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <20131217073926.GA31926@spider.services.datevnet.de> Message-ID: <52B073DF.8090605@Media-Brokers.com> On 2013-12-17 2:39 AM, Andreas Schulze wrote: > Am 16.12.2013 15:25 schrieb Charles Marcus: >> >auth_username_format = %Lu" >> >This really should be the default... > I disagree. That solve a symptom, not the problem. > > As of rfc3522 a localpart*may* be used case sensitive or not. > I suggest a switch "my_local_parts_are_casesensitive = yes/no" > or "my_local_parts_are_caseINsensitive = no/yes" > The name and default must be well selected and not break existing behaviour. > > I think that's more transparent then changing an mostly unvisible setting. Your system, your rules, however... Just because you *can* do something doesn't mean you *should* do it - and just because something is RFC compliant doesn't mean you should always implement it that way. There are very few compelling arguments for supporting identical usernames differing only by case. One is some kind of legacy (unix) environment where you already have a lot of these... but I can't readily think of another (good one)... -- Best regards, */Charles/* From h.reindl at thelounge.net Tue Dec 17 18:02:51 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 17 Dec 2013 17:02:51 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52B073DF.8090605@Media-Brokers.com> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <20131217073926.GA31926@spider.services.datevnet.de> <52B073DF.8090605@Media-Brokers.com> Message-ID: <52B075AB.3070803@thelounge.net> Am 17.12.2013 16:55, schrieb Charles Marcus: > On 2013-12-17 2:39 AM, Andreas Schulze wrote: >> Am 16.12.2013 15:25 schrieb Charles Marcus: >>> >auth_username_format = %Lu" >>> >This really should be the default... >> I disagree. That solve a symptom, not the problem. >> >> As of rfc3522 a localpart*may* be used case sensitive or not. >> I suggest a switch "my_local_parts_are_casesensitive = yes/no" >> or "my_local_parts_are_caseINsensitive = no/yes" >> The name and default must be well selected and not break existing behaviour. >> >> I think that's more transparent then changing an mostly unvisible setting. > > Your system, your rules, however... > > Just because you *can* do something doesn't mean you *should* do it - and just because something is RFC compliant > doesn't mean you should always implement it that way. > > There are very few compelling arguments for supporting identical usernames differing only by case. One is some kind > of legacy (unix) environment where you already have a lot of these... but I can't readily think of another (good > one)... in fact it does always harm because users there are enough writing their address uppercase while the server was never configured that way, there are enough writing FirstnameLastname at domain.tld and you can hardly find a normal person who accepts that writing a message to "YOU at domain.tld" goes to a different person than "you at domain.tld" or bounce in one of the cases -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From CMarcus at Media-Brokers.com Tue Dec 17 18:30:53 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 17 Dec 2013 11:30:53 -0500 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52B075AB.3070803@thelounge.net> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <20131217073926.GA31926@spider.services.datevnet.de> <52B073DF.8090605@Media-Brokers.com> <52B075AB.3070803@thelounge.net> Message-ID: <52B07C3D.5090901@Media-Brokers.com> On 2013-12-17 11:02 AM, Reindl Harald wrote: > there are enough writingFirstnameLastname at domain.tld and you can hardly > find a normal person who accepts that writing a message to"YOU at domain.tld" goes > to a different person than"you at domain.tld" or bounce in one of the cases I agree, but as I said - his system/server, his rules... From list_dovecot at bluerosetech.com Tue Dec 17 23:56:26 2013 From: list_dovecot at bluerosetech.com (Darren Pilgrim) Date: Tue, 17 Dec 2013 13:56:26 -0800 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52B075AB.3070803@thelounge.net> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <20131217073926.GA31926@spider.services.datevnet.de> <52B073DF.8090605@Media-Brokers.com> <52B075AB.3070803@thelounge.net> Message-ID: <52B0C88A.2030906@bluerosetech.com> On 12/17/2013 8:02 AM, Reindl Harald wrote: > there are enough writing their address uppercase while the server was never configured > that way, there are enough writing FirstnameLastname at domain.tld and you can hardly > find a normal person who accepts that writing a message to "YOU at domain.tld" goes > to a different person than "you at domain.tld" or bounce in one of the cases There are also listservs and other things out there which case fold email addresses--some fold to lowercase, some to uppercase. Current best practice is treat the entire email address as case insensitive. From adi at ente.limmat.ch Wed Dec 18 03:01:03 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Wed, 18 Dec 2013 02:01:03 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> Message-ID: <52B0F3CF.4040709@ente.limmat.ch> Hi again Thanks for helping me on this, especially to Steffen. If you do not need case sensitivity on user names the use of a redirect router in exim to lowercase the local part of the address to deliver works well. If one wants for whatever reasons to have support for user names, that just differ in its case, you could put more logic in that router to make that work. Since I did not need that, I can't post it here... So the solution to the problem is: A) Either: --------- Configure dovecot auth to lower case user names, which LMTP inherits, by setting auth_username_format = "%Lu" Co-Effect: authenticating logins with wrongly cased user names do also succeed. B) Or: ----- Configure your MTA to do the Job. With exim, add a new router just before local delivery takes place, like this: lowercase_local: debug_print = "R: lower case local_part for local delivery" driver = redirect redirect_router = local_user data = ${lc:${local_part}} and proceed with the local_user router: local_user: debug_print = "R: local_user for $local_part@$domain" driver = accept domains = +local_domains check_local_user local_parts = ! root transport = dovecot_lmtp cannot_route_message = Unknown user then add your LMTP transport: dovecot_lmtp: driver = lmtp socket = /var/run/dovecot/lmtp batch_max = 256 timeout = 2m delivery_date_add Has just the effect that login names stay case sensitive (if nothing else is set in dovecot by auth_username_format) but not email addresses, and in spite of being treated as case insensitive, email addresses retain their case. Maybe some one can add this to the wiki under http://wiki2.dovecot.org/LMTP/Exim?highlight=%28LMTP%29#Using_LMTP_over_UNIX_Socket The code there is anyway not very nice by using the manualroute router with: route_data = whatmeworry # required but not useful Thanks again to everyone for helping. Regards, Adrian. Am 17.12.13 09:38 schrieb Steffen Kaiser: > On Tue, 17 Dec 2013, Steffen Kaiser wrote: > >>> However, it's maybe best to lowercase the local part in the exim >>> lmtp-transport and leave dovecot's LMTP in peace. > >> that's what I wanted to suggest :) > >> More or less, it is the duty of the MTA, IMHO. > > Um, sorry, forgot the link: > http://www.gossamer-threads.com/lists/exim/users/4551 > > that looks promising. > > -- Steffen Kaiser From enorniel at gmail.com Wed Dec 18 12:26:48 2013 From: enorniel at gmail.com (eechim enorniel) Date: Wed, 18 Dec 2013 11:26:48 +0100 Subject: [Dovecot] External auth Message-ID: Hello, I saw a lot of tutorials about setting postfix with dovecot sasl but I would like more. I want to set a SSO system with roundcube on dovecot. I would like to know how to make dovecot work with sasl or saml, not as a provider but as a service plugging on an external provider. I saw there is an EXTERNAL auth mechanism but I didn't find any doc about it. Can you help me ? Thanks. From tss at iki.fi Wed Dec 18 12:33:46 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 18 Dec 2013 12:33:46 +0200 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52B0F3CF.4040709@ente.limmat.ch> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> <52B0F3CF.4040709@ente.limmat.ch> Message-ID: <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> On 18.12.2013, at 3.01, Adrian Zaugg wrote: > A) Either: > --------- > Configure dovecot auth to lower case user names, which LMTP inherits, by > setting > auth_username_format = "%Lu" > > Co-Effect: authenticating logins with wrongly cased user names do also > succeed. I think this would work as well: protocol lmtp { auth_username_format = %Lu } From skdovecot at smail.inf.fh-brs.de Wed Dec 18 14:46:42 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 18 Dec 2013 13:46:42 +0100 (CET) Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> <52B0F3CF.4040709@ente.limmat.ch> <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 18 Dec 2013, Timo Sirainen wrote: >> A) Either: >> --------- >> Configure dovecot auth to lower case user names, which LMTP inherits, by >> setting >> auth_username_format = "%Lu" >> >> Co-Effect: authenticating logins with wrongly cased user names do also >> succeed. > > I think this would work as well: > > protocol lmtp { > auth_username_format = %Lu > } (Y) I never thought about the "context"-depended conf file parsing stuff, wow. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUrGZMl3r2wJMiz2NAQKMFwf+Jxw4na2yRy9UQG7Q4KfZkyJXvfZrZNRG xFt+PS5nkVpJV0AbCSx+2AjRxjVm678AV/c9iB8lkCj5PQpnaAE78Rd+h7xKT/it JKpbmJrUHSroztUSKZi/CPG9naOzjdbEit5CqgDwinrCPjYZ6hKzq32n0ItAk252 v79PJp31evMBqncPqKBRNqsnauXCq1aCEyZA4HzVY13tqLD1At+NtRwOUpbn+9uH GO2ve6Eq4yp3Dzq4xAGkqANu5Xd7LSZBL8CTU3BcjK32RG+12F54OZjC2xqqomeQ MLa0Tq9KaChZwBTRm7E0ujA5LF9RCtUMxcK8YwB3jZbARIOsDGXQag== =6B31 -----END PGP SIGNATURE----- From adi at ente.limmat.ch Wed Dec 18 16:52:44 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Wed, 18 Dec 2013 15:52:44 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> <52B0F3CF.4040709@ente.limmat.ch> <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> Message-ID: <52B1B6BC.3050707@ente.limmat.ch> Am 18.12.13 11:33 schrieb Timo Sirainen: > I think this would work as well: > > protocol lmtp { > auth_username_format = %Lu > } I tried this with dovecot 2.1.7, but it did not work. It may work on a newer dovecot? Regards, Adrian. From christian.rohmann at frittentheke.de Wed Dec 18 19:40:47 2013 From: christian.rohmann at frittentheke.de (Christian Rohmann) Date: Wed, 18 Dec 2013 18:40:47 +0100 Subject: [Dovecot] Size detection/replair does not work with zlib In-Reply-To: <96e186c9c6fde572e7dd93b9b900ab97@roundcube.froglogic.com> References: <20131212114734.GA18852@sys-241.netcologne.de> <96e186c9c6fde572e7dd93b9b900ab97@roundcube.froglogic.com> Message-ID: <52B1DE1F.8070103@frittentheke.de> Hey dovecot-users, Am 12.12.2013 22:01, schrieb Frerich Raabe: > On 2013-12-12 12:47, Roland Rosenfeld wrote: >> So here dovecot detects the wrong S value, but instead of fixing it by >> using the uncompressed size, it renames to the same file name as >> before... > > I observed exactly the same issue ever since I enabled the zlib > plugin on our IMAP server, running dovecot 2.1.7. > > For what it's worth, I wrote a small shell script which, given a > Maildir directory, looks for all files for which the S= value doesn't > match the effective file size (i.e. for zlib-compressed files, > the S= value should match the *uncompressed* file size, for > plain files the S= value should match the physical file sie). The > script the attempts to print appropriate 'mv' commands for renaming > the files as needed. Maybe it helps, I attached it to this mail. Yeah this is the method to "repair" the files manually.But regarding Dovecot the following question arises: Could Dovecot, a.k.a Timo, not just simply implement this method of fixing the size of uncompressed emails? I mean it is able to determine the uncompressed size, so why not use that instead of the physical on-disk size / fstat value if the file is compressed? This would make Dovecot just much more robust when dealing with compressed files. Regards Christian -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3752 bytes Desc: S/MIME Cryptographic Signature URL: From me at rvijay.me Wed Dec 18 22:23:55 2013 From: me at rvijay.me (Vijay Rajah) Date: Thu, 19 Dec 2013 01:53:55 +0530 Subject: [Dovecot] letters local filter duplicated In-Reply-To: References: <529F0B20.6000002@Media-Brokers.com> Message-ID: <52B2045B.4030204@rvijay.me> On 16/12/13 1:10 PM, John Smith wrote: > two servers with replicated master/master. > with this setup letters processed local filter duplicated. > ?ie when the mail client receives a letter begins processing using rules > (filters) to move the letters in a different folder. > summarized in this folder is two duplicate letters.? > if you disable the filter, the message is not duplicated. But does not move > to another location. > both servers are configured identically, except "mail_replica = > tcp:ip_server2:4092" > I have the same issue with thunderbird, in a master-master setup. If I use sieve, the message does not get duplicated. Hence, it might be an issue with thunderbird. I'm not really sure, the root cause of the issue. I would be interested in knowing the solution as well. FYI: I'm on dovecot 2.2.6 and I'm using DSYNC based replication (over ssh) -Thanks Vijay From wdgarc88 at gmail.com Thu Dec 19 07:20:06 2013 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Thu, 19 Dec 2013 15:20:06 +1000 Subject: [Dovecot] mirror to download dovecot Message-ID: Halo, Is mirror to get 2.2.9? cannot get dovecot.org, this time out 4 xe-0-1-0-1-3664.r00.saplbr01.br.bb.gin.ntt.net (200.15.0.45) 6.946 ms 7.093 ms 6.899 ms 5 xe-4-1-3.r20.miamfl02.us.bb.gin.ntt.net (129.250.3.217) 118.130 ms 118.111 ms 118.117 ms 6 ae-1.r05.miamfl02.us.bb.gin.ntt.net (129.250.2.185) 118.592 ms 118.735 ms 118.628 ms 7 * * * 8 * * * 9 * * * I use to get from dovecot.ausics.org but fail connect too, seem has DNS 127.0.0.1 ????? is any others run mirror? From pine5514 at gmail.com Thu Dec 19 09:59:39 2013 From: pine5514 at gmail.com (Mr.Pine) Date: Thu, 19 Dec 2013 11:29:39 +0330 Subject: [Dovecot] int/ext mailserver Message-ID: I 'm using potfix-dovcote as an internal mail server(local.myco.com) and wan to run another potfix-dovcote as an external mail server (myco.com) on Internet.75% of my users should only work internally(no external mail) but the rest of users (25%)should be able to send mail to external network! These users have the same username on myco.com. I use smtp_generic_maps to map int username of these users to ext. one. For eg. All email send by test at local.myco.com map to test at myco.com. So anyone got these mails can reply them. I know that getmail is the tools that can get mails from users external mailbox and put them into int. mailbox. 1. I have a root access to ext mail server. But do not know my ext user password!. How can I use getmail to move ext mail to internal one?! 2. What is your idea about syncing users password in internal/external mail server?! I think its needed for getmail! 3. How can I restrict my internal users to send mail only internally!? I appreciated any help!! TNX From bourek at thinline.cz Thu Dec 19 10:54:29 2013 From: bourek at thinline.cz (Jiri Bourek) Date: Thu, 19 Dec 2013 09:54:29 +0100 Subject: [Dovecot] Does quota-status respect quota_grace? Message-ID: <52B2B445.1080100@thinline.cz> Hello, I have Dovecot 2.2.9 from Debian repository running on AMD64, ext4 filesystem for mail storage. Each mailbox has its own system user, quotas are enforced by file system. Quota settings in configuration are as follows (from doveconf -n): quota = fs:Domain quota:group:inode_per_mail quota2 = fs:Mailbox quota:user:inode_per_mail quota2_grace = 18%% quota_grace = 18%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO Quota rules are read from PostgreSQL (snippet) user_query = ... '*:bytes=' || domains.quota_size || 'M:messages=' || domains.quota_files as quota_rule, \ '*:bytes=' || mailboxes.quota_size || 'M:messages=' || mailboxes.quota_files as quota2_rule, \ ... As far as I can tell, quota enforcing in dovecot-lda works correctly. User is allowed one message which brings him over quota (provided the message fits into filesystem quota hard limit and quota_grace value), every other message after that is rejected. However policy service quota-status for Postfix seems to ignore the quota_grace value. When a message arrives which would make user go over quota (but which would not make him exceed the grace limit value), Postfix checks the policy service and is told to reject the message. I checked and dovecot itself is fine with the message - if I try to send it with the policy service check disabled, Postfix accepts it and so does dovecot-lda, the message is delivered into mailbox. My question is - is that intended behavior or bug in the quota-status? Appending some lines from debug log - as far as I can see there's not much in it though: dovecot: quota-status: Debug: Added userdb setting: mail=maildir:/home/mailboxes/t/e/test.info/test/:LAYOUT=fs:INDEX=/var/lib/dovecot-data/index/1010:CONTROL=/var/lib/dovecot-data/control/1010 dovecot: quota-status: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=11M:messages=110 dovecot: quota-status: Debug: Added userdb setting: plugin/quota_rule=*:bytes=15M:messages=150 dovecot: quota-status(test at test.info): Debug: Effective uid=1010, gid=1007, home=/home/mailboxes/t/e/test.info/test/ dovecot: quota-status(test at test.info): Debug: Quota root: name=Domain quota backend=fs args=group:inode_per_mail dovecot: quota-status(test at test.info): Debug: Quota rule: root=Domain quota mailbox=* bytes=15728640 messages=150 dovecot: quota-status(test at test.info): Debug: Quota grace: root=Domain quota bytes=2831155 (18%) dovecot: quota-status(test at test.info): Debug: Quota root: name=Mailbox quota backend=fs args=user:inode_per_mail dovecot: quota-status(test at test.info): Debug: Quota rule: root=Mailbox quota mailbox=* bytes=11534336 messages=110 dovecot: quota-status(test at test.info): Debug: Quota grace: root=Mailbox quota bytes=2076180 (18%) dovecot: quota-status(test at test.info): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxes/t/e/test.info/test/:LAYOUT=fs:INDEX=/var/lib/dovecot-data/index/1010:CONTROL=/var/lib/dovecot-data/control/1010 dovecot: quota-status(test at test.info): Debug: fs: root=/home/mailboxes/t/e/test.info/test, index=/var/lib/dovecot-data/index/1010, indexpvt=, control=/var/lib/dovecot-data/control/1010, inbox=/home/mailboxes/t/e/test.info/test, alt= dovecot: quota-status(test at test.info): Debug: fs quota add mailbox dir = /home/mailboxes/t/e/test.info/test dovecot: quota-status(test at test.info): Debug: fs quota block device = /dev/sdc1 dovecot: quota-status(test at test.info): Debug: fs quota mount point = /home dovecot: quota-status(test at test.info): Debug: fs quota mount type = ext4 From rs at sys4.de Thu Dec 19 11:13:17 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 19 Dec 2013 10:13:17 +0100 Subject: [Dovecot] Does quota-status respect quota_grace? In-Reply-To: <52B2B445.1080100@thinline.cz> References: <52B2B445.1080100@thinline.cz> Message-ID: <52B2B8AD.7090208@sys4.de> Am 19.12.2013 09:54, schrieb Jiri Bourek: > quota2_grace = 18%% > quota_grace = 18%% i am not sure ,you can have two quota2_grace rules, that should be a universal parameter perhaps you mixed somthing with lda/lmtp overquota rules please reread http://wiki2.dovecot.org/Quota/Configuration and/or wait for Timos answer Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From bourek at thinline.cz Thu Dec 19 11:33:18 2013 From: bourek at thinline.cz (Jiri Bourek) Date: Thu, 19 Dec 2013 10:33:18 +0100 Subject: [Dovecot] Does quota-status respect quota_grace? In-Reply-To: <52B2B8AD.7090208@sys4.de> References: <52B2B445.1080100@thinline.cz> <52B2B8AD.7090208@sys4.de> Message-ID: <52B2BD5E.6000209@thinline.cz> Robert Schetterer wrote: > Am 19.12.2013 09:54, schrieb Jiri Bourek: >> quota2_grace = 18%% >> quota_grace = 18%% > > i am not sure ,you can have two quota2_grace rules, that should be a > universal parameter Documentation doesn't mention anything about multiple quota_grace rules explicitly (or I missed it), but from what I've tried, it works. For example if I comment out the quota_grace, default 10% is used for one quota while the other stays 18% From the debug log with quota_grace removed: Debug: Quota grace: root=Domain quota bytes=104857600 (10%) Debug: Quota grace: root=Mailbox quota bytes=2076180 (18%) From rs at sys4.de Thu Dec 19 12:08:20 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 19 Dec 2013 11:08:20 +0100 Subject: [Dovecot] Does quota-status respect quota_grace? In-Reply-To: <52B2BD5E.6000209@thinline.cz> References: <52B2B445.1080100@thinline.cz> <52B2B8AD.7090208@sys4.de> <52B2BD5E.6000209@thinline.cz> Message-ID: <52B2C594.1090007@sys4.de> Am 19.12.2013 10:33, schrieb Jiri Bourek: > Robert Schetterer wrote: >> Am 19.12.2013 09:54, schrieb Jiri Bourek: >>> quota2_grace = 18%% >>> quota_grace = 18%% >> >> i am not sure ,you can have two quota2_grace rules, that should be a >> universal parameter > > Documentation doesn't mention anything about multiple quota_grace rules > explicitly (or I missed it), but from what I've tried, it works. For > example if I comment out the quota_grace, default 10% is used for one > quota while the other stays 18% > > From the debug log with quota_grace removed: > Debug: Quota grace: root=Domain quota bytes=104857600 (10%) > Debug: Quota grace: root=Mailbox quota bytes=2076180 (18%) > if its not in docs, it may not work as you expected Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From andreas.schulze at datev.de Thu Dec 19 12:23:10 2013 From: andreas.schulze at datev.de (Andreas Schulze) Date: Thu, 19 Dec 2013 11:23:10 +0100 Subject: [Dovecot] Horde + dovecot metadata support Message-ID: <20131219102309.GA29049@spider.services.datevnet.de> Hello, Horde (http://horde.org) has the ability to store its preferences direct into a users imap mailbox using imap metadata extension. There are two implementations of the imap extension. 1. a dovecot plugin: http://hg.dovecot.org/dovecot-metadata-plugin 2. dovecot itself: http://www.dovecot.org/list/dovecot/2013-November/093243.html I setup Horde and dovecot-2.2.5 to use this extension and it works well using 1.) Now, with dovecot-2.2.9, the plugin fail to compile (unrelated problem on my side). So I tried 2.) But here I get a Horde-Error "Error in IMAP command GETMETADATA: Invalid arguments." I enables mail_debug but saw no helpfull logging. mail_attribute_dict = file:/tmp/%Lu/dovecot-attributes remote horde.testserver.ip/32 { imap_metadata = yes mail_debug = yes } Also I created directory /tmp/$my_login_id (mode 777) but dovecot also created no files. neither it logs anything about it. This is a sample imap session generated by horde: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 1 AUTHENTICATE PLAIN *** 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE METADATA QUOTA] Logged in 2 NAMESPACE * NAMESPACE (("" ".")) NIL NIL 2 OK Namespace completed. 3 LIST () "" (*) * LIST () "." INBOX 3 OK List completed. 4 GETMETADATA "*" (/shared/vendor/kolab/folder-type) 4 BAD Error in IMAP command GETMETADATA: Invalid arguments. 5 LOGOUT * BYE Logging out 5 OK Logout completed. Are there any hints or is the metadata extension just not fully implemented in dovecot? Thanks, Andreas -- Andreas Schulze Internetdienste | P252 DATEV eG 90329 N?rnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 N?rnberg, Paumgartnerstr. 6-14 | Registergericht N?rnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Dipl.-Kfm. Dr. Robert Mayr J?rg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen From d.parthey at metaways.de Thu Dec 19 12:25:45 2013 From: d.parthey at metaways.de (Daniel Parthey) Date: Thu, 19 Dec 2013 11:25:45 +0100 Subject: [Dovecot] mirror to download dovecot In-Reply-To: References: Message-ID: <7ba717a5-2248-4882-9b53-3d843772f0a3@email.android.com> Hi Edwardo, Which file or URL are you looking for? Try one of these: http://www.dovecot.org/download.html http://www.dovecot.org/releases/ Regards Daniel From amateo at um.es Thu Dec 19 14:36:23 2013 From: amateo at um.es (Angel Luis Mateo Martinez) Date: Thu, 19 Dec 2013 12:36:23 +0000 Subject: [Dovecot] problem with password in a changing scenario Message-ID: <20131219123623.Horde.RV_gTq06Uw6G_7v5rKkXGg1@webmail.um.es> Hello, I'm having a problem with with password changing. According to http://wiki2.dovecot.org/Authentication/Caching, I understand "normal scenario" and "Using old cached password scenario", but I'm having a problem with the "Early change scenario". I understand that in this case, if in step 4 user tries password Y, then this password is not tried again and login fails. But if the user tries another password Z, then is it test it? Or does it directly fail? I think that it is directly failing. And here is my problem... I am using dovecot with a ldap backend and another pam backend. The first one is users connecting with an email client. The other one applies when the ldap backend fails and it is use for connections from our webmail, which is integrated in our CAS SSO environment (it has running an imap proxy too). Sometimes (the only scenari we were able to reproduce is with users that for some reason has two SSO sessions opened) dovecot receives an invalid CAS ticket, then authentication fails, and no newer tickets are tried until cache is clean. That's why I think that in this scenario another Z password is even tried. Any idea? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337 -------------- next part -------------- # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 3.4.0-030400-generic x86_64 Ubuntu 12.04.3 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_master_user_separator = * default_process_limit = 1024 disable_plaintext_auth = no imapc_features = rfc822.size imapc_host = myotis30.um.es imapc_master_user = master imapc_password = VAsGowem log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_attachment_dir = /mail/users/attachments mail_gid = vmail mail_home = /mail/users/mailboxes/%2Ln/%Ln mail_location = mdbox:%h/mdbox:INDEX=/mail/indexes/%2Ln/%Ln mail_plugins = quota zlib lazy_expunge acl stats mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 50 M namespace { inbox = yes location = prefix = separator = . } namespace { hidden = yes list = no location = mdbox:%h/expunged:INDEX=/mail/indexes/%2Ln/%Ln/expunged prefix = BORRADOS. separator = . } namespace { list = children location = mdbox:%%h/mdbox:INDEX=/mail/indexes/%%2Ln/%%Ln prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes cache_key=%Ln dovecot driver = pam } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=3600 lazy_expunge = BORRADOS. quota = dict:User quota::file:%h/quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 15 stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es protocols = " imap lmtp sieve pop3 sieve" service anvil { client_limit = 3075 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0777 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 10240 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 6 } service stats { fifo_listener stats-mail { mode = 0666 } } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota zlib lazy_expunge acl stats sieve } protocol lda { mail_plugins = quota zlib lazy_expunge acl stats sieve } protocol imap { mail_plugins = quota zlib lazy_expunge acl stats imap_quota imap_acl } protocol pop3 { pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, in=%i, out=%o } local 155.54.211.160/27/27 { doveadm_password = } From przemek.orzechowski at makolab.pl Thu Dec 19 17:07:14 2013 From: przemek.orzechowski at makolab.pl (=?UTF-8?B?UHJ6ZW15c8WCYXcgT3J6ZWNob3dza2k=?=) Date: Thu, 19 Dec 2013 16:07:14 +0100 Subject: [Dovecot] zlib plugin question Message-ID: <52B30BA2.2080901@makolab.pl> Hi Is it possible to compress incoming mails delivered via dovecots LDA when using dovecot --version 1.2.9 or do i have to compress them via cron? From raabe at froglogic.com Thu Dec 19 18:51:08 2013 From: raabe at froglogic.com (Frerich Raabe) Date: Thu, 19 Dec 2013 17:51:08 +0100 Subject: [Dovecot] zlib plugin question In-Reply-To: <52B30BA2.2080901@makolab.pl> References: <52B30BA2.2080901@makolab.pl> Message-ID: On 2013-12-19 16:07, Przemys?aw Orzechowski wrote: > Is it possible to compress incoming mails delivered via dovecots LDA > when using > dovecot --version > 1.2.9 > or do i have to compress them via cron? There is a zlib plugin for Dovecot 1.x you could use. See http://wiki1.dovecot.org/Plugins/Zlib -- Frerich Raabe - raabe at froglogic.com www.froglogic.com - Multi-Platform GUI Testing From raabe at froglogic.com Thu Dec 19 18:53:08 2013 From: raabe at froglogic.com (Frerich Raabe) Date: Thu, 19 Dec 2013 17:53:08 +0100 Subject: [Dovecot] zlib plugin question In-Reply-To: References: <52B30BA2.2080901@makolab.pl> Message-ID: On 2013-12-19 17:51, Frerich Raabe wrote: > On 2013-12-19 16:07, Przemys?aw Orzechowski wrote: >> Is it possible to compress incoming mails delivered via dovecots LDA >> when using >> dovecot --version >> 1.2.9 >> or do i have to compress them via cron? > > There is a zlib plugin for Dovecot 1.x you could use. See > > http://wiki1.dovecot.org/Plugins/Zlib Sorry, I only now noticed that this plugin only allows reading compressed mail files - apparently you would need Dovecot v2.x if you want to compress incoming mail. -- Frerich Raabe - raabe at froglogic.com www.froglogic.com - Multi-Platform GUI Testing From tss at iki.fi Thu Dec 19 22:12:19 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 22:12:19 +0200 Subject: [Dovecot] userdb { prefetch } problem after upgrade (was Re: v2.2.9 released) In-Reply-To: References: <0B57B8E1-1802-47B9-B2BE-D6DABE2546E0@iki.fi> <9D6E4A58-3658-4C5A-ADF7-1ADF169FE1CD@iki.fi> Message-ID: On 13.12.2013, at 12.06, Steffen Kaiser wrote: > I noticed a change between my current install v2.2.5+ and the current hg version, the ids are symbolic now rather than numeric: > > old# doveadm user dvtest1 > field value > uid 30002 > gid 30002 > home /home/dvtest1 > > cur# doveadm user dvtest1 > field value > uid vmail > gid vmail > home /home/dvtest1 They should be numeric always or there is some problem. I can't really think of how it would even be possible to make them non-numeric.. What does it log with mail_debug=yes? From msmith at datafoundry.com Thu Dec 19 22:49:12 2013 From: msmith at datafoundry.com (Michael Smith (DF)) Date: Thu, 19 Dec 2013 20:49:12 +0000 Subject: [Dovecot] Mailbox with .broken files Message-ID: Anyone have any feedback, guidance or suggestions on this? Timo? -----Original Message----- From: Michael Smith (DF) [mailto:msmith at datafoundry.com] Sent: Friday, December 13, 2013 9:49 AM To: 'dovecot at dovecot.org' Subject: [Dovecot] Mailbox with .broken files We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp... files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = References: <20131219102309.GA29049@spider.services.datevnet.de> Message-ID: <769C46FE-A51F-4084-9305-391C74B335A6@iki.fi> On 19.12.2013, at 12.23, Andreas Schulze wrote: > 4 GETMETADATA "*" (/shared/vendor/kolab/folder-type) .. > Are there any hints or is the metadata extension just not fully implemented in dovecot? One bug: http://hg.dovecot.org/dovecot-2.2/rev/f64810b00b7f Then also Horde isn't sending a valid RFC 5464 command. Mailbox wildcards aren't supported by it. I think it was supported by the earlier drafts, but removed later. Looks like the previous dovecot-metadata plugin also allows it. So, I guess I can add it just as well: http://hg.dovecot.org/dovecot-2.2/rev/0c3071ebe44b (Noticed only after commit that this was Horde, not Kolab.) From tss at iki.fi Thu Dec 19 23:24:11 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 23:24:11 +0200 Subject: [Dovecot] Mailbox with .broken files In-Reply-To: References: Message-ID: On 13.12.2013, at 17.49, Michael Smith (DF) wrote: > We're using Dovecot 2.2.4 and mdbox storage with compression. > > I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. > > Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp... files also started showing up... > ... > -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 > -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken > -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 > -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken .. > What caused this problem? Something caused mdbox rebuilding, which triggered this bug: http://hg.dovecot.org/dovecot-2.2/rev/f965670a7b69 > How concerned should I be about possible lost email? This is a production environment. It's very likely there is some lost emails in the *.broken files. Fix would be to 1) upgrade to v2.2.6 or newer 2) take a backup of the mdbox 3) move *.broken to their original names. 4) doveadm force-resync -u user at domain INBOX The main problem here is that after Dovecot fixed e.g. m.1234 file and copied the original to m.1234.broken, it could still have added some new mails to m.1234 file and by replacing it those mails would get lost. This one is a bit tricky to check and to fix.. One possibility would be to use "doveadm dump" for the m.1234 and m.1234.broken files and verify that the .broken file has all the GUIDs that m.1234 has (and more). Except it's possible that user would have intentionally deleted some of those mails, so if you bring some mails back user might have to re-delete some of them. From slusarz at curecanti.org Thu Dec 19 23:27:15 2013 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 19 Dec 2013 14:27:15 -0700 Subject: [Dovecot] Horde + dovecot metadata support In-Reply-To: <769C46FE-A51F-4084-9305-391C74B335A6@iki.fi> References: <20131219102309.GA29049@spider.services.datevnet.de> <769C46FE-A51F-4084-9305-391C74B335A6@iki.fi> Message-ID: <20131219142715.Horde.AwYrMltkxJ2Nv5tgvlYY9g2@bigworm.curecanti.org> Quoting Timo Sirainen : > On 19.12.2013, at 12.23, Andreas Schulze wrote: > >> 4 GETMETADATA "*" (/shared/vendor/kolab/folder-type) > .. >> Are there any hints or is the metadata extension just not fully >> implemented in dovecot? > > One bug: http://hg.dovecot.org/dovecot-2.2/rev/f64810b00b7f > > Then also Horde isn't sending a valid RFC 5464 command. Mailbox > wildcards aren't supported by it. I think it was supported by the > earlier drafts, but removed later. Looks like the previous > dovecot-metadata plugin also allows it. So, I guess I can add it > just as well: http://hg.dovecot.org/dovecot-2.2/rev/0c3071ebe44b > (Noticed only after commit that this was Horde, not Kolab.) I believe this is an error in our Kolab integration rather than with the IMAP library itself. The metadata retrieval call in the library is doing nothing more than taking the "mailbox" input and escaping it. ("*" is a valid mailbox name, albeit non-optimal, so sanity checking is the responsibility of the consumer). I'll pass the report along so that this is fixed in the Kolab integration code. michael From tss at iki.fi Thu Dec 19 23:34:35 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 23:34:35 +0200 Subject: [Dovecot] External auth In-Reply-To: References: Message-ID: On 18.12.2013, at 12.26, eechim enorniel wrote: > I saw a lot of tutorials about setting postfix with dovecot sasl but I > would like more. > > I want to set a SSO system with roundcube on dovecot. > > I would like to know how to make dovecot work with sasl or saml, not as a > provider but as a service plugging on an external provider. > > I saw there is an EXTERNAL auth mechanism but I didn't find any doc about > it. There isn't really any standard way to do this, unless you count setting up a master password login from your webmail. Several systems have implemented their own SSO auth mechanisms that pass the token to Dovecot, which then verifies it from some external server. I was thinking about creating some semi-standard for that, but not implemented yet. And in any case it would still require some way of verifying the token from all kinds of different SSO servers, so it's not some quick task and I'm not sure if it should be something that would be even distributed with Dovecot. From tss at iki.fi Thu Dec 19 23:44:44 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 23:44:44 +0200 Subject: [Dovecot] Does quota-status respect quota_grace? In-Reply-To: <52B2B445.1080100@thinline.cz> References: <52B2B445.1080100@thinline.cz> Message-ID: <72CF4A57-FBF4-4697-8D53-CC944FDE8F95@iki.fi> On 19.12.2013, at 10.54, Jiri Bourek wrote: > As far as I can tell, quota enforcing in dovecot-lda works correctly. User is allowed one message which brings him over quota (provided the message fits into filesystem quota hard limit and quota_grace value), every other message after that is rejected. > > However policy service quota-status for Postfix seems to ignore the quota_grace value. When a message arrives which would make user go over quota (but which would not make him exceed the grace limit value), Postfix checks the policy service and is told to reject the message. http://hg.dovecot.org/dovecot-2.2/rev/be98fec32cd8 should help. From tss at iki.fi Thu Dec 19 23:49:16 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 23:49:16 +0200 Subject: [Dovecot] Errors in log file In-Reply-To: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> References: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> Message-ID: On 16.12.2013, at 23.46, Christian R??ner wrote: > Dec 16 17:21:55 imap(roessner@****): Error: stat(/srv/mail/virtual/*****/roessner/.dovecot.sieve/tmp) failed: Not a directory This is why it's not a good idea to use home as the Maildir root directory. You can work around this by setting maildir_stat_dirs=yes (minor performance hit). A bigger problem comes if a user creates a "dovecot/sieve" folder. From tss at iki.fi Thu Dec 19 23:55:11 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 23:55:11 +0200 Subject: [Dovecot] auth failures In-Reply-To: <20131212110543.GA4702@spider.services.datevnet.de> References: <20131212110543.GA4702@spider.services.datevnet.de> Message-ID: <88A3807C-16FD-431D-9AE4-3FAEE82E0F8C@iki.fi> On 12.12.2013, at 13.05, Andreas Schulze wrote: > last week and today our dovecot pop3 server stopped responding. > Without any other logentries dovecot start to log only this: > > Dec 12 09:14:12 mbox1 dovecot: auth: Error: ldap(testuser,192.0.2.110,): ldap_search(base=ou=accounts,dc=example,dc=de filter=(&(|(uid=testuser)(mail=testuser))(!(state=blocked)))) failed: Operations error > > For every pop3 Session, ~2000 per Minute ..., over 10 Minutes > I send dovecot a SIGTERM. After dovecot was started again, all was fine again. > > # doveconf -n > http://postmaster.datev.de/tmp/dovecot.conf > > The LDAP-Server itself did resond to queries in the same timeframe. I know this because the MTA on the same host was able to deliver messages into mailboxes. Likely the difference is that Dovecot keeps the LDAP connection open for a very long time, while MTA likely recreates new connections often (maybe even every time). I guess the fix would be to simply treat that error as "reconnection required": http://hg.dovecot.org/dovecot-2.2/rev/ea38559ffd4e From tss at iki.fi Thu Dec 19 23:59:40 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 19 Dec 2013 23:59:40 +0200 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <52B1B6BC.3050707@ente.limmat.ch> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> <52B0F3CF.4040709@ente.limmat.ch> <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> <52B1B6BC.3050707@ente.limmat.ch> Message-ID: <95C6C48A-E2E1-4921-A907-5FB19E9BB2B4@iki.fi> On 18.12.2013, at 16.52, Adrian Zaugg wrote: > Am 18.12.13 11:33 schrieb Timo Sirainen: >> I think this would work as well: >> >> protocol lmtp { >> auth_username_format = %Lu >> } > > I tried this with dovecot 2.1.7, but it did not work. It may work on a > newer dovecot? Well, this is already the default setting in v2.1. So what you would really need to do is: auth_username_format = %u protocol lmtp { auth_username_format = %Lu } Not sure why it wouldn't otherwise work. auth_debug=yes might show something useful. From tss at iki.fi Fri Dec 20 00:37:21 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 20 Dec 2013 00:37:21 +0200 Subject: [Dovecot] reproducible dsync backup panic (dovecot 2.2.7) In-Reply-To: References: Message-ID: On 17.12.2013, at 11.54, Peter Benko wrote: > I'm receiving a reproducible dsync backup panic for some of my users. The error message is as follows: > > dsync-remote(user@): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) Can you get it to dump core and use gdb /usr/bin/doveadm core bt full fr 5 p *change > The command I'm using to back up individual user's mail is something like: > > sudo -u vmail dsync -v -u user at server.com -R backup ssh -i sshid-file login at server.com sudo -u vmail dsync -v -u user at server.com Probably an easier way would be if you could copy the local and remote mdboxes to e.g. /tmp/mdbox-local and /tmp/mdbox-remote. Then you should be able to do: gdb --args doveadm -o mail=mdbox:/tmp/mdbox-local backup -R mdbox:/tmp/mdbox-remote run bt full fr 5 p *change Oh, and in any case this would be helpful in figuring out the problem. Run these on both local and remote servers and send the output to me: doveadm mailbox status -u user at domain 'guid uidvalidity uidnext' '*' doveadm dump /mail/mailboxes/domain/user/dovecot.mailbox.log From wdgarc88 at gmail.com Fri Dec 20 01:01:06 2013 From: wdgarc88 at gmail.com (Edwardo Garcia) Date: Fri, 20 Dec 2013 09:01:06 +1000 Subject: [Dovecot] mirror to download dovecot In-Reply-To: <7ba717a5-2248-4882-9b53-3d843772f0a3@email.android.com> References: <7ba717a5-2248-4882-9b53-3d843772f0a3@email.android.com> Message-ID: 2.2.9 release but point of post is I cannot reach dovecot website we has a route fault to it On Thu, Dec 19, 2013 at 8:25 PM, Daniel Parthey wrote: > Hi Edwardo, > > Which file or URL are you looking for? > > Try one of these: > http://www.dovecot.org/download.html > http://www.dovecot.org/releases/ > > Regards > Daniel From tss at iki.fi Fri Dec 20 01:15:27 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 20 Dec 2013 01:15:27 +0200 Subject: [Dovecot] mirror to download dovecot In-Reply-To: References: <7ba717a5-2248-4882-9b53-3d843772f0a3@email.android.com> Message-ID: <5C7E012A-4D94-4390-A229-314D354174EB@iki.fi> dovecot.org points to 193.210.130.67 but you can't download Dovecot from there (it redirects to www.dovecot.org). www.dovecot.org has two IPs: 62.236.108.70 and 62.50.189.34. I would think that at least one of them works? Most web browsers nowadays automatically try both IPs if the first one fails. You can also access these directly as syksy.dovecot.org and kevat.dovecot.org. There was some trouble with kevat.dovecot.org yesterday, but it seems to work now. On 20.12.2013, at 1.01, Edwardo Garcia wrote: > 2.2.9 release > but point of post is I cannot reach dovecot website we has a route fault to > it > > > On Thu, Dec 19, 2013 at 8:25 PM, Daniel Parthey wrote: > >> Hi Edwardo, >> >> Which file or URL are you looking for? >> >> Try one of these: >> http://www.dovecot.org/download.html >> http://www.dovecot.org/releases/ >> >> Regards >> Daniel From tss at iki.fi Fri Dec 20 05:07:10 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 20 Dec 2013 05:07:10 +0200 Subject: [Dovecot] v2.2.10 released Message-ID: <290D21FB-FD16-43E9-992A-C2CBD077C53C@iki.fi> http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz.sig I've been really busy the last few months, as I guess people in Dovecot mailing list have seen since I haven't been very responsive. There are at least some dsync bugs I haven't had time to look into yet. The busyness probably continues for a while more, but the next year is looking much better for me and for Dovecot in general. We're planning to hire a few more Dovecot coders at some point, so if you're interested send me an email. :) + auth: passdb/userdb dict rewrite to support much more complex setups. See doc/example-config/dovecot-dict-auth.conf.ext. The old settings will continue to work. + auth: Added userdb result_success/failure/tempfail and skip settings, similar to passdb's. See http://wiki2.dovecot.org/UserDatabase + imap: Implemented SETQUOTA command for admin user when quota_set is configured. See http://master.wiki2.dovecot.org/Quota/Configuration + quota: Support "*" and "?" wildcards in mailbox names in quota_rules + mysql: Added ssl_verify_server_cert=no|yes parameter. This currently defaults to "no" to make sure nothing breaks, but likely will become "yes" in Dovecot v2.3. + ldap: Added blocking=yes setting to use auth worker processes for ldap lookups. This is a workaround for now to be able to use multiple simultaneous LDAP connections. + pop3c+dsync performance improvements - quota-status: quota_grace was ignored - ldap: Fixed memory leak with auth_bind=yes and without auth_bind_userdn. - imap: Don't send HIGHESTMODSEQ anymore on SELECT/EXAMINE when CONDSTORE/QRESYNC has never before been enabled for the mailbox. - imap: Fixes to handling mailboxes without permanent modseqs. (When [NOMODSEQ] is returned by SELECT, mainly with in-memory indexes.) - imap: Various fixes to METADATA support. - stats plugin: Processes that only temporarily dropped privileges (e.g. indexer-worker) may have been logging errors about not being able to open /proc/self/io. From bourek at thinline.cz Fri Dec 20 09:45:06 2013 From: bourek at thinline.cz (Jiri Bourek) Date: Fri, 20 Dec 2013 08:45:06 +0100 Subject: [Dovecot] Does quota-status respect quota_grace? In-Reply-To: <72CF4A57-FBF4-4697-8D53-CC944FDE8F95@iki.fi> References: <52B2B445.1080100@thinline.cz> <72CF4A57-FBF4-4697-8D53-CC944FDE8F95@iki.fi> Message-ID: <52B3F582.5080905@thinline.cz> Timo Sirainen wrote: > On 19.12.2013, at 10.54, Jiri Bourek wrote: > >> As far as I can tell, quota enforcing in dovecot-lda works >> correctly. User is allowed one message which brings him over quota >> (provided the message fits into filesystem quota hard limit and >> quota_grace value), every other message after that is rejected. >> >> However policy service quota-status for Postfix seems to ignore the >> quota_grace value. When a message arrives which would make user go >> over quota (but which would not make him exceed the grace limit >> value), Postfix checks the policy service and is told to reject the >> message. > > http://hg.dovecot.org/dovecot-2.2/rev/be98fec32cd8 should help. > It does, thanks a lot From cr at sys4.de Fri Dec 20 13:22:37 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Fri, 20 Dec 2013 12:22:37 +0100 Subject: [Dovecot] Errors in log file In-Reply-To: References: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> Message-ID: Hi, >> Dec 16 17:21:55 imap(roessner@****): Error: stat(/srv/mail/virtual/*****/roessner/.dovecot.sieve/tmp) failed: Not a directory > > This is why it's not a good idea to use home as the Maildir root directory. You can work around this by setting maildir_stat_dirs=yes (minor performance hit). A bigger problem comes if a user creates a "dovecot/sieve" folder. I fully agree. The mailboxes are historical from an old Courier-IMAP server. Maybe more than 5 years ago. I switched to Dovecot in the past. Probably I will write a little script and rearrange the directory structure. The workaround is okay for now. Thanks a lot Enjoy the holidays -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From radekburza at tlen.pl Fri Dec 20 15:53:22 2013 From: radekburza at tlen.pl (=?UTF-8?Q?radek?=) Date: Fri, 20 Dec 2013 14:53:22 +0100 Subject: [Dovecot] =?utf-8?q?=5Bdovecot-2=2E2=2E5=5D_Duplicates_in_mdbox?= Message-ID: <40620a77.70b4c4b4.52b44bd2.c99f9@tlen.pl> Hi I have strange situation with one of mailboxes in mdbox format. Some messages are duplicated, not all. I am sure that is not sieve or another mail client issue, because access is via roundcube without sieve plugin. In maillog I have not found any suspicious information about this problem and i can see that from postfix do dovecot-lda was piped only one copy of message. Radek From adi at ente.limmat.ch Fri Dec 20 22:56:02 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Fri, 20 Dec 2013 21:56:02 +0100 Subject: [Dovecot] configure lmtp to deliver to email addresses case insensitively In-Reply-To: <95C6C48A-E2E1-4921-A907-5FB19E9BB2B4@iki.fi> References: <52AF5632.5050104@ente.limmat.ch> <52AF61D3.3030403@Media-Brokers.com> <52AF7169.9040608@ente.limmat.ch> <52AF76BE.7090600@Media-Brokers.com> <52AF8484.2050704@ente.limmat.ch> <52AFB11F.3040409@ente.limmat.ch> <52B0F3CF.4040709@ente.limmat.ch> <215FBD15-4991-44C3-AE3D-47F9555C75AB@iki.fi> <52B1B6BC.3050707@ente.limmat.ch> <95C6C48A-E2E1-4921-A907-5FB19E9BB2B4@iki.fi> Message-ID: <52B4AEE2.1050607@ente.limmat.ch> I've updated the wiki under: http://wiki2.dovecot.org/LMTP/Exim to document the discussed problem. Maybe someone can review this. Regards, Adrian. Am 19.12.13 22:59 schrieb Timo Sirainen: > auth_username_format = %u > protocol lmtp { > auth_username_format = %Lu > } From slitt at troubleshooters.com Fri Dec 20 23:53:09 2013 From: slitt at troubleshooters.com (Steve Litt) Date: Fri, 20 Dec 2013 16:53:09 -0500 Subject: [Dovecot] Thank you! Message-ID: <20131220165309.646a0f31@mydesk> Hi all, I've been on this list for 18 months but almost completely as a lurker. You know why? Because Dovecot never, ever, ever screws up on me or displays unexpected behavior, so I never have technical questions. Thank you for producing such a rock solid piece of software! SteveT Steve Litt * http://www.troubleshooters.com/ Troubleshooting Training * Human Performance From cr at sys4.de Sat Dec 21 01:47:29 2013 From: cr at sys4.de (=?utf-8?Q?Christian_R=C3=B6=C3=9Fner?=) Date: Sat, 21 Dec 2013 00:47:29 +0100 Subject: [Dovecot] [SOLVED] Errors in log file In-Reply-To: References: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> Message-ID: <8528768F-2373-4167-848A-C9FE34B5982D@sys4.de> Hi >>> Dec 16 17:21:55 imap(roessner@****): Error: stat(/srv/mail/virtual/*****/roessner/.dovecot.sieve/tmp) failed: Not a directory >> >> This is why it's not a good idea to use home as the Maildir root directory. You can work around this by setting maildir_stat_dirs=yes (minor performance hit). A bigger problem comes if a user creates a "dovecot/sieve" folder. > > I fully agree. The mailboxes are historical from an old Courier-IMAP server. Maybe more than 5 years ago. I switched to Dovecot in the past. > > Probably I will write a little script and rearrange the directory structure. Solved! 15.000 lines bash script and now I have a perfect clean directory structure and all problems are gone Happy holidays Christian From jonikula at gmail.com Sat Dec 21 08:52:32 2013 From: jonikula at gmail.com (Jouko Nikula) Date: Sat, 21 Dec 2013 13:52:32 +0700 Subject: [Dovecot] Ignoring mount points for secondary dovecot instance does not seem to work Message-ID: Hello, I tried to ignore all mountpoints in Dovecot. I have two dovecot instances running: root at fileserver# doveadm instance list path name last used running /usr/local/var/run/dovecot dovecot 2013-12-21 08:09:34 yes /var/run/dovecot.smtp smtp-auth 2013-12-21 08:09:34 yes I give commands: root at fileserver# doveadm mount add '/*' ignore root at fileserver# doveadm -i smtp-auth mount add '/*' ignore And then restart dovecot. In the log I can see that the main instance is now ignoring my mountpoints, but the smtp-auth instance is still warning about my mountpoints. Is this a bug or am I missing something? My configurations are as follows: root at fileserver# doveconf -ni smtp-auth # 2.2.9: /usr/local/etc/dovecot/dovecot.conf.smtp # OS: Linux 3.2.0-4-686-pae i686 Debian 7.1 auth_mechanisms = plain login base_dir = /var/run/dovecot.smtp/ first_valid_uid = 123 instance_name = smtp-auth log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = mail mail_location = maildir:~/mail mail_uid = vmail passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = dovecot driver = pam } protocols = service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = References: <20131213010751.AD240E0090@blue.fi.intel.com> <52AB70AC.1030201@rename-it.nl> <20131213221430.EDA5BE0090@blue.fi.intel.com> <52AC2DC8.4030508@rename-it.nl> <20131214163930.96645E0090@blue.fi.intel.com> Message-ID: <52B5A337.507@rename-it.nl> On 12/14/2013 5:39 PM, Kirill A. Shutemov wrote: > Stephan Bosch wrote: >> On 12/13/2013 11:14 PM, Kirill A. Shutemov wrote: >>> Stephan Bosch wrote: >>>> This probably fixes it, although I am not entirely sure. I am mainly a >>>> bit puzzled on how this causes the fd leak; the fd_in and fd_out are for >>>> the current backends always the same fd. >>> fd_in is not opened in my case: -1 all the way. I use vnd.dovecot.pipe. >> Ah right, that explains it. >> >>> I've hackaround sieve-filter crash with the ugly patch. I don't know how to fix >>> this properly. >> Could you provide more details of your setup (configuration, >> sieve-filter command line, Sieve script), so that I can reproduce the >> problem at this end? > Command: > > sieve-filter -e -v -W ~/.dovecot.sieve INBOX expunge This should fix it: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/8612191c5069 I tested it here with several hundred thousand old spam e-mails. Regards, Stephan. From CMarcus at Media-Brokers.com Sat Dec 21 17:10:33 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 21 Dec 2013 10:10:33 -0500 Subject: [Dovecot] [SOLVED] Errors in log file In-Reply-To: <8528768F-2373-4167-848A-C9FE34B5982D@sys4.de> References: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> <8528768F-2373-4167-848A-C9FE34B5982D@sys4.de> Message-ID: <52B5AF69.7090209@Media-Brokers.com> On 2013-12-20 6:47 PM, Christian R??ner wrote: >>> This is why it's not a good idea to use home as the Maildir root directory. You can work around this by setting maildir_stat_dirs=yes (minor performance hit). A bigger problem comes if a user creates a "dovecot/sieve" folder. >> I fully agree. The mailboxes are historical from an old Courier-IMAP server. Maybe more than 5 years ago. I switched to Dovecot in the past. >> >> Probably I will write a little script and rearrange the directory structure. > Solved! 15.000 lines bash script and now I have a perfect clean directory structure and all problems are gone Care to share the script? I collect cool little things like this in case I ever need something like it... -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Sat Dec 21 17:49:07 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 21 Dec 2013 10:49:07 -0500 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? Message-ID: <52B5B873.8070504@Media-Brokers.com> Hi all, Our mailstore was converted from a Courier-IMAP system last year, but I am planning a migration to a shiny new VM, and would really like to clean things up and do away with the legacy INBOX namespace. My goal is to simplify IMAP client setup - no special 'INBOX' namespace needed, they just enter the server info and credentials. Also important because I will be rolling out SOGo, which has a nice web interface, and I want the mailstore to be as close to default dovecot settings as possible - although I do plan on converting from maildir to mdbox when I do the conversion I also don't want other folders to show up as subfolders of the Inbox in IMAP clients, they should all show up on the same level as the Inbox. I've read http://wiki2.dovecot.org/Migration/Courier, but I don't see anything about how to eliminate this stupid legacy INBOX. namespace, so that new IMAP clients won't show all folders as subfolders of the INBOX unless/until they add the INBOX namespace prefix in the advanced settings. I've also been reading http://wiki2.dovecot.org/Namespaces, but I'm still confused as to how to go about this. Currently I have: namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } The wiki recommends avoiding the 'alternative' of having two different namespaces, so I don't want to do that. Also - it would be ok if existing clients had temporary issues displaying folders properly until the INBOX prefix was removed (I would give everyone plenty of advance warning). Anyone ever done this before? Any suggestions Timo? Note: I am planning a migration to a new mail server (VM), so could make any filesystem layout changes when I do this if necessary. Thanks, -- Best regards, */Charles/* From tss at iki.fi Sat Dec 21 17:58:55 2013 From: tss at iki.fi (Timo Sirainen) Date: Sat, 21 Dec 2013 17:58:55 +0200 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? In-Reply-To: <52B5B873.8070504@Media-Brokers.com> References: <52B5B873.8070504@Media-Brokers.com> Message-ID: On 21.12.2013, at 17.49, Charles Marcus wrote: > Our mailstore was converted from a Courier-IMAP system last year, but I am planning a migration to a shiny new VM, and would really like to clean things up and do away with the legacy INBOX namespace. > > My goal is to simplify IMAP client setup - no special 'INBOX' namespace needed, they just enter the server info and credentials. > > Also important because I will be rolling out SOGo, which has a nice web interface, and I want the mailstore to be as close to default dovecot settings as possible - although I do plan on converting from maildir to mdbox when I do the conversion > > I also don't want other folders to show up as subfolders of the Inbox in IMAP clients, they should all show up on the same level as the Inbox. > > I've read http://wiki2.dovecot.org/Migration/Courier, but I don't see anything about how to eliminate this stupid legacy INBOX. namespace, so that new IMAP clients won't show all folders as subfolders of the INBOX unless/until they add the INBOX namespace prefix in the advanced settings. > > I've also been reading http://wiki2.dovecot.org/Namespaces, but I'm still confused as to how to go about this. I don't think it can be done easily with just a single config. Whatever you do to new users might break existing setups. So the only good way I think would be to use two different IPs. One for the new setups, one for the old. For example imap.domain.com -> mail.domain.com or vice versa. From cr at sys4.de Sat Dec 21 18:43:30 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Sat, 21 Dec 2013 17:43:30 +0100 Subject: [Dovecot] [SOLVED] Errors in log file In-Reply-To: <52B5AF69.7090209@Media-Brokers.com> References: <4ACC7EA3-44E3-4FB7-9519-84ABAFD45A61@sys4.de> <8528768F-2373-4167-848A-C9FE34B5982D@sys4.de> <52B5AF69.7090209@Media-Brokers.com> Message-ID: <09015498-4C81-4E14-AD7C-955DA84B513D@sys4.de> Hi, >>>> This is why it's not a good idea to use home as the Maildir root directory. You can work around this by setting maildir_stat_dirs=yes (minor performance hit). A bigger problem comes if a user creates a "dovecot/sieve" folder. > >>> I fully agree. The mailboxes are historical from an old Courier-IMAP server. Maybe more than 5 years ago. I switched to Dovecot in the past. >>> >>> Probably I will write a little script and rearrange the directory structure. > >> Solved! 15.000 lines bash script and now I have a perfect clean directory structure and all problems are gone > > Care to share the script? I collect cool little things like this in case I ever need something like it... Of course. This script is a python script that generates the bash script. It assumes that the maildir is directly und a users home and that also the sieve folder lives inside the maildir. But the script is very simple, so you can adopt it to your needs: Second, it looks for a sieve script called default.sieve, which I told roundcube to use as a name. So maybe you need to adjust this as well. -------------- next part -------------- A non-text attachment was scrubbed... Name: fix-mboxes.py Type: text/x-python-script Size: 2366 bytes Desc: not available URL: -------------- next part -------------- The result looks something like: ------------------------------------------------------------ #!/bin/bash P=/srv/mail/virtual umask 077 ? mv ${P}/deltaweb.de/cr ${P}/deltaweb.de/__maildir__cr__ mkdir ${P}/deltaweb.de/cr chown vmail:mail ${P}/deltaweb.de/cr mv ${P}/deltaweb.de/__maildir__cr__ ${P}/deltaweb.de/cr/maildir mkdir ${P}/deltaweb.de/cr/sieve chown vmail:mail ${P}/deltaweb.de/cr/sieve if [[ -f ${P}/deltaweb.de/cr/maildir/sieve/default.sieve ]]; then mv ${P}/deltaweb.de/cr/maildir/sieve/default.sieve ${P}/deltaweb.de/cr/sieve/ test -f ${P}/deltaweb.de/cr/maildir/.dovecot.svbin && \ mv ${P}/deltaweb.de/cr/maildir/.dovecot.svbin ${P}/deltaweb.de/cr/ test -f ${P}/deltaweb.de/cr/maildir/.dovecot.lda-dupes && \ mv ${P}/deltaweb.de/cr/maildir/.dovecot.lda-dupes ${P}/deltaweb.de/cr/ test -f ${P}/deltaweb.de/cr/maildir/.dovecot.sieve.log && \ mv ${P}/deltaweb.de/cr/maildir/.dovecot.sieve.log ${P}/deltaweb.de/cr/ ( cd ${P}/deltaweb.de/cr; ln -s sieve/default.sieve .dovecot.sieve ) rm -f ${P}/deltaweb.de/cr/maildir/.dovecot.sieve fi rm -rf ${P}/deltaweb.de/cr/maildir/sieve ? exit 0 ------------------------------------------------------------ It is not perfect, but for our server it did the trick ;-) So enjoy? -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From CMarcus at Media-Brokers.com Sat Dec 21 19:12:19 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 21 Dec 2013 12:12:19 -0500 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? In-Reply-To: References: <52B5B873.8070504@Media-Brokers.com> Message-ID: <52B5CBF3.4010409@Media-Brokers.com> On 2013-12-21 10:58 AM, Timo Sirainen wrote: > On 21.12.2013, at 17.49, Charles Marcus wrote: > >> Our mailstore was converted from a Courier-IMAP system last year, but I am planning a migration to a shiny new VM, and would really like to clean things up and do away with the legacy INBOX namespace. >> >> My goal is to simplify IMAP client setup - no special 'INBOX' namespace needed, they just enter the server info and credentials. >> >> Also important because I will be rolling out SOGo, which has a nice web interface, and I want the mailstore to be as close to default dovecot settings as possible - although I do plan on converting from maildir to mdbox when I do the conversion >> >> I also don't want other folders to show up as subfolders of the Inbox in IMAP clients, they should all show up on the same level as the Inbox. >> >> I've read http://wiki2.dovecot.org/Migration/Courier, but I don't see anything about how to eliminate this stupid legacy INBOX. namespace, so that new IMAP clients won't show all folders as subfolders of the INBOX unless/until they add the INBOX namespace prefix in the advanced settings. >> >> I've also been reading http://wiki2.dovecot.org/Namespaces, but I'm still confused as to how to go about this. > I don't think it can be done easily with just a single config. Whatever you do to new users might break existing setups. So the only good way I think would be to use two different IPs. One for the new setups, one for the old. For example imap.domain.com -> mail.domain.com or vice versa. Actually, that's a good idea... thanks! :) Then I guess I proxy the old users to the old server until I get them all converted? Now I'm off to read about how to implement that... -- Best regards, */Charles/* From kirill at shutemov.name Sat Dec 21 19:17:29 2013 From: kirill at shutemov.name (Kirill A. Shutemov) Date: Sat, 21 Dec 2013 19:17:29 +0200 Subject: [Dovecot] File descriptor leak in sieve-extprograms In-Reply-To: <52B5A337.507@rename-it.nl> References: <20131213010751.AD240E0090@blue.fi.intel.com> <52AB70AC.1030201@rename-it.nl> <20131213221430.EDA5BE0090@blue.fi.intel.com> <52AC2DC8.4030508@rename-it.nl> <20131214163930.96645E0090@blue.fi.intel.com> <52B5A337.507@rename-it.nl> Message-ID: <20131221171729.GA26142@node.dhcp.inet.fi> On Sat, Dec 21, 2013 at 03:18:31PM +0100, Stephan Bosch wrote: > On 12/14/2013 5:39 PM, Kirill A. Shutemov wrote: > > Stephan Bosch wrote: > >> On 12/13/2013 11:14 PM, Kirill A. Shutemov wrote: > >>> Stephan Bosch wrote: > >>>> This probably fixes it, although I am not entirely sure. I am mainly a > >>>> bit puzzled on how this causes the fd leak; the fd_in and fd_out are for > >>>> the current backends always the same fd. > >>> fd_in is not opened in my case: -1 all the way. I use vnd.dovecot.pipe. > >> Ah right, that explains it. > >> > >>> I've hackaround sieve-filter crash with the ugly patch. I don't know how to fix > >>> this properly. > >> Could you provide more details of your setup (configuration, > >> sieve-filter command line, Sieve script), so that I can reproduce the > >> problem at this end? > > Command: > > > > sieve-filter -e -v -W ~/.dovecot.sieve INBOX expunge > > This should fix it: > > http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/8612191c5069 > > I tested it here with several hundred thousand old spam e-mails. Verified with valgrind too. Thanks. -- Kirill A. Shutemov From genie at geniechka.ru Sat Dec 21 20:10:26 2013 From: genie at geniechka.ru (Eugene) Date: Sat, 21 Dec 2013 22:10:26 +0400 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? In-Reply-To: <52B5CBF3.4010409@Media-Brokers.com> References: <52B5B873.8070504@Media-Brokers.com> <52B5CBF3.4010409@Media-Brokers.com> Message-ID: <1BEDF09BDBC44AA2BA193E05E2A9679D@geniepc2011> Hello, It has been a while since I migrated from Courier to Dovecot, but I don't remember any special problems. They both were using $HOME/Maildir for storage so I did not even had to move anything, just remove that INBOX root prefix from the client config and refresh the folder list. Best wishes Eugene -----Original Message----- From: Charles Marcus Sent: Saturday, December 21, 2013 9:12 PM To: dovecot at dovecot.org Subject: Re: [Dovecot] Eliminate legacy INBOX namespace - how? On 2013-12-21 10:58 AM, Timo Sirainen wrote: > On 21.12.2013, at 17.49, Charles Marcus wrote: > >> Our mailstore was converted from a Courier-IMAP system last year, but I >> am planning a migration to a shiny new VM, and would really like to clean >> things up and do away with the legacy INBOX namespace. >> >> My goal is to simplify IMAP client setup - no special 'INBOX' namespace >> needed, they just enter the server info and credentials. >> >> Also important because I will be rolling out SOGo, which has a nice web >> interface, and I want the mailstore to be as close to default dovecot >> settings as possible - although I do plan on converting from maildir to >> mdbox when I do the conversion >> >> I also don't want other folders to show up as subfolders of the Inbox in >> IMAP clients, they should all show up on the same level as the Inbox. >> >> I've read http://wiki2.dovecot.org/Migration/Courier, but I don't see >> anything about how to eliminate this stupid legacy INBOX. namespace, so >> that new IMAP clients won't show all folders as subfolders of the INBOX >> unless/until they add the INBOX namespace prefix in the advanced >> settings. >> >> I've also been reading http://wiki2.dovecot.org/Namespaces, but I'm still >> confused as to how to go about this. > I don't think it can be done easily with just a single config. Whatever > you do to new users might break existing setups. So the only good way I > think would be to use two different IPs. One for the new setups, one for > the old. For example imap.domain.com -> mail.domain.com or vice versa. Actually, that's a good idea... thanks! :) Then I guess I proxy the old users to the old server until I get them all converted? Now I'm off to read about how to implement that... -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Sat Dec 21 23:24:47 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 21 Dec 2013 16:24:47 -0500 Subject: [Dovecot] New server missing auth-worker entries in logs Message-ID: <52B6071F.1000601@Media-Brokers.com> Hi all, Ok, I'm making progress on my new server, but there is an entry in the logs on the old/current server that is not showing p on the new one... lines like: dovecot: auth-worker(20284): mysql(localhost): Connected to database my_auth_db I've looked everywhere, compared settings, etc, and can't seem to find why I get this line on the old server and odn't on the new one. Anyone have a clue stick? Thanks From tss at iki.fi Sat Dec 21 23:57:45 2013 From: tss at iki.fi (Timo Sirainen) Date: Sat, 21 Dec 2013 23:57:45 +0200 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? In-Reply-To: <52B5CBF3.4010409@Media-Brokers.com> References: <52B5B873.8070504@Media-Brokers.com> <52B5CBF3.4010409@Media-Brokers.com> Message-ID: <9A8179E7-D671-49C7-8A19-CB5DEC169A40@iki.fi> On 21.12.2013, at 19.12, Charles Marcus wrote: >> I don't think it can be done easily with just a single config. Whatever you do to new users might break existing setups. So the only good way I think would be to use two different IPs. One for the new setups, one for the old. For example imap.domain.com -> mail.domain.com or vice versa. > > Actually, that's a good idea... thanks! :) > > Then I guess I proxy the old users to the old server until I get them all converted? Now I'm off to read about how to implement that... You can use a single Dovecot, just use something like: namespace inbox { prefix = } local 1.2.3.4 { namespace inbox { prefix = INBOX. } } Where 1.2.3.4 would be the IP for the old configuration. From tss at iki.fi Sat Dec 21 23:59:18 2013 From: tss at iki.fi (Timo Sirainen) Date: Sat, 21 Dec 2013 23:59:18 +0200 Subject: [Dovecot] New server missing auth-worker entries in logs In-Reply-To: <52B6071F.1000601@Media-Brokers.com> References: <52B6071F.1000601@Media-Brokers.com> Message-ID: <42150738-A23A-48DE-88A7-329FEAA8C13E@iki.fi> On 21.12.2013, at 23.24, Charles Marcus wrote: > Ok, I'm making progress on my new server, but there is an entry in the logs on the old/current server that is not showing p on the new one... lines like: > > dovecot: auth-worker(20284): mysql(localhost): Connected to database my_auth_db > > I've looked everywhere, compared settings, etc, and can't seem to find why I get this line on the old server and odn't on the new one. http://hg.dovecot.org/dovecot-2.2/rev/33e78edac8f5 From CMarcus at Media-Brokers.com Sun Dec 22 16:44:24 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 09:44:24 -0500 Subject: [Dovecot] New server missing auth-worker entries in logs In-Reply-To: <42150738-A23A-48DE-88A7-329FEAA8C13E@iki.fi> References: <52B6071F.1000601@Media-Brokers.com> <42150738-A23A-48DE-88A7-329FEAA8C13E@iki.fi> Message-ID: <52B6FAC8.4090603@Media-Brokers.com> On 2013-12-21 4:59 PM, Timo Sirainen wrote: > On 21.12.2013, at 23.24, Charles Marcus wrote: >> I've looked everywhere, compared settings, etc, and can't seem to find why I get this line on the old server and odn't on the new one. > http://hg.dovecot.org/dovecot-2.2/rev/33e78edac8f5 Do you never sleep Timo??? Anyway, thanks for the quick fix! -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Sun Dec 22 17:13:29 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 10:13:29 -0500 Subject: [Dovecot] Duplicated (but only for unread) messages after second rsync pass... Message-ID: <52B70199.3030501@Media-Brokers.com> Ok, I know I should probably be using dsync for this, but I'm more familiar with rsync, and didn't think this would be a problem. Here is what I am doing, and what is apparently happening (only done this once, but I'm guessing it will happen each time): rsync -avHP /mnt/vmail/example.com/user1/ /var/vmail/example.com/user1/ chown -R vmail:vmail /var/vmail/example.com Ok, so far so good, everything works fine accessing the mails (I'm using Thunderbird). Now I do another rsync, but this time I did the entire mailstore: rsync -avHP /mnt/vmail/example.com/ /var/vmail/example.com/ chown -R vmail:vmail /var/vmail/example.com Right after I started up dovecot again, I hot a bunch of these in the logs: 2013-12-22T09:52:51-05:00 newhost dovecot: imap(user1 at example.com): Warning: Maildir /var/vmail/example.com/user1/: Expunged message reappeared, giving a new UID (old uid=45516, file=1387468268.Vfe02Ic1343fM845754.oldhost.sub.example.com:2,ST) 2013-12-22T09:52:51-05:00 newhost dovecot: imap(user1 at example.com): Warning: Maildir /var/vmail/example.com/user1/: Expunged message reappeared, giving a new UID (old uid=45518, file=1387468645.Vfe02Ic73e0eM530539.oldhost.sub.example.com:2,ST) The problem is, it looks like every single message that was flagged as unread is now duplicated on the new system. Also - not that this is a problem, but all of the old messages have the fqdn of the old server in the individual email file names - oldhost.sub.example.com - while the new ones only have the local hostname (newhost) Did I do something wrong? Or is this going to be an unavoidable problem if I want to use rsync to do the final migration that using dsync would avoid? Thanks, -- Best regards, */Charles /* From tss at iki.fi Sun Dec 22 17:37:01 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 22 Dec 2013 17:37:01 +0200 Subject: [Dovecot] Duplicated (but only for unread) messages after second rsync pass... In-Reply-To: <52B70199.3030501@Media-Brokers.com> References: <52B70199.3030501@Media-Brokers.com> Message-ID: <33C7BB6F-2310-4DCC-A2F6-493B74E8EE62@iki.fi> On 22.12.2013, at 17.13, Charles Marcus wrote: > Ok, I know I should probably be using dsync for this, but I'm more familiar with rsync, and didn't think this would be a problem. > > Here is what I am doing, and what is apparently happening (only done this once, but I'm guessing it will happen each time): > > rsync -avHP /mnt/vmail/example.com/user1/ /var/vmail/example.com/user1/ > > chown -R vmail:vmail /var/vmail/example.com > > Ok, so far so good, everything works fine accessing the mails (I'm using Thunderbird). > > Now I do another rsync, but this time I did the entire mailstore: > > rsync -avHP /mnt/vmail/example.com/ /var/vmail/example.com/ > > chown -R vmail:vmail /var/vmail/example.com > > Right after I started up dovecot again, I hot a bunch of these in the logs: > > 2013-12-22T09:52:51-05:00 newhost dovecot: imap(user1 at example.com): Warning: Maildir /var/vmail/example.com/user1/: Expunged message reappeared, giving a new UID (old uid=45516, file=1387468268.Vfe02Ic1343fM845754.oldhost.sub.example.com:2,ST) > 2013-12-22T09:52:51-05:00 newhost dovecot: imap(user1 at example.com): Warning: Maildir /var/vmail/example.com/user1/: Expunged message reappeared, giving a new UID (old uid=45518, file=1387468645.Vfe02Ic73e0eM530539.oldhost.sub.example.com:2,ST) > > The problem is, it looks like every single message that was flagged as unread is now duplicated on the new system. > > Also - not that this is a problem, but all of the old messages have the fqdn of the old server in the individual email file names - oldhost.sub.example.com - while the new ones only have the local hostname (newhost) The hostname doesn't matter. > Did I do something wrong? Or is this going to be an unavoidable problem if I want to use rsync to do the final migration that using dsync would avoid? Use rsync --delete to get rid of the extra mails in destination. And of course don't deliver any new mails to destination before that is done. :) From CMarcus at Media-Brokers.com Sun Dec 22 17:43:39 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 10:43:39 -0500 Subject: [Dovecot] 'unknown user' using dovecot LDA Message-ID: <52B708AB.4000809@Media-Brokers.com> Ok, one more issue to resolve. The old server was still using the postfix/virtual for delivery, but the new one is using the dovecot LDA. Now, when an email generated locally by a cron job is delivered, this shows in the log: 2013-12-22T10:29:55-05:00 host postfix/pickup[31400]: C67FD90F676B2: uid=0 from= 2013-12-22T10:29:55-05:00 host postfix/cleanup[22349]: C67FD90F676B2: message-id=<20131222152955.C67FD90F676B2 at smtp2.example.com> 2013-12-22T10:29:55-05:00 host postfix/qmgr[31401]: C67FD90F676B2: from=, size=1555, nrcpt=1 (queue active) 2013-12-22T10:29:55-05:00 host dovecot: auth-worker(22365): passwd(user1 at example.com): unknown user 2013-12-22T10:29:55-05:00 host dovecot: lda(user1 at example.com): msgid=<20131222152955.C67FD90F676B2 at smtp2.example.com>: saved mail to INBOX 2013-12-22T10:29:55-05:00 host postfix/pipe[22361]: C67FD90F676B2: to=, relay=dovecot, delay=0.06, delays=0.02/0/0/0.04, dsn=2.0.0, status=sent (delivered via dovecot service) 2013-12-22T10:29:55-05:00 host postfix/qmgr[31401]: C67FD90F676B2: removed The mail was delivered (as the log also clearly shows), but what is with the 'unknown user'? I'm not sure how I can test my maps with dovecot, but testing with postfix shows: # postmap -q user1 at example.com mysql:/etc/postfix/maps/mysql/vmm.cf example.com/user1/ Which is correct. And my dovecot-sql-conf.ext contains: driver = mysql connect = "host=localhost dbname=db_name user=dbuser password=password" default_pass_scheme = CRYPT password_query = \ SELECT username AS user, password \ FROM mailbox WHERE username = '%u' user_query = \ SELECT CONCAT('/var/vmail/', maildir) AS home \ FROM mailbox WHERE username = '%u' iterate_query = SELECT username AS user FROM mailbox I confirmed the db info is identical to what postfix is using. Oh - and in order to make sure that all usernames are lowercased, shouldn't I change '%u' above to '%Lu'? Appreciate any suggestions on where to go next... thanks -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Sun Dec 22 17:44:52 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 10:44:52 -0500 Subject: [Dovecot] Duplicated (but only for unread) messages after second rsync pass... In-Reply-To: <33C7BB6F-2310-4DCC-A2F6-493B74E8EE62@iki.fi> References: <52B70199.3030501@Media-Brokers.com> <33C7BB6F-2310-4DCC-A2F6-493B74E8EE62@iki.fi> Message-ID: <52B708F4.2040804@Media-Brokers.com> On 2013-12-22 10:37 AM, Timo Sirainen wrote: > Use rsync --delete to get rid of the extra mails in destination. I wondered if that would do it... thanks. > And of course don't deliver any new mails to destination before that is done.:) Well, at least I knew not to do that... ;) Thanks Timo. -- Best regards, */Charles/* From tom at whyscream.net Sun Dec 22 17:49:46 2013 From: tom at whyscream.net (Tom Hendrikx) Date: Sun, 22 Dec 2013 16:49:46 +0100 Subject: [Dovecot] 'unknown user' using dovecot LDA In-Reply-To: <52B708AB.4000809@Media-Brokers.com> References: <52B708AB.4000809@Media-Brokers.com> Message-ID: <52B70A1A.9020403@whyscream.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 22-12-13 16:43, Charles Marcus wrote: > Ok, one more issue to resolve. > > The old server was still using the postfix/virtual for delivery, > but the new one is using the dovecot LDA. > > Now, when an email generated locally by a cron job is delivered, > this shows in the log: > > 2013-12-22T10:29:55-05:00 host postfix/pickup[31400]: > C67FD90F676B2: uid=0 from= > 2013-12-22T10:29:55-05:00 host postfix/cleanup[22349]: > C67FD90F676B2: > message-id=<20131222152955.C67FD90F676B2 at smtp2.example.com> > 2013-12-22T10:29:55-05:00 host postfix/qmgr[31401]: C67FD90F676B2: > from=, size=1555, nrcpt=1 (queue > active) 2013-12-22T10:29:55-05:00 host dovecot: > auth-worker(22365): passwd(user1 at example.com): unknown user This is an error from the passwd authentication backend, not from the mysql one you're checking below. Seems that you have 2 auth backends enabled in dovecot... > 2013-12-22T10:29:55-05:00 host dovecot: lda(user1 at example.com): > msgid=<20131222152955.C67FD90F676B2 at smtp2.example.com>: saved mail > to INBOX 2013-12-22T10:29:55-05:00 host postfix/pipe[22361]: > C67FD90F676B2: to=, > relay=dovecot, delay=0.06, delays=0.02/0/0/0.04, dsn=2.0.0, > status=sent (delivered via dovecot service) > 2013-12-22T10:29:55-05:00 host postfix/qmgr[31401]: C67FD90F676B2: > removed > > The mail was delivered (as the log also clearly shows), but what is > with the 'unknown user'? > > I'm not sure how I can test my maps with dovecot, but testing with > postfix shows: > > # postmap -q user1 at example.com > mysql:/etc/postfix/maps/mysql/vmm.cf example.com/user1/ > > Which is correct. > > And my dovecot-sql-conf.ext contains: > > driver = mysql connect = "host=localhost dbname=db_name user=dbuser > password=password" default_pass_scheme = CRYPT password_query = \ > SELECT username AS user, password \ FROM mailbox WHERE username = > '%u' user_query = \ SELECT CONCAT('/var/vmail/', maildir) AS home > \ FROM mailbox WHERE username = '%u' iterate_query = SELECT > username AS user FROM mailbox > > I confirmed the db info is identical to what postfix is using. > > Oh - and in order to make sure that all usernames are lowercased, > shouldn't I change '%u' above to '%Lu'? > > Appreciate any suggestions on where to go next... thanks > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBCAAGBQJStwoaAAoJEJPfMZ19VO/1MkIQAK2u3lQOUI6zHGQzoO7iNjQP OAHmFyn/QnPSRGd7O+EAHSG6vvz6QBgf0qpUSym8nPu+jDaG564eZwqfQu1cIa2c uerz0ZDYk8hu4XqKHP83c/A5SsoG8QbmO0LTwr3wSSvmvOS4G1agMqpZt2r5r2pG aiAbHgQYWbp906F0absak/W4XAIJltqiIxQ1QcFhhXjovmiQTxugiCgx7RhxY5dx Li1KWzGZbl9cANQvUn8Sy7UIkYtu40qcZn150DYq3iKKT2cA18PSSPA8Rur/zigT vidhIB+h0p+qNlGKs1rUlKifX2fD9JhGa/GinotBi33PTZPsTzVzYESgBYR9/nFH ekgraAJ+xHva2K0dKartzzddHvweAub0PxXn4YZw5X4fxYyITGuWqDBsB2Pn38XW xQRjWQ2nnjNH7YHrCiwAcykU71jT6kYJwSBp1SxkWRHlk9HTDPKH0P+SRJJ03Bri 2CfkutX8GNVNXlME2G1yqDhV03XOPziEwdRUSB5t2jgZWrMYTE21zfpLLLUYhNKa JYnShmpEkRk9VpGquk1fCTMZNtTIomdcqwtfd0r0cPwXFx2KVTBJfkvwR8CCX850 QgiwlTARaLrF8VVT9ujLP2uBieoeDOIJOEAFs86BxQVmLqBkZJVn3raJikhzoHJo pxe1lAFyeF5C7zjD1i5x =rG+d -----END PGP SIGNATURE----- From h.reindl at thelounge.net Sun Dec 22 17:52:50 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 22 Dec 2013 16:52:50 +0100 Subject: [Dovecot] Duplicated (but only for unread) messages after second rsync pass... In-Reply-To: <52B708F4.2040804@Media-Brokers.com> References: <52B70199.3030501@Media-Brokers.com> <33C7BB6F-2310-4DCC-A2F6-493B74E8EE62@iki.fi> <52B708F4.2040804@Media-Brokers.com> Message-ID: <52B70AD2.2060807@thelounge.net> Am 22.12.2013 16:44, schrieb Charles Marcus: > On 2013-12-22 10:37 AM, Timo Sirainen wrote: >> Use rsync --delete to get rid of the extra mails in destination. > > I wondered if that would do it... thanks in case of a 1:1 rsync you always want the parameters below to include any sort of links, permissions and attributes [harry at srv-rhsoft:~]$ which rsync.sh /usr/local/bin/rsync.sh [harry at srv-rhsoft:~]$ cat /usr/local/bin/rsync.sh #!/bin/bash # -z compress # -t timestamps # -P progress # -r recursive # -l links # -H hard-links # -p permissions # -o owner # -g group # -E executability # -A acls # -X xtended attributes # Sicherstellen dass Source UND Target uebergeben wurden if [ "$1" == "" ] || [ "$2" == "" ] || [ "$1" == "$2" ]; then echo "USAGE: rsync.sh [bwlimit]" exit fi # Standard-Parameter RSYNC_PARAMS="--no-motd --force --delete-after --devices --specials --sparse -tPrlHpogEAX" # Wenn in einem der beiden Paramneter ein @ vorkommt Komprimierung einschalten # Ansonsten handelt es sich um zwei lokale Ordner und rsync wuerde die # Daten ohne Sinn komprimieren if [ `grep '@' <<< "$1"` ] || [ `grep '@' <<< "$2"` ]; then RSYNC_PARAMS="--compress --sockopts=SO_SNDBUF=32768,SO_RCVBUF=32768 $RSYNC_PARAMS" fi if [ "$3" != "" ]; then RSYNC_PARAMS="--bwlimit=$3 $RSYNC_PARAMS" fi # Eigentliches Kommando ausfuehren nice -n 19 rsync $RSYNC_PARAMS --rsync-path='nice -n 19 rsync' "$1" "$2" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From CMarcus at Media-Brokers.com Sun Dec 22 18:24:26 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 11:24:26 -0500 Subject: [Dovecot] 'unknown user' using dovecot LDA In-Reply-To: <52B70A1A.9020403@whyscream.net> References: <52B708AB.4000809@Media-Brokers.com> <52B70A1A.9020403@whyscream.net> Message-ID: <52B7123A.6010507@Media-Brokers.com> On 2013-12-22 10:49 AM, Tom Hendrikx wrote: > On 22-12-13 16:43, Charles Marcus wrote: >> 2013-12-22T10:29:55-05:00 host postfix/pickup[31400]: >> C67FD90F676B2: uid=0 from= >> 2013-12-22T10:29:55-05:00 host postfix/cleanup[22349]: >> C67FD90F676B2: >> message-id=<20131222152955.C67FD90F676B2 at smtp2.example.com> >> 2013-12-22T10:29:55-05:00 host postfix/qmgr[31401]: C67FD90F676B2: >> from=, size=1555, nrcpt=1 (queue >> active) 2013-12-22T10:29:55-05:00 host dovecot: >> auth-worker(22365): passwd(user1 at example.com): unknown user > This is an error from the passwd authentication backend, not from the > mysql one you're checking below. Seems that you have 2 auth backends > enabled in dovecot... Ah, right you are, thanks! Missed that (it was staring me in the face) - doveconf -n shows: userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } One thing about dovecots config I've learned during this process... it is confusing sometimes to determine where any given setting is coming from, given the number of different default config files.. Grepping of course will help you find it, but it would be nice if there was some way to simplify this... Maybe cut down on the number of different config files (ie, combine all of the different auth-* files into one)? Or maybe a verbose flag you could pass to doveconf -n - ie, 'doveconf -nv' - that would sort the output based on the config file that each group of settings came from, with a comment above each group of settings, ie: doveconf -nv ... # from /etc/dovecot/conf.d/auth-system.conf.ext userdb { driver = passwd } # from /etc/dovecot/conf.d/auth-sql.conf.ext userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } But, like I said, it isn't all that difficult to find them so not a huge deal. Anyway, problem solved - thanks again Tom... -- Best regards, */Charles/* From h.reindl at thelounge.net Sun Dec 22 18:29:42 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 22 Dec 2013 17:29:42 +0100 Subject: [Dovecot] 'unknown user' using dovecot LDA In-Reply-To: <52B7123A.6010507@Media-Brokers.com> References: <52B708AB.4000809@Media-Brokers.com> <52B70A1A.9020403@whyscream.net> <52B7123A.6010507@Media-Brokers.com> Message-ID: <52B71376.7050109@thelounge.net> Am 22.12.2013 17:24, schrieb Charles Marcus: > One thing about dovecots config I've learned during this process... it is confusing sometimes to determine where > any given setting is coming from, given the number of different default config files.. > > Grepping of course will help you find it, but it would be nice if there was some way to simplify this... > > Maybe cut down on the number of different config files you are free to use only one config file as below and a second one "/etc/dovecot/sql.conf" referred there contains the sensible autentication configuration hence my RPM-SPEC does not include a single config file [root at testserver:~]$ cat /etc/dovecot/dovecot.conf # provided services protocols = imap pop3 # configure ssl ssl = yes ssl_cert = From CMarcus at Media-Brokers.com Sun Dec 22 19:28:08 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 12:28:08 -0500 Subject: [Dovecot] 'unknown user' using dovecot LDA In-Reply-To: <52B71376.7050109@thelounge.net> References: <52B708AB.4000809@Media-Brokers.com> <52B70A1A.9020403@whyscream.net> <52B7123A.6010507@Media-Brokers.com> <52B71376.7050109@thelounge.net> Message-ID: <52B72128.9030706@Media-Brokers.com> On 2013-12-22 11:29 AM, Reindl Harald wrote: > Am 22.12.2013 17:24, schrieb Charles Marcus: >> One thing about dovecots config I've learned during this process... it is confusing sometimes to determine where >> any given setting is coming from, given the number of different default config files.. >> >> Grepping of course will help you find it, but it would be nice if there was some way to simplify this... >> >> Maybe cut down on the number of different config files > you are free to use only one config file as below and > a second one "/etc/dovecot/sql.conf" referred there > contains the sensible autentication configuration I know this, and indeed I do this myself. I wasn't talking about your RPM-SPEC file, I was talking about the numerous dovecot config files that are installed in a new default installation. It is very confusing for people new to dovecot (I didn't have any major problems, because I'm not new, but installing it fresh gave me a new perspective). -- Best regards, */Charles/* From wdehoog at exalondelft.nl Sun Dec 22 19:58:25 2013 From: wdehoog at exalondelft.nl (W. de Hoog) Date: Sun, 22 Dec 2013 18:58:25 +0100 Subject: [Dovecot] search gives variable/different results In-Reply-To: <52AC78EA.2070404@exalondelft.nl> References: <52AC78EA.2070404@exalondelft.nl> Message-ID: <52B72841.4080800@exalondelft.nl> Hi, Still having search troubles. I expect to get 9 results in two mailboxes, 3 in the first one and six in de second one. Total mailboxes in shared/ is around 1100. doveadm search mailbox "shared/Products/VIP*" TO stromvers -> all expected results doveadm search mailbox "shared/Products/VIP/*" TO stromvers -> first 3 ok, from last box only the last 3. doveadm search mailbox "shared/Products*" TO stromvers -> sometimes last 2 from 1st mailbox, last 4 from 2nd mailbox sometimes no results at all doveadm search mailbox "shared/Products/*" TO stromvers -> some results from 2nd mailbox Is the search syntax O use wrong? I added some printf statements to see what is going on. It seems to walk all mailboxes. Unfortunately I don't know how to have doveadm use the lib21_fts_squat_plugin.so I build. It always loads the one from /usr/libs. > $ dovecot -n > # 2.2.9 (5c170e0786f3): /etc/dovecot/dovecot.conf > # OS: Linux 3.12.0-031200-generic x86_64 Ubuntu 13.10 > auth_verbose = yes > disable_plaintext_auth = no > log_path = /var/log/dovecot.log > mail_debug = yes > mail_plugins = fts fts_squat > mail_privileged_group = mail > namespace { > hidden = yes > inbox = yes > list = no > location = mbox:~/mail:INBOX=/var/mail/%u > prefix = "#mbox/" > separator = / > } > namespace { > list = yes > location = sdbox:/home/imapshared-sdbox > prefix = shared/ > separator = / > subscriptions = no > type = public > } > namespace inbox { > location = sdbox:~/sdboxmail > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > separator = / > } > passdb { > driver = pam > } > plugin { > fts = squat > fts_autoindex = yes > fts_squat = partial=4 full=10 > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = " imap" > ssl_cert = ssl_key = userdb { > driver = passwd > } > verbose_ssl = yes > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags > } > -- Willem-Jan de Hoog From minfrin at sharp.fm Sun Dec 22 21:54:19 2013 From: minfrin at sharp.fm (Graham Leggett) Date: Sun, 22 Dec 2013 21:54:19 +0200 Subject: [Dovecot] Dovecot proxying with LDAP - an example? Message-ID: <5CFD7D5D-D00D-4C9A-9937-0D65F46A80B0@sharp.fm> Hi all, I have been struggling trying to understand the syntax to configure dovecot as a proxy against an LDAP server. As a single server dovecot works great. Now I want to add the "mailHost" attribute which, if present, should indicate the DNS name of the host that contains the person's mailbox. If the mailHost matches the local hostname, the mailbox should be served locally as it already does now. If the mailHost is not the local hostname, dovecot should proxy the request to the given server using SSL on port 993. The docs at http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy suggest that proxy_always is what I am looking for, but I cannot find any worked examples of how this might work. Has anyone attempted this before? What I have so far is this, but no proxying seems to take place: pass_attrs = mail=user,userPassword=password,\ mailMessageStore=userdb_mail,=proxy_always=y,mailHost=host,=ssl=yes Can anyone confirm? I am using dovecot v2.0.9 as provided out the box by RHEL6. Regards, Graham -- From CMarcus at Media-Brokers.com Sun Dec 22 22:08:48 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 22 Dec 2013 15:08:48 -0500 Subject: [Dovecot] Duplicated (but only for unread) messages after second rsync pass... In-Reply-To: <33C7BB6F-2310-4DCC-A2F6-493B74E8EE62@iki.fi> References: <52B70199.3030501@Media-Brokers.com> <33C7BB6F-2310-4DCC-A2F6-493B74E8EE62@iki.fi> Message-ID: <52B746D0.5020703@Media-Brokers.com> On 2013-12-22 10:37 AM, Timo Sirainen wrote: > Use rsync --delete to get rid of the extra mails in destination. And of course don't deliver any new mails to destination before that is done. :) Thanks Timo - but I'm curious why this only affected UNREAD messages? Even ones that were not new since the first rsync (some were over a month old, but still marked as unread, and those were duplicated too). -- Best regards, */Charles/* From mnewpipe at gmail.com Sun Dec 22 23:07:13 2013 From: mnewpipe at gmail.com (Michael Neurohr) Date: Sun, 22 Dec 2013 22:07:13 +0100 Subject: [Dovecot] TLS SNI with Dovecot Message-ID: <52B75481.10007@gmail.com> Hi! I've been using Dovecot for one single Domain with SSL certificates. Now I would like to use Dovecot with several Domains and proper SSL certificates. I tried to setup TLS SNI but it does not work. What I basically did was just adding local_name imap.samsoft.at { ssl_cert = , rip=151.236.5.22, lip=151.38.7.25, TLS handshaking: SSL_accept() failed: error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate: SSL alert number 42, session= =================================================================== The actual Dovecot config is pasted below. How can I solve that and server different certificates on the same IP Address? Thanks, Michael doveconf -n # 2.2.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab076.8 i686 CentOS release 6.5 (Final) simfs auth_mechanisms = plain login mail_location = maildir:/var/mail/vhosts/%d/%n mail_plugins = notify mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_backend = dspam antispam_dspam_args = --source=error;--signature=%%s;--user;%u antispam_dspam_binary = /usr/bin/dspam antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items;Deleted Messages sieve = /var/mail/vhosts/sieve-scripts/%d/%n/.dovecot.sieve sieve_before = /var/mail/vhosts/sieve-scripts/before sieve_dir = /var/mail/vhosts/sieve-scripts/%d/%n/sieve sieve_extensions = +imapflags } postmaster_address = postmaster at changed.at protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = required ssl_ca = References: <52B75481.10007@gmail.com> Message-ID: <52B758EF.8090700@thelounge.net> Am 22.12.2013 22:07, schrieb Michael Neurohr: > I've been using Dovecot for one single Domain with SSL certificates. > Now I would like to use Dovecot with several Domains and proper SSL > certificates. I tried to setup TLS SNI but it does not work. What I > basically did was just adding forget it - SNI is relevant for webservers because different vhosts with different contents, typically not for mailservers why do you start the burden of different certs instead "mail.your-company.tld" and give that hostname to any user? ______________ there are good reasons that other hosters are doing the same http://www.df.eu/at/service/df-faq/e-mail/pop3-imap-postfaecher/mail-programme/ unencrypted: imap.your-domain.tld encrypted: sslmailpool.ispgateway.de while the unencrpyted from is also stupid from maintaince point of view we did that for some years and it did not work out in any sense -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From gedalya at gedalya.net Mon Dec 23 00:09:15 2013 From: gedalya at gedalya.net (Gedalya) Date: Sun, 22 Dec 2013 17:09:15 -0500 Subject: [Dovecot] TLS SNI with Dovecot In-Reply-To: <52B758EF.8090700@thelounge.net> References: <52B75481.10007@gmail.com> <52B758EF.8090700@thelounge.net> Message-ID: <52B7630B.1030309@gedalya.net> On 12/22/2013 04:26 PM, Reindl Harald wrote: > forget it - SNI is relevant for webservers because different > vhosts with different contents, typically not for mailservers > > why do you start the burden of different certs instead > "mail.your-company.tld" and give that hostname to any user? > While it's true that there is no strictly technical benefit to SNI in IMAP, it can perhaps have benefits in terms of presentability. Hosted domain customers might want to be able to use their own certificates issued to them rather than using Subject Alternate Names etc, for purely cosmetic reasons. From h.reindl at thelounge.net Mon Dec 23 00:15:12 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 22 Dec 2013 23:15:12 +0100 Subject: [Dovecot] TLS SNI with Dovecot In-Reply-To: <52B7630B.1030309@gedalya.net> References: <52B75481.10007@gmail.com> <52B758EF.8090700@thelounge.net> <52B7630B.1030309@gedalya.net> Message-ID: <52B76470.3040907@thelounge.net> Am 22.12.2013 23:09, schrieb Gedalya: > On 12/22/2013 04:26 PM, Reindl Harald wrote: >> forget it - SNI is relevant for webservers because different >> vhosts with different contents, typically not for mailservers >> >> why do you start the burden of different certs instead >> "mail.your-company.tld" and give that hostname to any user? >> > While it's true that there is no strictly technical benefit to SNI in IMAP, it can perhaps have benefits in terms > of presentability. > Hosted domain customers might want to be able to use their own certificates issued to them rather than using > Subject Alternate Names etc, for purely cosmetic reasons. hopefully they pay for that "cosmetic reasons" or leave technical things to techs keep in mind that you need a certificate with each used domain as SAN (subject alternative name) which means each time you host a new domain you need to change the certificate - Thawte calculates 169,- per jear and SAN - have fun :-) then there are mail-clients - which of them do not support SNI, or in case of mail clients which of them do support it properly and how is the presentability in case of certificate warnings for the one which does not 169,- for cosmetic reasons - well, i would prefer a chiropody instead..... -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From sca at andreasschulze.de Mon Dec 23 00:46:40 2013 From: sca at andreasschulze.de (Andreas Schulze) Date: Sun, 22 Dec 2013 23:46:40 +0100 Subject: [Dovecot] move mailbox to LAYOUT=fs Message-ID: <20131222224640.GA28227@solar.andreasschulze.de> Hello, I think about migrating small servers storage to LAYOUT=fs (http://wiki2.dovecot.org/MailLocation/Maildir#Directory_layout) Is there a smooth way to adjust the existing folders? Andreas From boyd.yang at gmail.com Mon Dec 23 04:26:07 2013 From: boyd.yang at gmail.com (boyd yang) Date: Mon, 23 Dec 2013 10:26:07 +0800 Subject: [Dovecot] auth: Error: net_accept() failed: Too many open files Message-ID: Hi All, I got below errors when I do some 2000 users concurrency test against dovecot 2.1.7. Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files Dec 23 10:18:52 auth: Error: net_accept() failed: Too many open files I seems the auth process become the bottleneck as there is only one auth process. service auth-worker { process_limit = 1000 } service imap-login { process_min_avail = 48 service_count = 0 } service imap { process_limit = 10240 process_min_avail = 8 } I find that the auth process does not open too many files with lsof, and my limit is very big(1000000). How to fix this? Thanks! From andreas.schulze at datev.de Mon Dec 23 09:13:01 2013 From: andreas.schulze at datev.de (Andreas Schulze) Date: Mon, 23 Dec 2013 08:13:01 +0100 Subject: [Dovecot] Horde + dovecot metadata support In-Reply-To: <20131219102309.GA29049@spider.services.datevnet.de> References: <20131219102309.GA29049@spider.services.datevnet.de> Message-ID: <20131223071301.GE28060@spider.services.datevnet.de> Am 19.12.2013 11:23 schrieb Andreas Schulze: > Horde (http://horde.org) has the ability to store its preferences direct into a users imap mailbox > using imap metadata extension. There are two implementations of the imap extension. > 1. a dovecot plugin: http://hg.dovecot.org/dovecot-metadata-plugin > 2. dovecot itself: http://www.dovecot.org/list/dovecot/2013-November/093243.html > Hello, thanks to Timo to fix the issue in Version dovecot-2.2.10. With minimal configuration? Horde-5.1.5 can now store its preferences in an IMAP folder. ? in dovecot.conf: imap_metadata = yes mail_attribute_dict = file:Maildir/dovecot-metadata -- Andreas Schulze Internetdienste | P252 DATEV eG 90329 N?rnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 N?rnberg, Paumgartnerstr. 6-14 | Registergericht N?rnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Dipl.-Kfm. Dr. Robert Mayr J?rg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen From amateo at um.es Mon Dec 23 09:41:21 2013 From: amateo at um.es (Angel Luis Mateo Martinez) Date: Mon, 23 Dec 2013 07:41:21 +0000 Subject: [Dovecot] [dovecot-2.2.5] Duplicates in mdbox In-Reply-To: <40620a77.70b4c4b4.52b44bd2.c99f9@tlen.pl> References: <40620a77.70b4c4b4.52b44bd2.c99f9@tlen.pl> Message-ID: <20131223074121.Horde.SaN2uBJ2l9JYa3zIVnBFeQ1@webmail.um.es> Hi, radek escribi?: > Hi > > I have strange situation with one of mailboxes in mdbox format. Some > messages are duplicated, not all. I am sure that is not sieve or > another mail client issue, because access is via roundcube without > sieve plugin. > In maillog I have not found any suspicious information about this > problem and i can see that from postfix do dovecot-lda was piped > only one copy of message. > I have a similar problem, but not the same (if this could give you a clue). In my case I think that is fault of the email client (thunderbird). I have some users with a lot of emails in some folders. These emails are received from web applications that send a lot of of them. In my case, the user receives them in his inbox folder and with a filter in his client they are moved to another folder. This is where I think that duplication are done (since one user move the filter from his client to a sieve script in the server, there are no more duplications ) -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337 From wuweiwwd at sina.com Mon Dec 23 13:30:51 2013 From: wuweiwwd at sina.com (wuwei) Date: Mon, 23 Dec 2013 03:30:51 -0800 (PST) Subject: [Dovecot] [help]how to config the dovecot authentication by the other servers Message-ID: <1387798251357-46078.post@n4.nabble.com> hi i am the postfix+dovecot.for example,there are three servers: server 1 for postfix server 2 for dovecot server 3 for auth server how could i let the dovecot(2.29) authenticated by the other servers? i config the postfix auth-type to dovecot.how could i config the dovecot authenticated by the server 3 with tcp/ip socket?or is there are any samples?i have found in http://wiki2.dovecot.org/. *at first i try to use memcached ,these are the configure:* *./dovecot-dict-auth.conf.ext* uri = memcached:host=172.24.140.252:port=12000 password_key = dovecot/passdb/%u user_key = dovecot/userdb/%u value_format = json iterate_disable = yes default_pass_scheme = plain * ./10-auth.conf* auth_mechanisms = plain login !include auth-dict.conf.ext *./auth-dict.conf.ext* passdb { driver = dict args = /usr/local/dovecot/etc/dovecot/dovecot-dict-auth.conf.ext } userdb { driver = prefetch #args = /etc/dovecot/dovecot-dict-auth.conf.ext } *in memcached i put some data in?* set dovecot/passdb/test at test.com 0 0 103 {'uid':'123','gid':'123','home':'/home/username','username':'test at test.com','password':'test at test.com'} STORED set dovecot/passdb/test 0 0 103 {'uid':'123','gid':'123','home':'/home/username','username':'test at test.com','password':'test at test.com'} STORED set test 0 0 103 {'uid':'123','gid':'123','home':'/home/username','username':'test at test.com','password':'test at test.com'} STORED set test at test.com 0 0 103 {'uid':'123','gid':'123','home':'/home/username','username':'test at test.com','password':'test at test.com'} STORED i reload dovecot and postfix.postfix connect to dovect is ok!i open the debug log .the memcached tell that it has received a connection.and the dovecot also said has connect to the memcached ,but after 30s,the connect to the memcached auto broken by out of time.here some logs: * dovcot logs:* Dec 23 16:45:57 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Dec 23 16:45:57 auth: Debug: Read auth token secret from /usr/local/dovecot/var/run/dovecot/auth-token-secret.dat Dec 23 16:45:57 auth: Debug: auth client connected (pid=0) Dec 23 16:46:08 auth: Debug: client in: AUTH 1 login service=smtp nologin lip=172.24.140.228 rip=192.168.3.29 Dec 23 16:46:08 auth: Debug: client passdb out: CONT 1 VXNlcm5hbWU6 Dec 23 16:46:22 auth: Debug: client in: CONT 1 OTY1ZWI3MmM5MmE1NDlkZA== (previous base64 data may contain sensitive data) Dec 23 16:46:22 auth: Debug: client passdb out: CONT 1 UGFzc3dvcmQ6 Dec 23 16:46:39 auth: Debug: client in: CONT 1 OTY1ZWI3MmM5MmE1NDlkZA== (previous base64 data may contain sensitive data) Dec 23 16:46:39 auth-worker(27884): Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Dec 23 16:46:39 auth-worker(27884): Debug: dict(965eb72c92a549dd,192.168.3.29): lookup shared/dovecot/passdb/965eb72c92a549dd Dec 23 16:47:11 auth: Debug: client passdb out: FAIL 1 user=965eb72c92a549dd temp Dec 23 16:47:09 debian228 dovecot: auth-worker(27884): Error: memcached: Lookup timed out in 30.000 secs Dec 23 16:47:09 debian228 dovecot: auth-worker(27884): Error: dict(965eb72c92a549dd,192.168.3.29): Lookup failed i don't know why it happened.and why it look up key with prefix "shared/".until now i found that the key is password "965eb72c92a549dd"(password is the same as username before).what will happened if there two people with the same password.it seams that i should use the userdb! is someone could give me a sample?what could i do if there has two or more memcached servers?so ,i think of that if there has some config to connect to the tcp socket server.and the server implement by java or any other language by the developer itself. thank you for you help! -- View this message in context: http://dovecot.2317879.n4.nabble.com/help-how-to-config-the-dovecot-authentication-by-the-other-servers-tp46078.html Sent from the Dovecot mailing list archive at Nabble.com. From wdehoog at exalondelft.nl Mon Dec 23 13:41:36 2013 From: wdehoog at exalondelft.nl (W. de Hoog) Date: Mon, 23 Dec 2013 12:41:36 +0100 Subject: [Dovecot] search gives variable/different results In-Reply-To: <52B72841.4080800@exalondelft.nl> References: <52AC78EA.2070404@exalondelft.nl> <52B72841.4080800@exalondelft.nl> Message-ID: <52B82170.6000603@exalondelft.nl> Switched from fts-squat to fts-solr and searching works much better. -- Willem-Jan de Hoog From martijn.list at gmail.com Mon Dec 23 17:07:44 2013 From: martijn.list at gmail.com (martijn.list) Date: Mon, 23 Dec 2013 16:07:44 +0100 Subject: [Dovecot] Is the users password available from a mail_filter? Message-ID: <52B851C0.8070902@gmail.com> Hi, I'm working on a Dovecot encryption module which uses the mail filter plugin to encrypt/decrypt the message "on the fly". I was wondering whether it is possible to access the password (or a hashed password) of the user. It seems that only the user (using the %u parameter) is available to the mail_filter plugin. Any idea how to get hold of the (possibly hashed) password? Kind regards, Martijn Brinkers From anant.saraswat at techblue.co.uk Mon Dec 23 17:39:12 2013 From: anant.saraswat at techblue.co.uk (Anant) Date: Mon, 23 Dec 2013 21:09:12 +0530 Subject: [Dovecot] Sieve Addon in thunderbird is not showing Vacation in action list Message-ID: <52B85920.8060903@techblue.co.uk> Hello guys, I am using "dovecot-2.2-pigeonhole-0.4.2" ( Sieve Support for Dovecot ) , Now I can set Vacation mail using Roundcube and it is working fine. now i want to set Vacation/outofoffice mail from thunderbird 24.0 , I have installed pluginsieve-0.2.3d.xpi for thunderbird from "https://github.com/thsmi/sieve/tree/master/nightly" But I am not able to set vacation as it is not giving me an option with reply option. *Even if i will create a vacation mail in Roundcube , my thunderbird plugin was unable to understand that filter. getting an error / //Error while parsing script.// // } expected but found: vacation :subject "not available" "not here"; } .../ and my source code for sieve filter is look like ///require ["vacation"];// //# rule:[vacation]// //if true// //{// // vacation :subject "not available" "not here";// //}/ *I am only able to Enable one filter at a time in thunderbird. And I am not sure it is the right place to post that stuff.. So please guide me as well if I am wrong. Regards, Anant Saraswat From michael at bigmichi1.de Mon Dec 23 17:48:13 2013 From: michael at bigmichi1.de (Michael Cramer) Date: Mon, 23 Dec 2013 16:48:13 +0100 Subject: [Dovecot] v2.2.10 released In-Reply-To: <290D21FB-FD16-43E9-992A-C2CBD077C53C@iki.fi> References: <290D21FB-FD16-43E9-992A-C2CBD077C53C@iki.fi> Message-ID: <20131223164813.Horde.zMxpTPoZGlRIHyPTsB3FdA1@horde.bigmichi1.de> Zitat von Timo Sirainen : > http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz.sig > > I've been really busy the last few months, as I guess people in > Dovecot mailing list have seen since I haven't been very responsive. > There are at least some dsync bugs I haven't had time to look into > yet. The busyness probably continues for a while more, but the next > year is looking much better for me and for Dovecot in general. We're > planning to hire a few more Dovecot coders at some point, so if > you're interested send me an email. :) > > + auth: passdb/userdb dict rewrite to support much more complex > setups. See doc/example-config/dovecot-dict-auth.conf.ext. > The old settings will continue to work. > + auth: Added userdb result_success/failure/tempfail and skip > settings, similar to passdb's. See > http://wiki2.dovecot.org/UserDatabase > + imap: Implemented SETQUOTA command for admin user when quota_set is > configured. See http://master.wiki2.dovecot.org/Quota/Configuration > + quota: Support "*" and "?" wildcards in mailbox names in > quota_rules > + mysql: Added ssl_verify_server_cert=no|yes parameter. This > currently > defaults to "no" to make sure nothing breaks, but likely > will become > "yes" in Dovecot v2.3. > + ldap: Added blocking=yes setting to use auth worker processes for > ldap lookups. This is a workaround for now to be able to > use multiple > simultaneous LDAP connections. > + pop3c+dsync performance improvements > - quota-status: quota_grace was ignored > - ldap: Fixed memory leak with auth_bind=yes and without > auth_bind_userdn. > - imap: Don't send HIGHESTMODSEQ anymore on SELECT/EXAMINE when > CONDSTORE/QRESYNC has never before been enabled for the mailbox. > - imap: Fixes to handling mailboxes without permanent modseqs. > (When [NOMODSEQ] is returned by SELECT, mainly with in-memory > indexes.) > - imap: Various fixes to METADATA support. > - stats plugin: Processes that only temporarily dropped privileges > (e.g. indexer-worker) may have been logging errors about not being > able to open /proc/self/io. thanks for the new release timo, i updated my ubuntu ppa (https://launchpad.net/~bigmichi1/+archive/dovecot) for 12.04, 12.10, 13.04 and 13.10 if somebody needs the prebuild packages From michael at bigmichi1.de Mon Dec 23 18:40:03 2013 From: michael at bigmichi1.de (Michael Cramer) Date: Mon, 23 Dec 2013 17:40:03 +0100 Subject: [Dovecot] panic with 2.2.10 and GETMETADATA Message-ID: <20131223174003.Horde.WM_BZlgIhPZU5WlyudM6BQ1@horde.bigmichi1.de> i have in my configs the following lines: 10-mail.conf:mail_attribute_dict = file:/srv/vmail/dovecot/metadata/%d/%n/attributes 20-imap.conf:imap_metadata = yes when i test GETMETADATA with telnet i got a pannic in my error.log file and no attributes file in the given location is created root at i920:/etc/dovecot/conf.d# telnet localhost imap Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 01 LOGIN tester at domain.com ********* 01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIA L CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY NOTIFY METADATA COMPRESS=DEFLATE QUOTA ACL RIGHTS=texk] Logged in 02 GETMETADATA "*" (/shared/test) Connection closed by foreign host. in error.log i have these lines: Dec 23 17:20:00 imap(tester at domain.com): Panic: file imap-client.c: line 634 (client_command_free): assertion failed: (client->output_cmd_lock == NULL) Dec 23 17:20:00 imap(tester at domain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e900) [0x7fb053bea900] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e9de) [0x7fb053bea9de] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb053ba5bfe] -> dovecot/imap() [0x415c17] -> dovecot/imap() [0x415d8a] -> dovecot/imap() [0x415e15] -> dovecot/imap(client_handle_input+0x115) [0x416115] -> dovecot/imap(client_input+0x72) [0x4164a2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fb053bfa8f7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fb053bfb687] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb053bfa498] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb053baadf3] -> dovecot/imap(main+0x2af) [0x40b06f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fb0537e5de5] -> dovecot/imap() [0x40b1cc] gdb with bt full gives: #0 0x00007f174b6bdf77 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f174b6c15e8 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f174baad8f6 in default_fatal_finish (type=, status=status at entry=0) at failures.c:193 backtrace = 0x1801040 "/usr/lib/dovecot/libdovecot.so.0(+0x5e900) [0x7f174baad900] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e9de) [0x7f174baad9de] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f174ba68bfe] -> dovecot/im"... #3 0x00007f174baad9de in i_internal_fatal_handler (ctx=0x7fffe2002eb0, format=, args=) at failures.c:657 status = 0 #4 0x00007f174ba68bfe in i_panic (format=format at entry=0x423040 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffe2002fa0, reg_save_area = 0x7fffe2002ee0}} #5 0x0000000000415c17 in client_command_free (_cmd=_cmd at entry=0x7fffe2002fc8) at imap-client.c:634 cmd = 0x183a2d0 client = 0x18396f0 state = CLIENT_COMMAND_STATE_WAIT_INPUT __FUNCTION__ = "client_command_free" #6 0x0000000000415d8a in client_command_input (cmd=0x0) at imap-client.c:783 client = 0x18396f0 command = __FUNCTION__ = "client_command_input" #7 0x0000000000415e15 in client_command_input (cmd=0x183a2d0) at imap-client.c:841 client = 0x18396f0 command = __FUNCTION__ = "client_command_input" #8 0x0000000000416115 in client_handle_next_command (remove_io_r=, client=0x18396f0) at imap-client.c:879 No locals. #9 client_handle_input (client=client at entry=0x18396f0) at imap-client.c:891 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #10 0x00000000004164a2 in client_input (client=0x18396f0) at imap-client.c:933 cmd = 0x181db70 output = 0x183a120 bytes = 35 __FUNCTION__ = "client_input" #11 0x00007f174babd8f7 in io_loop_call_io (io=0x183a1f0) at ioloop.c:388 ioloop = 0x1808730 t_id = 2 #12 0x00007f174babe687 in io_loop_handler_run (ioloop=ioloop at entry=0x1808730) at ioloop-epoll.c:220 ctx = 0x18093c0 list = 0x180adf0 io = tv = {tv_sec = 1799, tv_usec = 999100} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run" #13 0x00007f174babd498 in io_loop_run (ioloop=0x1808730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #14 0x00007f174ba6ddf3 in master_service_run (service=0x18085c0, callback=callback at entry=0x41eea0 ) at master-service.c:566 No locals. #15 0x000000000040b06f in main (argc=1, argv=0x1808390) at main.c:400 set_roots = {0x426d00 , 0x0} login_set = {auth_socket_path = 0x1800048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41f250 , failure_callback = 0x41ef80 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 c = From sca at andreasschulze.de Mon Dec 23 23:44:51 2013 From: sca at andreasschulze.de (Andreas Schulze) Date: Mon, 23 Dec 2013 22:44:51 +0100 Subject: [Dovecot] panic with 2.2.10 and GETMETADATA In-Reply-To: <20131223174003.Horde.WM_BZlgIhPZU5WlyudM6BQ1@horde.bigmichi1.de> References: <20131223174003.Horde.WM_BZlgIhPZU5WlyudM6BQ1@horde.bigmichi1.de> Message-ID: <20131223214451.GA5549@solar.andreasschulze.de> Am 23.12.2013 17:40 schrieb Michael Cramer: > 10-mail.conf:mail_attribute_dict = > file:/srv/vmail/dovecot/metadata/%d/%n/attributes > 20-imap.conf:imap_metadata = yes nothing more here but no no segfault. I had also strange problems while using horde. They went away after I cleaned *all* files refrerenced by mail_attribute_dict and the "metadata Mailbox" created by horde. > #0 0x00007f174b6bdf77 in raise () from /lib/x86_64-linux-gnu/libc.so.6 Oh, 32bit OS here. Andreas From hardyjm at potsdam.edu Tue Dec 24 00:59:44 2013 From: hardyjm at potsdam.edu (Jeff Hardy) Date: 23 Dec 2013 17:59:44 -0500 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? In-Reply-To: <9A8179E7-D671-49C7-8A19-CB5DEC169A40@iki.fi> References: <52B5B873.8070504@Media-Brokers.com> <52B5CBF3.4010409@Media-Brokers.com> <9A8179E7-D671-49C7-8A19-CB5DEC169A40@iki.fi> Message-ID: <52B8C060.2000908@potsdam.edu> On 12/21/2013 4:57 PM, Timo Sirainen wrote: > On 21.12.2013, at 19.12, Charles Marcus wrote: > >>> I don't think it can be done easily with just a single config. Whatever you do to new users might break existing setups. So the only good way I think would be to use two different IPs. One for the new setups, one for the old. For example imap.domain.com -> mail.domain.com or vice versa. >> >> Actually, that's a good idea... thanks! :) >> >> Then I guess I proxy the old users to the old server until I get them all converted? Now I'm off to read about how to implement that... > > You can use a single Dovecot, just use something like: > > namespace inbox { > prefix = > } > > local 1.2.3.4 { > namespace inbox { > prefix = INBOX. > } > } > > Where 1.2.3.4 would be the IP for the old configuration. > We migrated from Courier-IMAP to Dovecot 1.1(?) many years ago, and used the alternative mentioned in the wiki with few problems. This is what our Dovecot 1.2 config looked like: namespace private { separator = . prefix = inbox = yes } namespace private { separator = . prefix = INBOX. inbox = no hidden = yes list = no # for v1.1+ } For our current Dovecot 2.0.9, it changed only slightly: namespace { separator = . prefix = inbox = yes } namespace { separator = . prefix = INBOX. inbox = no hidden = yes list = no alias_for = } Note that what I have is different than what is currently in the wiki, and it has been awhile since I was hip-deep in this, so apologies if it is not current recommended practice (or wrong). What I can say is that most/all of our Courier users had set "INBOX." as their namespace folder prefix (depends what the client calls it), with the intention of shifting their subfolders out from underneath Inbox in their clients. With the change, they still worked, and new unconfigured clients work, side-by-side. At this point we probably have no clients with any special configuration in this regard (which is why I won't discard the possibility that this is now wrong and not even doing what was originally intended). The only namespace-related problem I can even think of over the years is what we call "nested inbox hell," example: .INBOX.INBOX.INBOX.INBOX.INBOX.INBOX.Sent .INBOX.INBOX.INBOX.INBOX.INBOX.Sent .INBOX.INBOX.INBOX.INBOX.Sent .INBOX.INBOX.INBOX.Sent .INBOX.INBOX.Sent .INBOX.Sent This seems limited to Apple mail clients, is not global, and I have no idea if it is even related, but thought it worth mentioning. We scripted the cleanup/merge, and nail it if it appears. Rare. Cheers. -Jeff From voytek at sbt.net.au Tue Dec 24 01:22:39 2013 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Tue, 24 Dec 2013 10:22:39 +1100 Subject: [Dovecot] Eliminate legacy INBOX namespace - how? In-Reply-To: <52B8C060.2000908@potsdam.edu> References: <52B5B873.8070504@Media-Brokers.com> <52B5CBF3.4010409@Media-Brokers.com> <9A8179E7-D671-49C7-8A19-CB5DEC169A40@iki.fi> <52B8C060.2000908@potsdam.edu> Message-ID: > What I can say is that most/all of our Courier users had set "INBOX." as > their namespace folder prefix (depends what the client calls it), with the .. just reading from sidelines, looking at my own inbox (formerly CourierIMAP> D1 > D2) I see some of 'legacy' dir tree folders as so: ... drwx------ 5 vmail vmail 4096 Dec 24 07:09 .Drafts drwx------ 5 vmail vmail 4096 Nov 25 23:27 .ebay drwx------ 5 vmail vmail 4096 Nov 25 23:24 .INBOX.Drafts drwx------ 5 vmail vmail 4096 Nov 25 23:25 .INBOX.Sent drwx------ 5 vmail vmail 4096 Nov 25 23:27 .INBOX.Sent.2008.01 drwx------ 5 vmail vmail 4096 Nov 25 23:27 .INBOX.Sent.2008.02 ... it all seems to work, BUT, to keep me happy, can I just rename from the shell respective folders to get rid of INBOX where is exists...? or it that a bad idea..? # cd /etc/dovecot # grep INBOX * dovecot.conf: autocreate = INBOX dovecot.conf: autosubscribe = INBOX # grep inbox * dovecot.conf: inbox = yes From p.heinlein at heinlein-support.de Tue Dec 24 12:25:56 2013 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Tue, 24 Dec 2013 11:25:56 +0100 Subject: [Dovecot] Patch for Dovecot's quota policy daemon Message-ID: <52B96134.9090903@heinlein-support.de> Hi Timo, we wrote a simple Patch for the Dovecot quota policy daemon. If a user is over quota, I prefer blocking the user sending e-mails, so I need a policy daemon, that's able to use the envelope or sasl sender as lookup key. I'd be happy if that patch can become part of the normale Dovecot releases. Peer -------- Original-Nachricht -------- Betreff: Re: Fwd: Quota-Patch Datum: Wed, 11 Dec 2013 17:33:45 +0100 Von: Stephan Seitz Organisation: Heinlein Support GmbH An: Peer Heinlein Parameter r Code ENUM QUOTA_MATCH_RECIPIENT Stringmatch recipient= ${recipient} This macro expands to the complete recipient address. A command-line argument that contains ${recipient} expands to as many command-line arguments as there are recipients. This information is modified by the hqu flags for quoting and case folding. Parameter S Code ENUM QUOTA_MATCH_SASLSENDER Stringmatch sasl_sender= ${sasl_sender} This macro expands to the SASL sender name (i.e. the original submitter as per RFC 4954) in the MAIL FROM command when the Postfix SMTP server received the message. This feature is available as of Postfix 2.2. Parameter U Code ENUM QUOTA_MATCH_SASLUSER Stringmatch sasl_username= ${sasl_username} This macro expands to the SASL user name in the AUTH command when the Postfix SMTP server received the message. This feature is available as of Postfix 2.2. Parameter s Code ENUM QUOTA_MATCH_SENDER Stringmatch sender= ${sender} This macro expands to the envelope sender address. By default, the null sender address expands to MAILER-DAEMON; this can be changed with the null_sender attribute, as described above. This information is modified by the q flag for quoting. -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot-rUsS.patch Type: text/x-patch Size: 3998 bytes Desc: not available URL: From hawat.thufir at gmail.com Tue Dec 24 18:43:05 2013 From: hawat.thufir at gmail.com (thufir) Date: Tue, 24 Dec 2013 08:43:05 -0800 Subject: [Dovecot] dovecot-postfix stack imap_client_workarounds Message-ID: <52B9B999.5000704@gmail.com> To use dovecot-postfix stack with thunderbird, do I put the configuration into /usr/share/dovecot/protocols.d/impad.protocol? That would seem to be how the stack is configured. "Thunderbird To use with Thunderbird, edit the file /etc/dovecot/dovecot.conf: protocol imap { ... login_greeting_capability = yes imap_client_workarounds = tb-extra-mailbox-sep }" https://help.ubuntu.com/community/Dovecot thufir at dur:~$ thufir at dur:~$ cat /usr/share/dovecot/protocols.d/imapd.protocol protocols = $protocols imap thufir at dur:~$ thufir at dur:~$ dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-44-generic i686 Ubuntu 12.04.3 LTS mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = was automatically rejected:%n%r } thufir at dur:~$ thufir at dur:~$ thanks, Thufir From CMarcus at Media-Brokers.com Tue Dec 24 19:02:02 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 24 Dec 2013 12:02:02 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... Message-ID: <52B9BE0A.2030001@Media-Brokers.com> Ok, hopefully there is a solution to this. I've been experimenting with multiple rsyncs in preparation for pulling the trigger on the mail server switch, but have a problem that I really want to fox before doing so. Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync. Here is the series of commands I'm running: 1. stop postfix, stop dovecot on new server 2. rsync -rltgovDHP --delete --exclude-from 'excludes.txt' /path/to/vmail/example.com/ /var/vmail/example.com/ 3. chown vmail:vmail /var/vmail 4. start dovecot, start postfix ls -al /var/vmail/example.com/user/cur shows all of the messages that should be there, and all perms are correct. Go to my account that is pointed to this mail server/account, and none of the new messages show up. Also, some messages are still showing up that shouldn't. I've tried compacting the folders, closing/relaunching Thunderbird, but nothing helps. The only way to get them to show up is to go to the local Thunderbird cache for the account, and delete the files associated with the folder having the problem. The problem is, ALL folders will have this problem, which means that everyone will need to delete ALL of their local cahced folders. This will be a major support problem. Anyone have any ideas? -- Best regards, */Charles/* From h.reindl at thelounge.net Tue Dec 24 19:04:46 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 24 Dec 2013 18:04:46 +0100 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9BE0A.2030001@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> Message-ID: <52B9BEAE.7040601@thelounge.net> Am 24.12.2013 18:02, schrieb Charles Marcus: > Ok, hopefully there is a solution to this. > > I've been experimenting with multiple rsyncs in preparation for pulling the trigger on the mail server switch, but > have a problem that I really want to fox before doing so. > > Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync that is not dovecot specific and a thunderbird problem right click on the folder -> properties -> repair it happens from time to time that after that messages re-appear and this happens on any mailserver, not only dovecot -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From CMarcus at Media-Brokers.com Tue Dec 24 19:16:58 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 24 Dec 2013 12:16:58 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9BEAE.7040601@thelounge.net> References: <52B9BE0A.2030001@Media-Brokers.com> <52B9BEAE.7040601@thelounge.net> Message-ID: <52B9C18A.7050304@Media-Brokers.com> On 2013-12-24 12:04 PM, Reindl Harald wrote: > Am 24.12.2013 18:02, schrieb Charles Marcus: >> Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync > that is not dovecot specific and a thunderbird problem > right click on the folder -> properties -> repair > > it happens from time to time that after that messages re-appear > and this happens on any mailserver, not only dovecot Thanks, that won't be quite so bad - except for people who have dozens (some almost a hundred) folders... I think it might be better to just delete the local cached copies of everything. Do you know if there is an open bug for Thunderbird for this? -- Best regards, */Charles/* From h.reindl at thelounge.net Tue Dec 24 19:30:37 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 24 Dec 2013 18:30:37 +0100 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9C18A.7050304@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> <52B9BEAE.7040601@thelounge.net> <52B9C18A.7050304@Media-Brokers.com> Message-ID: <52B9C4BD.2060107@thelounge.net> Am 24.12.2013 18:16, schrieb Charles Marcus: > On 2013-12-24 12:04 PM, Reindl Harald wrote: >> Am 24.12.2013 18:02, schrieb Charles Marcus: >>> Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync > >> that is not dovecot specific and a thunderbird problem >> right click on the folder -> properties -> repair >> >> it happens from time to time that after that messages re-appear >> and this happens on any mailserver, not only dovecot > > Thanks, that won't be quite so bad - except for people who have dozens (some almost a hundred) folders... > I think it might be better to just delete the local cached copies of everything. * stop thunderbird * delete any .msf file you find * you are done i am doing this once a year as well as for the "global-messages-db.sqlite" after i archive my current message structure below "2013" at the end of the year and let rebuild the whole caches > Do you know if there is an open bug for Thunderbird for this? i doubt there is a way to debug this predictable it happens AFAIK when different clients are changing the mailbox state at the same time and i doubt this only affects thunderbird, but only for thundebrir dteh global fix is possible that easy -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From stan at hardwarefreak.com Tue Dec 24 20:11:58 2013 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Tue, 24 Dec 2013 12:11:58 -0600 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9BE0A.2030001@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> Message-ID: <52B9CE6E.5060301@hardwarefreak.com> On 12/24/2013 11:02 AM, Charles Marcus wrote: > Ok, hopefully there is a solution to this. > > I've been experimenting with multiple rsyncs in preparation for pulling > the trigger on the mail server switch, but have a problem that I really > want to fox before doing so. > > Apparently something causes Thunderbirds local message cache to get out > of sync with dovecot after a sync. > > Here is the series of commands I'm running: > > 1. stop postfix, stop dovecot on new server > > 2. rsync -rltgovDHP --delete --exclude-from 'excludes.txt' > /path/to/vmail/example.com/ /var/vmail/example.com/ > > 3. chown vmail:vmail /var/vmail > > 4. start dovecot, start postfix > > ls -al /var/vmail/example.com/user/cur > > shows all of the messages that should be there, and all perms are correct. > > Go to my account that is pointed to this mail server/account, and none > of the new messages show up. Also, some messages are still showing up > that shouldn't. > > I've tried compacting the folders, closing/relaunching Thunderbird, but > nothing helps. > > The only way to get them to show up is to go to the local Thunderbird > cache for the account, and delete the files associated with the folder > having the problem. > > The problem is, ALL folders will have this problem, which means that > everyone will need to delete ALL of their local cahced folders. > > This will be a major support problem. > > Anyone have any ideas? The source of the problem is almost certainly out of sync Dovecot index files between the old and new servers, and thus TBird. After an rsync copy of the mails the new server must create the indexes on-the-fly when TBird connects, and the resulting new indexes are likely not identical to the old server. Thus TBird is seeing a different mailbox view. TBird keeps its own indexes for all IMAP folders. It has nothing little or nothing to do with local cached copies of folders. I don't use GLODA and I don't cache locally, but I still have a .msf file for each Dovecot IMAP folder, some of them multiple MBs in size. These are strictly indexes. It's these local indexes not being in sync with your new Dovecot server indexes that I'm pretty sure is the cause of your problem. If the mailbox contents are identical before/after the copy, you might try copying the indexes over from the old mail server, preserving permissions, creation time, atime, etc. If the server indexes are identical before/after the rsync you should avoid this problem, assuming everything else is identical, including server hostnames, IP addresses, encryption key, etc, etc. TBird tracks mailboxes by server name in Account Settings after all. If the server name changes that'll cause TBird to create an alternate local folder hierarchy in the profile directory. And that'll wreak havoc on your indexes, mailbox view, etc. -- Stan From jouko.nikula at iki.fi Wed Dec 25 05:16:49 2013 From: jouko.nikula at iki.fi (Jouko Nikula) Date: Wed, 25 Dec 2013 10:16:49 +0700 Subject: [Dovecot] SHA512-CRYPT scheme fails password verification Message-ID: Hello, If I try to use the crypt schemes provided by libc. I fail as follows: jnikula at jlaptop:~/$ doveadm pw -s SHA512-CRYPT -p 123456 {SHA512-CRYPT}$6$to2umWLDtqvzS8SV$ZGpBeGNKuUN/2HKG6I2BEAt.Gzrz/y.SZDkos2GT2ik8obnp3XCFWfVsKVriJa6jjHULmLIqCSSyaF5YrTH7u. jnikula at jlaptop:~/$ doveadm pw -t {SHA512-CRYPT}$6$to2umWLDtqvzS8SV$ZGpBeGNKuUN/2HKG6I2BEAt.Gzrz/y.SZDkos2GT2ik8obnp3XCFWfVsKVriJa6jjHULmLIqCSSyaF5YrTH7u. -p 123456 doveadm(jnikula): Fatal: reverse password verification check failed: Password mismatch Using SHA512 sum scheme (-s SHA512) works ok in the same manner. I have dovecot version 2.2.9 on Linux 3.11.0-14-generic x86_64 Ubuntu 13.10 and I get the same results on 32-bit Debian as well. Does anyone have idea what's wrong? Thanks in advance, Jouko Nikula From list_dovecot at bluerosetech.com Wed Dec 25 09:07:55 2013 From: list_dovecot at bluerosetech.com (Darren Pilgrim) Date: Tue, 24 Dec 2013 23:07:55 -0800 Subject: [Dovecot] SHA512-CRYPT scheme fails password verification In-Reply-To: References: Message-ID: <52BA844B.1050405@bluerosetech.com> On 12/24/2013 7:16 PM, Jouko Nikula wrote: > Hello, > > If I try to use the crypt schemes provided by libc. I fail as follows: > > jnikula at jlaptop:~/$ doveadm pw -s SHA512-CRYPT -p 123456 > {SHA512-CRYPT}$6$to2umWLDtqvzS8SV$ZGpBeGNKuUN/2HKG6I2BEAt.Gzrz/y.SZDkos2GT2ik8obnp3XCFWfVsKVriJa6jjHULmLIqCSSyaF5YrTH7u. > jnikula at jlaptop:~/$ doveadm pw -t > {SHA512-CRYPT}$6$to2umWLDtqvzS8SV$ZGpBeGNKuUN/2HKG6I2BEAt.Gzrz/y.SZDkos2GT2ik8obnp3XCFWfVsKVriJa6jjHULmLIqCSSyaF5YrTH7u. > -p 123456 > doveadm(jnikula): Fatal: reverse password verification check failed: > Password mismatch > > Using SHA512 sum scheme (-s SHA512) works ok in the same manner. > > I have dovecot version 2.2.9 on Linux 3.11.0-14-generic x86_64 Ubuntu > 13.10 and I get the same results on 32-bit Debian as well. Does anyone > have idea what's wrong? You're being bitten by shell interpretation/expansion. You need to make the hash an uninterpretted literal (in bourne-type shells, wrap it in single quotes): # doveadm pw -s SHA512-CRYPT -p 123456 {SHA512-CRYPT}$6$ZmAHfx//YBcuQdpt$/vUoc3G7y/v9JMSfrz0zhdBTs2U5ZmyLZbB6BEpV3BBi8f9N70kNf6xZWAnhE.hQn46pQhpIwnziIdNfjlAKu1 # doveadm pw -t {SHA512-CRYPT}$6$ZmAHfx//YBcuQdpt$/vUoc3G7y/v9JMSfrz0zhdBTs2U5ZmyLZbB6BEpV3BBi8f9N70kNf6xZWAnhE.hQn46pQhpIwnziIdNfjlAKu1 -p 123456 doveadm(root): Fatal: reverse password verification check failed: Password mismatch # doveadm pw -t '{SHA512-CRYPT}$6$ZmAHfx//YBcuQdpt$/vUoc3G7y/v9JMSfrz0zhdBTs2U5ZmyLZbB6BEpV3BBi8f9N70kNf6xZWAnhE.hQn46pQhpIwnziIdNfjlAKu1' -p 123456 {SHA512-CRYPT}$6$ZmAHfx//YBcuQdpt$/vUoc3G7y/v9JMSfrz0zhdBTs2U5ZmyLZbB6BEpV3BBi8f9N70kNf6xZWAnhE.hQn46pQhpIwnziIdNfjlAKu1 (verified) From kolmann at zid.tuwien.ac.at Wed Dec 25 09:16:56 2013 From: kolmann at zid.tuwien.ac.at (Philipp Kolmann) Date: Wed, 25 Dec 2013 08:16:56 +0100 Subject: [Dovecot] LMTP with virtual and system users Message-ID: <52BA8668.5000502@zid.tuwien.ac.at> Hi, I have a mailsystem where i have some local users with shell access and full home dirs which receive mail and also several SQL virtual users only for mail. With the virtual users, everything works fine. Mail is delivered via LMTP and also sieve works :) The SQL Lookup knows what to do with username at domain.com The problem is the system user. If exim delivers the mail to the lmtp socket, the LMTPd can't find username at local.host I would be able to specify the global auth_username_format=%n but then my SQL queries break and I like the possibility to have xx at domain1.com and xx at domain2.com routed to two different accounts. As I have seen in the source, I can't specify username_format=%n in the passdb { driver = pam } backend. Do you have any suggestion how to solve this issue? thanks Philipp -------------- next part -------------- # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.3 auth_debug = yes auth_verbose = yes first_valid_uid = 100 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { driver = pam } plugin { mail_log_fields = uid box msgid size from subject flags sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at rudolfina.at protocols = " imap lmtp sieve" service auth { unix_listener auth-client { group = Debian-exim mode = 0660 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl_cert = References: <52BA844B.1050405@bluerosetech.com> Message-ID: On Wed, Dec 25, 2013 at 2:07 PM, Darren Pilgrim wrote: > > You're being bitten by shell interpretation/expansion. You need to make the > hash an uninterpretted literal (in bourne-type shells, wrap it in single > quotes): > Ah, yes of course. Works now. Thanks! From klondike at klondike.es Tue Dec 24 15:15:02 2013 From: klondike at klondike.es (klondike) Date: Tue, 24 Dec 2013 14:15:02 +0100 Subject: [Dovecot] Sieve is not getting the propper RCPT from the LMTP daemon Message-ID: <52B988D6.50209@klondike.es> Hi! Since the setup I use is a bit strange let's go for it first: * The system uses postfix as MTA and dovecot as LDA after alias translation by local via LMTP * The dovecot version is 2.2.5 and the pigeonhole version is 0.4.1 * The SMTP server at gentoo.org is configured to send me a backup of my emails to klondike+gentoo (at) xiscosoft.es using sendmail * The email is received by the server and then (hopefully filtered). * The email comes with two Delivered-To: headers, the first one has the correct address, the second one has the gentoo address. The interesting part of the filter is this: if envelope :detail "to" "gentoo" { addflag "\\Seen"; fileinto "gentoo"; stop; } But this doesn't seem to work, I enable debugging with the following lines: require "vnd.dovecot.debug"; require "envelope"; require "variables"; if envelope :matches "to" "*" { debug_log "envelope to `${1}'"; } if envelope :matches "from" "*" { debug_log "envelope from `${1}'"; } The relevant lines for the test e-mail I sent are these: sieve: info: started log at Dec 24 13:37:23. main script: line 9: info: DEBUG: envelope to `klondike (at) gentoo.org'. main script: line 10: info: DEBUG: envelope from `klondike (at) gentoo.org'. info: msgid=<52B97FF7.6050109 at gentoo.org>: stored mail into mailbox 'INBOX'. The thing is that the to envelope should be instead klondike+gentoo (at) xiscosoft.es as show by the lmtp logs: Dec 24 13:37:23 localhost dovecot: lmtp(26249): Connect from local Dec 24 13:37:23 localhost dovecot: lmtp(26249, klondike): Cd6YHwOAuVKJZgAA0J78UA: sieve: msgid=<52B97FF7.6050109 at gentoo.org>: stored mail into mailbox 'INBOX' Dec 24 13:37:23 localhost dovecot: lmtp(26249): Disconnect from local: Successful quit Dec 24 13:37:23 localhost postfix/lmtp[26248]: 657D9101E5E: to=, relay=xiscosoft.net[private/dovecot-lmtp], delay=0.29, delays=0.05/0.03/0.03/0.18, dsn=2.0.0, status=sent (250 2.0.0 Cd6YHwOAuVKJZgAA0J78UA Saved) I really have no idea of why sieve is behaving like this as the evelope address is sent properly by postfix's lmtp according to the logs. Any ideas? klondike PS: please do CC me when answering this e-mail as I'm not subscribed to the list yet -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From klondike at klondike.es Wed Dec 25 10:47:44 2013 From: klondike at klondike.es (klondike) Date: Wed, 25 Dec 2013 09:47:44 +0100 Subject: [Dovecot] Sieve is not getting the propper RCPT from the LMTP daemon In-Reply-To: <52B988D6.50209@klondike.es> References: <52B988D6.50209@klondike.es> Message-ID: <52BA9BB0.6080806@klondike.es> El 24/12/13 14:15, klondike escribi?: > Hi! > > Since the setup I use is a bit strange let's go for it first: > * The system uses postfix as MTA and dovecot as LDA after alias > translation by local via LMTP > * The dovecot version is 2.2.5 and the pigeonhole version is 0.4.1 Tried also today with 2.2.6 and 0.4.2 with the same results BTW Timo, thanks for the verbose error messages, LMTP refused to work until postmaster_address wasn't set (despite the config still states it will go back to a default) and the logs clearly pointed that :-) klondike -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From michael at vivid.net.nz Thu Dec 26 11:04:24 2013 From: michael at vivid.net.nz (michael) Date: Thu, 26 Dec 2013 22:04:24 +1300 Subject: [Dovecot] Dovecot quota with MySQL - username issue Message-ID: <36d15e57fcc6f32b543d2b684dbbeeaf@mail.vivid.net.nz> Hi all, I'm using Dovecot 2.2.8 with quota using a MySQL backend. The Quota plugin is listed for POP3, IMAP and LDA. When it is enabled for LDA, it populates the "username" field in the MySQL table with e mail addresses. I end up with a mixture of email addresses and usernames, which causes things to not fully work. It *should* be just usernames. the LDA SQL statement is: user_query = \ SELECT mailboxes.username, accounts.uid, accounts.uid AS gid, \ concat('/home/',mailboxes.username) AS home, \ (SELECT IF(accounts.new_mail_fmt=1, \ CONCAT('Maildir:',home,'/Maildir'), \ CONCAT('mbox:',home,'/Maildir:INBOX=/var/spool/mail/',mailboxes.username))) AS mail_location \ FROM mailboxes JOIN accounts ON accounts.username=mailboxes.username \ WHERE (mailboxes.email='%u' || \ (mailboxes.email=CONCAT('@','%d') AND (SELECT COUNT(email) FROM mailboxes \ WHERE email='%u') = 0) AND mailboxes.active IS TRUE) It clearly knows the username. Usernames on this system are just names, not full email addresses. The configuration of Quota Dict is: dovecot.conf dict/quotadict = mysql:/etc/dovecot/dovecot-dict-sql.conf ... quota = dict:user::proxy::quotadict dovecot-dict-sql.conf map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } Can this be fixed? Michael From mihai at badici.ro Thu Dec 26 12:23:18 2013 From: mihai at badici.ro (Mihai Badici) Date: Thu, 26 Dec 2013 12:23:18 +0200 Subject: [Dovecot] tests with metadata module Message-ID: <16526123.pst3BNDYgE@arhivio> --Repost after subscription as list member --- I made some tests with metadata support in dovecot 2.2.10. Previously I had dovecot 2.2.4 with external metadata plugin who work well. I use dovecot with roundcube and roundcube plugins from kolab project . First, the feature activation was tricky and rather undocumented. I spent about half hour googling, after that I set: imap_metadata = yes and mail_attribute_dict = file:%h/shared_metadata I think you cold put those lines in the 20-imap.conf example file commented; that way will be easy for us to activate. Because I changed the location of shared_metadata, all folders was unannotated . I went in folder manager in roundcube and set folder "calendar" as calendar type and so on. That worked and i have: cat shared_metadata: shared/c4268a04da44bb527c5b0000193e0904/vendor/kolab/folder-type event shared/cd5792367fc9cd5196170000193e0904/vendor/kolab/folder-type event shared/33f55d2e8912195209290000193e0904/vendor/kolab/folder-type event shared/32f55d2e8912195209290000193e0904/vendor/kolab/folder-type contact However, it looks like the metadata is not properly read after. Calendar and Contacts folders don't appear in roundcube. I have this crash in dovecot's log: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x67d81) [0xb7625d81] -> /usr/lib/dovecot/libdovecot.so.0(+0x67e11) [0xb7625e11] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75d6af9] -> dovecot/imap() [0x805d3b2] -> dovecot/imap() [0x805d5bc] -> dovecot/imap() [0x805d6c9] -> dovecot/imap(client_handle_input+0x56) [0x805d836] -> dovecot/imap(client_input+0x72) [0x805dcc2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x38) [0xb7638d98] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x10e) [0xb7639d6e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb7638818] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x28) [0xb75dcb68] -> dovecot/imap(main+0x284) [0x8050f34] -> /lib/libc.so.6(__libc_start_main+0xf5) [0xb743f5a5] -> dovecot/imap() [0x80510a5] Dec 26 09:28:49 imap(mihai.badici): Fatal: master: service(imap): child 4919 killed with signal 6 (core dumps disabled) I logged imap sessions in roundcube and I have: A0003 GETMETADATA "*" (/private/vendor/kolab/folder-type /shared/vendor/kolab/folder-type) On a similar server with the "old" metadata plugin, I have here listed all folders with coresponding annotations. How I can debug further? This is a test server so I can stress it. -- Mihai B?dici http://mihai.badici.ro ----------------------------------------- From adi at ente.limmat.ch Thu Dec 26 13:20:22 2013 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Thu, 26 Dec 2013 12:20:22 +0100 Subject: [Dovecot] LMTP with virtual and system users In-Reply-To: <52BA8668.5000502@zid.tuwien.ac.at> References: <52BA8668.5000502@zid.tuwien.ac.at> Message-ID: <52BC10F6.7070306@ente.limmat.ch> Hi Philipp You can use exim to prepare the address as you wish: only the user name for pam users and the full address for virtual users. Configure a new router to strip the domain part for pam users: local_pam_users: debug_print = "R: strip domain for local pam users" driver = redirect check_local_user domains = @ : localhost : ${primary_hostname} data = ${local_part} redirect_router = local_user I'm not 100% sure of the domains condition; it should restrict the router to your domain(s) where your pam users receive their email. The redirect_router designates the router which routes your local deliveries to your lmtp transport. Place the new router to run just before your "local_user" router. Since your config works for your virtual users, you don't need to do anything in addition. Regards, Adrian. Am 25.12.13 08:16 schrieb Philipp Kolmann: > Hi, > > I have a mailsystem where i have some local users with shell access and > full home dirs which receive mail and also several SQL virtual users > only for mail. > With the virtual users, everything works fine. Mail is delivered via > LMTP and also sieve works :) > The SQL Lookup knows what to do with username at domain.com > > The problem is the system user. If exim delivers the mail to the lmtp > socket, the LMTPd can't find username at local.host > I would be able to specify the global auth_username_format=%n but then > my SQL queries break and I like the possibility to have xx at domain1.com > and xx at domain2.com routed to two different accounts. > > As I have seen in the source, I can't specify username_format=%n in the > passdb { driver = pam } backend. Do you have any suggestion how to > solve this issue? > > thanks > Philipp > > From CMarcus at Media-Brokers.com Thu Dec 26 15:40:34 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 08:40:34 -0500 Subject: [Dovecot] mail_location, user 'home', questions Message-ID: <52BC31D2.8050405@Media-Brokers.com> Hi all, Ok, another question... I always like changes to the default settings whenever possible (KISS principle)... So, according to the dovecot wiki, the default location for a maildir setup is: mail_location = maildir:~/Maildir However, when I first tried to access mail on the new box, something wasn't right, and I ended up having to change this to: mail_location = maildir:~ to get mail to display correctly. The filesystem for a users maildir currently has everything (cur/new/tmp, and the individual folders) inside that users directory, ie: /var/vmail/example.com/user/ Do I need to change this so that everything is under a 'Maildir' subdirectroy inside the users directory, like: /var/vmail/example.com/user/Maildir/ ? Also, I'm aware that it is important that even virtual users have valid 'homes', but I'm confused as to where these are (or are supposed to be) by default. My sql query currently contains: user_query = \ SELECT CONCAT('/var/vmail/', maildir) AS home \ FROM mailbox WHERE username = '%u' iterate_query = SELECT username AS user FROM mailbox So... what exactly is this saying? That the users 'home' is '/var/vmail'? Or does it automatically append %d/%u? I'm specifically wondering if the intention for the defaults is for the users home to be: /var/vmail/example.com/user and the users maildirs to be in: /var/vmail/example.com/user/Maildir Would appreciate some clarification... It wouldn't be hard to mv all of the users maildirs to a Maildir subfolder after the sync, but I want to know for sure that that is what I should/need to do... Thanks, -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Thu Dec 26 16:28:09 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 09:28:09 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9CE6E.5060301@hardwarefreak.com> References: <52B9BE0A.2030001@Media-Brokers.com> <52B9CE6E.5060301@hardwarefreak.com> Message-ID: <52BC3CF9.10706@Media-Brokers.com> On 2013-12-24 1:11 PM, Stan Hoeppner wrote: > If the mailbox contents are identical before/after the copy, you > might try copying the indexes over from the old mail server, > preserving permissions, creation time, atime, etc. Can't do this, because the old server doesn't have on disk indexes. It doesn't have enough disk space left (enabling indexing would probably cause the filesystem to fill up). Disk space is one big reason for the migration - the other being that the old server is... well, so old (about 9 years now)... :) > TBird tracks mailboxes by server name in Account Settings after all. > If the server name changes that'll cause TBird to create an > alternate local folder hierarchy in the profile directory. And > that'll wreak havoc on your indexes, mailbox view, etc. When I pull the trigger, I'll simple change the DNS pointers, so no, the server name will not change (from Thunderbird's perspective). I'm mainly just interested in the end users not having to do anything to 'refresh' their local caches. Maybe the best solution is a script that deletes all local copies of .msf files... although I had another thought I'll ask about in a renamed thread... -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Thu Dec 26 16:34:03 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 09:34:03 -0500 Subject: [Dovecot] Question re: indexes Message-ID: <52BC3E5B.2040402@Media-Brokers.com> Hi all, On the old/current dovecot server, I have disabled on disk indexes: mail_location = maildir:~/:INDEX=MEMORY On the new server, I removed the 'INDEX=MEMORY' part, and I now see some new index related files, but what I don't see is the main dovecot.index file... I only have: dovecot.index.cache and dovecot.index.log So... where is the main dovecot.index file? -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Thu Dec 26 17:07:20 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 10:07:20 -0500 Subject: [Dovecot] Question re: indexes In-Reply-To: <52BC3E5B.2040402@Media-Brokers.com> References: <52BC3E5B.2040402@Media-Brokers.com> Message-ID: <52BC4628.4000308@Media-Brokers.com> On 2013-12-26 9:34 AM, Charles Marcus wrote: > So... where is the main dovecot.index file? Hmmm... could this be related to how my mail_location is currently set ('maildir:~', as opposed to 'maildir:~/Maildir')? -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Thu Dec 26 17:07:54 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 10:07:54 -0500 Subject: [Dovecot] Dovecot control files - WAS: Re: Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9BE0A.2030001@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> Message-ID: <52BC464A.1020708@Media-Brokers.com> On 2013-12-24 12:02 PM, Charles Marcus wrote: > Apparently something causes Thunderbirds local message cache to get > out of sync with dovecot after a sync. Ok, I had a new thought about the problem of invalid local client caches... There is this on the dovecot wiki about the control files: http://wiki2.dovecot.org/MailLocation/Maildir "Dovecot stores some Maildir metadata into two control files: dovecot-uidlist file contains IMAP UID <-> Maildir filename mapping ... If the messages get new UIDs, the IMAP clients will invalidate their local cache and download the messages all over again. If you do this for all the users, you could cause huge disk I/O bursts to your server. " This sounds like exactly what I want (IMAP clients will INVALIDATE THEIR LOCAL CACHE...) to happen the first time users access their mail on the new server. So, I'm thinking what I could do is simply exclude the dovecot-uid* files during the transfer (and delete existing ones using --delete-excluded) during the rsync, and this would cause everyone's Thunderbird to regenerate their local caches, thus eliminating the need to rebuild the .msf files (either manually or by scripting their deletion)? The new server is a VM on a pretty hefty box, with 16GB allocated, and if I do this before people come in, their initial logins would be spread out, not exactly at the same time, so the 'huge disk IO bursts' shouldn't be a big problem. Obviously this would only happen the for the client they first access their mail with, so I'd need to block access to the new mail server from outside (ie, so mobile clients, which are polling the new server, wouldn't cause the regeneration of the dovecot-uid* files before Thunderbird gets a chance to, but... Hmmm... what will happen for mobile clients... crap... will those get confused to, but leaving me with no easy way to delete their local cache (like I could the .msf files)? Have to first test and make sure this will actually solve the problem though... -- Best regards, */Charles/* From tss at iki.fi Thu Dec 26 18:05:17 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 26 Dec 2013 18:05:17 +0200 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52B9BE0A.2030001@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> Message-ID: <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> None of that should be happening. The client shouldn't be able to become confused, because it should see identical mailboxes in the old and in the new server. You can check with IMAP protocol if the rsync actually preserved everything correctly (what's in excludes.txt?) : doveadm exec imap -u user at domain a select inbox b uid search all Do this in both old and new server. Make sure that UIDVALIDITY and UIDNEXT replies to SELECT are the same, and also that the SEARCH reply is the same. Did you stop Dovecot on the old server during rsync? That could explain if it was modified while rsync was running. On 24.12.2013, at 19.02, Charles Marcus wrote: > Ok, hopefully there is a solution to this. > > I've been experimenting with multiple rsyncs in preparation for pulling the trigger on the mail server switch, but have a problem that I really want to fox before doing so. > > Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync. > > Here is the series of commands I'm running: > > 1. stop postfix, stop dovecot on new server > > 2. rsync -rltgovDHP --delete --exclude-from 'excludes.txt' /path/to/vmail/example.com/ /var/vmail/example.com/ > > 3. chown vmail:vmail /var/vmail > > 4. start dovecot, start postfix > > ls -al /var/vmail/example.com/user/cur > > shows all of the messages that should be there, and all perms are correct. > > Go to my account that is pointed to this mail server/account, and none of the new messages show up. Also, some messages are still showing up that shouldn't. > > I've tried compacting the folders, closing/relaunching Thunderbird, but nothing helps. > > The only way to get them to show up is to go to the local Thunderbird cache for the account, and delete the files associated with the folder having the problem. > > The problem is, ALL folders will have this problem, which means that everyone will need to delete ALL of their local cahced folders. > > This will be a major support problem. > > Anyone have any ideas? > > -- > > Best regards, > > */Charles/* From CMarcus at Media-Brokers.com Thu Dec 26 20:33:06 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 13:33:06 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> Message-ID: <52BC7662.6090403@Media-Brokers.com> Hi Timo, Thanks for the reply, but I think I figured it out... I just realized... 1. the source does NOT have any index files at all, only the dovecot-uid* files 2. the target (the account I am testing with) *does* have *two* index files (but not the main dovecot.index file), because they are created when I access the account So, maybe I just need to delete the index files on the target before accessing it? I also really, really need to know why I don't have the main dovecot.index file... ??? I'll test the above hypothesis after the current backup finishes... On 2013-12-26 11:05 AM, Timo Sirainen wrote: > None of that should be happening. The client shouldn't be able to become confused, because it should see identical mailboxes in the old and in the new server. You can check with IMAP protocol if the rsync actually preserved everything correctly (what's in excludes.txt?) : > > doveadm exec imap -u user at domain > a select inbox > b uid search all > > Do this in both old and new server. Make sure that UIDVALIDITY and UIDNEXT replies to SELECT are the same, and also that the SEARCH reply is the same. > > Did you stop Dovecot on the old server during rsync? That could explain if it was modified while rsync was running. > > On 24.12.2013, at 19.02, Charles Marcus wrote: > >> Ok, hopefully there is a solution to this. >> >> I've been experimenting with multiple rsyncs in preparation for pulling the trigger on the mail server switch, but have a problem that I really want to fox before doing so. >> >> Apparently something causes Thunderbirds local message cache to get out of sync with dovecot after a sync. >> >> Here is the series of commands I'm running: >> >> 1. stop postfix, stop dovecot on new server >> >> 2. rsync -rltgovDHP --delete --exclude-from 'excludes.txt' /path/to/vmail/example.com/ /var/vmail/example.com/ >> >> 3. chown vmail:vmail /var/vmail >> >> 4. start dovecot, start postfix >> >> ls -al /var/vmail/example.com/user/cur >> >> shows all of the messages that should be there, and all perms are correct. >> >> Go to my account that is pointed to this mail server/account, and none of the new messages show up. Also, some messages are still showing up that shouldn't. >> >> I've tried compacting the folders, closing/relaunching Thunderbird, but nothing helps. >> >> The only way to get them to show up is to go to the local Thunderbird cache for the account, and delete the files associated with the folder having the problem. >> >> The problem is, ALL folders will have this problem, which means that everyone will need to delete ALL of their local cahced folders. >> >> This will be a major support problem. >> >> Anyone have any ideas? -- Best regards, */Charles /* From CMarcus at Media-Brokers.com Thu Dec 26 20:40:40 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 13:40:40 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52BC7662.6090403@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> Message-ID: <52BC7828.7020209@Media-Brokers.com> On 2013-12-26 1:33 PM, Charles Marcus wrote: > 1. the source does NOT have any index files at all, only the > dovecot-uid* files > > 2. the target (the account I am testing with) *does* have *two* index > files (but not the main dovecot.index file), because they are created > when I access the account > > So, maybe I just need to delete the index files on the target before > accessing it? Meaning... the index files and the dovecot-uid* files are out of sync (index files are in a state from the last time I accessed the mailstore, before I rsync'd it again, but the dovecot-uid* files are from the state of the mailstore at the time of the last backup). Would that explain it? -- Best regards, */Charles/* From tss at iki.fi Thu Dec 26 20:44:13 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 26 Dec 2013 20:44:13 +0200 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52BC7662.6090403@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> Message-ID: <713709AB-6824-4E8D-AFB7-8366060FCC2E@iki.fi> On 26.12.2013, at 20.33, Charles Marcus wrote: > Hi Timo, > > Thanks for the reply, but I think I figured it out... > > I just realized... > > 1. the source does NOT have any index files at all, only the dovecot-uid* files Only the dovecot-uidlist matters, the indexes are only for optimization. > 2. the target (the account I am testing with) *does* have *two* index files (but not the main dovecot.index file), because they are created when I access the account This is intentional optimization. > So, maybe I just need to delete the index files on the target before accessing it? Nope, doesn't matter. > I also really, really need to know why I don't have the main dovecot.index file... ??? It's going to be created later once the mailbox has had a bit more changes. From tss at iki.fi Thu Dec 26 20:45:51 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 26 Dec 2013 20:45:51 +0200 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52BC7828.7020209@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> <52BC7828.7020209@Media-Brokers.com> Message-ID: <84A2EE13-28AD-4083-9820-013C72FD397F@iki.fi> On 26.12.2013, at 20.40, Charles Marcus wrote: > On 2013-12-26 1:33 PM, Charles Marcus wrote: >> 1. the source does NOT have any index files at all, only the dovecot-uid* files >> >> 2. the target (the account I am testing with) *does* have *two* index files (but not the main dovecot.index file), because they are created when I access the account >> >> So, maybe I just need to delete the index files on the target before accessing it? > > Meaning... the index files and the dovecot-uid* files are out of sync (index files are in a state from the last time I accessed the mailstore, before I rsync'd it again, but the dovecot-uid* files are from the state of the mailstore at the time of the last backup). > > Would that explain it? Ah. Maybe. Although they do have timestamps and should refresh automatically if they don't match. But I've heard some problems related to that. Using doveadm force-resync -A '*' could be used to make sure the indexes are up to date for everyone. From rs at sys4.de Thu Dec 26 21:02:01 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 26 Dec 2013 20:02:01 +0100 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <84A2EE13-28AD-4083-9820-013C72FD397F@iki.fi> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> <52BC7828.7020209@Media-Brokers.com> <84A2EE13-28AD-4083-9820-013C72FD397F@iki.fi> Message-ID: <52BC7D29.6020006@sys4.de> Am 26.12.2013 19:45, schrieb Timo Sirainen: > On 26.12.2013, at 20.40, Charles Marcus wrote: > >> On 2013-12-26 1:33 PM, Charles Marcus wrote: >>> 1. the source does NOT have any index files at all, only the dovecot-uid* files >>> >>> 2. the target (the account I am testing with) *does* have *two* index files (but not the main dovecot.index file), because they are created when I access the account >>> >>> So, maybe I just need to delete the index files on the target before accessing it? >> >> Meaning... the index files and the dovecot-uid* files are out of sync (index files are in a state from the last time I accessed the mailstore, before I rsync'd it again, but the dovecot-uid* files are from the state of the mailstore at the time of the last backup). >> >> Would that explain it? > > Ah. Maybe. Although they do have timestamps and should refresh automatically if they don't match. But I've heard some problems related to that. Using doveadm force-resync -A '*' could be used to make sure the indexes are up to date for everyone. > off topic, i sometimes have bugs with Thunderbird on Windows only ( no idea why ) only dovecot-uid* delete fixes that, and all mails in dove maildir can be seen again on TB win, never had that problem with thunderbird on linux. Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From CMarcus at Media-Brokers.com Thu Dec 26 22:21:34 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 15:21:34 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <713709AB-6824-4E8D-AFB7-8366060FCC2E@iki.fi> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> <713709AB-6824-4E8D-AFB7-8366060FCC2E@iki.fi> Message-ID: <52BC8FCE.6060107@Media-Brokers.com> On 2013-12-26 1:44 PM, Timo Sirainen wrote: > On 26.12.2013, at 20.33, Charles Marcus wrote: >> I also really, really need to know why I don't have the main dovecot.index file... ??? > It's going to be created later once the mailbox has had a bit more changes. Oh... ok... didn't see anything on the wiki about a delay with this file being created. Thanks! From CMarcus at Media-Brokers.com Thu Dec 26 22:21:52 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 26 Dec 2013 15:21:52 -0500 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52BC7D29.6020006@sys4.de> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> <52BC7828.7020209@Media-Brokers.com> <84A2EE13-28AD-4083-9820-013C72FD397F@iki.fi> <52BC7D29.6020006@sys4.de> Message-ID: <52BC8FE0.4030809@Media-Brokers.com> On 2013-12-26 2:02 PM, Robert Schetterer wrote: > Am 26.12.2013 19:45, schrieb Timo Sirainen: >> On 26.12.2013, at 20.40, Charles Marcus wrote: >>> Meaning... the index files and the dovecot-uid* files are out of sync (index files are in a state from the last time I accessed the mailstore, before I rsync'd it again, but the dovecot-uid* files are from the state of the mailstore at the time of the last backup). >>> >>> Would that explain it? >> Ah. Maybe. Although they do have timestamps and should refresh automatically if they don't match. But I've heard some problems related to that. Using doveadm force-resync -A '*' could be used to make sure the indexes are up to date for everyone. > off topic, i sometimes have bugs with Thunderbird on Windows only ( no > idea why ) only dovecot-uid* delete fixes that, and all mails in dove > maildir can be seen again on TB win, never had that problem with > thunderbird on linux. Ok, I'll test two different ways... First, I'll test if just deleting the index files on the target before accessing with Thunderbird shows all files. If it doesn't, then I'll test if deleting both the indexes and the uid* files does the trick. Thanks, -- Best regards, */Charles/* From rs at sys4.de Fri Dec 27 00:05:55 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 26 Dec 2013 23:05:55 +0100 Subject: [Dovecot] Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52BC8FE0.4030809@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> <52BC7828.7020209@Media-Brokers.com> <84A2EE13-28AD-4083-9820-013C72FD397F@iki.fi> <52BC7D29.6020006@sys4.de> <52BC8FE0.4030809@Media-Brokers.com> Message-ID: <52BCA843.2040803@sys4.de> Am 26.12.2013 21:21, schrieb Charles Marcus: > On 2013-12-26 2:02 PM, Robert Schetterer wrote: >> Am 26.12.2013 19:45, schrieb Timo Sirainen: >>> On 26.12.2013, at 20.40, Charles Marcus >>> wrote: >>>> Meaning... the index files and the dovecot-uid* files are out of >>>> sync (index files are in a state from the last time I accessed the >>>> mailstore, before I rsync'd it again, but the dovecot-uid* files are >>>> from the state of the mailstore at the time of the last backup). >>>> >>>> Would that explain it? > >>> Ah. Maybe. Although they do have timestamps and should refresh >>> automatically if they don't match. But I've heard some problems >>> related to that. Using doveadm force-resync -A '*' could be used to >>> make sure the indexes are up to date for everyone. > >> off topic, i sometimes have bugs with Thunderbird on Windows only ( no >> idea why ) only dovecot-uid* delete fixes that, and all mails in dove >> maildir can be seen again on TB win, never had that problem with >> thunderbird on linux. > > Ok, I'll test two different ways... > > First, I'll test if just deleting the index files on the target before > accessing with Thunderbird shows all files. > > If it doesn't, then I'll test if deleting both the indexes and the uid* > files does the trick. in my case this has worked ever in the "magic TB win list mail bug", but it might be an additional problem not directly related to your problem > > Thanks, > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From madduck at madduck.net Fri Dec 27 07:04:16 2013 From: madduck at madduck.net (martin f krafft) Date: Fri, 27 Dec 2013 18:04:16 +1300 Subject: [Dovecot] Sieve's spamtest always returns 0 Message-ID: <20131227050416.GA5197@fishbowl.rw.madduck.net> I am a bit at a loss here with Sieve (pigeonhole) and the spamtest extension. I am using Dovecot 2.1.7 (backported to Debian squeeze), which comes with Pigeonhole 0.3.0. Messages are scanned with SpamAssassin, which adds a header like X-Spam-Status: Yes, score=84.6 required=5.0 tests=? and so I configured spamtest in conf.d/90-plugin.conf like so: sieve_spamtest_status_type = score sieve_spamtest_status_header = X-Spam-Status: [^,]*, score=(-?[[:digit:]]+\.[[:digit:]]).* sieve_spamtest_max_header = X-Spam-Status: [^,]*, score=[^[:space:]]+ required=(-?[[:digit:]]+\.[[:digit:]]).* I tested those regular expressions with sed -r, e.g. % sed -rne "s@^X-Spam-Status: [^,]*, score=-?[[:digit:]]+\.[[:digit:]] required=(-?[[:digit:]]+\.[[:digit:]]).*@\1 at p" mailfile 5.0 and they work. Unfortunately, in sieve scripts, the spamtest value is always 0, which is indicative of the spamtest "not having run", which in this case I assume means that the regular expression didn't match. Am I right in assuming that the matching happens at the time of evaluation, and so adding the headers using vnd.dovecot.filter just before works? Or does the spamtest matching happen before the sieve scripts are executed? Can you see any other reason why spamtest always yields a value of 0? Thanks, -- martin | http://madduck.net/ | http://two.sentenc.es/ "those who are faithful know only the trivial side of love: it is the faithless who know love's tragedies." -- oscar wilde spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From cr at sys4.de Fri Dec 27 12:08:37 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Fri, 27 Dec 2013 11:08:37 +0100 Subject: [Dovecot] German Umlauts in folder name and sieve Message-ID: <09ABC858-7067-4179-AA19-4B3CBDE4BE72@sys4.de> Hi, I had created an imap folder that has German Umlauts in it: ?RA R??ner - Merle? When finished, the result looks like this on filesystem: drwx------ 3 vmail vmail 4096 Dec 27 11:02 RA Ro&AwgA3w-ner - Merle/ I wrote this sieve script (with SOGo): if anyof (address :regex "from" "@.*\\.ra-roessner-merle\\.de") { fileinto "RA Ro&AwgA3w-ner - Merle"; stop; } That creates a new IMAP folder with exactly this strange name. Can I change this somehow? # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 auth_master_user_separator = * auth_mechanisms = plain login cram-md5 digest-md5 ntlm auth_verbose = yes default_vsz_limit = 512 M hostname = mail.roessner-net.de imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_access_groups = vmail mail_attachment_dir = /var/mail/virtual/copymail/attachments mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = quota acl fts fts_lucene zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 128 M namespace { list = children location = mdbox:%%h/mdbox prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox junkmail { special_use = \Junk } prefix = separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/mail/virtual/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. quota = dict:User quota::file:%h/mdbox/dovecot-quota quota_grace = 10%% quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener auth-userdb { mode = 0600 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix mode = 0666 user = postfix } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = From bourek at thinline.cz Fri Dec 27 12:26:32 2013 From: bourek at thinline.cz (Jiri Bourek) Date: Fri, 27 Dec 2013 11:26:32 +0100 Subject: [Dovecot] German Umlauts in folder name and sieve In-Reply-To: <09ABC858-7067-4179-AA19-4B3CBDE4BE72@sys4.de> References: <09ABC858-7067-4179-AA19-4B3CBDE4BE72@sys4.de> Message-ID: <52BD55D8.3050500@thinline.cz> Christian R??ner wrote: > Hi, > > I had created an imap folder that has German Umlauts in it: > > ?RA R??ner - Merle? > > When finished, the result looks like this on filesystem: > > drwx------ 3 vmail vmail 4096 Dec 27 11:02 RA Ro&AwgA3w-ner - Merle/ > > I wrote this sieve script (with SOGo): > > if anyof (address :regex "from" "@.*\\.ra-roessner-merle\\.de") { > fileinto "RA Ro&AwgA3w-ner - Merle"; > stop; > } You need to put the imap folder name (fileinto "RA R??ner - Merle";) instead of directory name into your sieve script. More info in documentaton: http://wiki2.dovecot.org/Pigeonhole/Sieve/Troubleshooting#Mailbox_Names_with_non-ASCII_Characters_Cause_Problems From cr at sys4.de Fri Dec 27 12:33:09 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Fri, 27 Dec 2013 11:33:09 +0100 Subject: [Dovecot] German Umlauts in folder name and sieve In-Reply-To: <52BD55D8.3050500@thinline.cz> References: <09ABC858-7067-4179-AA19-4B3CBDE4BE72@sys4.de> <52BD55D8.3050500@thinline.cz> Message-ID: <1FA81241-F9AE-435C-A9A1-0243EB726DB6@sys4.de> Hi, >> if anyof (address :regex "from" "@.*\\.ra-roessner-merle\\.de") { >> fileinto "RA Ro&AwgA3w-ner - Merle"; >> stop; >> } > > You need to put the imap folder name (fileinto "RA R??ner - Merle";) instead of directory name into your sieve script. More info in documentaton: thank you very much. So this is a SOGo bug, as the folder gets listed in a pull down menu ;-) Kind regards -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From alessio at skye.it Fri Dec 27 14:04:11 2013 From: alessio at skye.it (Alessio Cecchi) Date: Fri, 27 Dec 2013 13:04:11 +0100 Subject: [Dovecot] =?utf-8?q?obox=5Ffs_and_Dropbox=2C_someone_uses_it=3F?= Message-ID: <2cd6f6311c5f2f8079c3a0a46e02fd38@skye.it> I purchased the license for the Dovecot Object Storage for Dropbox to test this functionality on a personal domain. Unfortunately I can not make it work, I create the token for my Dropbox account from here https://dropbox.dovecot.fi/ and setup in dovecot configuration. When I try to login with an user I found these errors in log file: ============ Dec 27 10:52:16 mail dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=8844, secured, session= Dec 27 10:52:16 mail dovecot: metacache-worker(8839): Error: fs-dropbox: GET 1/metadata/sandbox/dovecot1 at test.it/idx/?file_limit=25000 failed: 401 Unauthorized Dec 27 10:52:16 archiviomail dovecot: metacache-worker(8839): Error: Failed to iterate dovecot1 at test.it/idx/: GET 1/metadata/sandbox/dovecot1 at test.it/idx/?file_limit=25000 failed: 401 Unauthorized Dec 27 10:52:16 mail dovecot: imap(dovecot1 at test.it): Error: user dovecot1 at test.it: Initialization failed: Namespace '': obox: USER-REF: /var/run/dovecot/metacache returned failure Dec 27 10:52:16 mail dovecot: imap(dovecot1 at test.it): Error: Invalid user settings. Refer to server log for more information. Dec 27 10:52:16 mail dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=8846, secured, session= ============= I do not think it's a problem of my configuration, if instead of Dropbox use AWS S3 works fine, seems to be a token problem (401 Unauthorized). The plugin configuration is this: ### Dropbox plugin { obox_fs = fscache 10G:/var/lib/dovecot/cache:dropbox:https://XXXX:YYYY at dropbox/ } Anyone successfully used this setup? From CMarcus at Media-Brokers.com Fri Dec 27 15:41:37 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 08:41:37 -0500 Subject: [Dovecot] Server Migration Attempt - new messages DELETED after secondary rsyncs Message-ID: <52BD8391.2070106@Media-Brokers.com> Starting a new thread, as I've got a lot more details now... First, I know this may be (or is even likely) something weird happening with Thunderbird, but the bottom line is, I have to find a resolution or a workaround or something, or I will be unable to pull the trigger on the server migration. It is simply unacceptable to lose ANY mails doing this. Goal: migrate mailstore from old server to new server using rsync Thunderbird (24.2) is set up to access the new account for testing Problem: after rsync, ls shows new messages (11 for the 27th), but when Thunderbird accesses the maildir again after another rsync, MOST (but not all) of the new messages are deleted (only one for the 27th remains) Timo - I'd be happy to do anything necessary to track this down if you'll just tell me what you need... Note: if you are pretty confident that upgrading dovecot on the old server and using dsync to do the migration will solve the problem, obviously I'm willing to do that if there is no other choice, but... I hope you'll want to get to the bottom of this regardless, as, according to you and everything I've read, it should work without losing any emails... Ok, as to details... Source (ol/active server): dovecot 2.1.17, postfix virtual for delivery, vmail owned by postfix:postfix Note: using prefix=INBOX. courier compatibility namespace Target: dovecot 2.2.10, dovecot LDA, vmail owned by vmail:vmail, nothing being actively delivered (yet) Note: NOT using prefix=INBOX. courier compatiblity namespace Both doveconf -n outputs at end of this message *** Could the different namespaces, or differing dovecot versions cause this? Current /snapshot/ being used was taken at about 3:48am this morning rsync command (dovecot is STOPPED before performing, source is the latest snapshot of the active server): rsync -rltgovDHP --delete --delete-excluded --exclude-from '/path/to/excludes.txt' /snapshot/.../vmail/example.com/user/ /.../vmail/example.com/user/ I'm only syncing the one user until I get this problem resolved as it is faster. excludes.txt contains only (just to eliminate these which are still on the source): courierimap* Right after the rsync: ls -al /.../user (changes depending on what is in includes.txt) -rw------- 1 vmail vmail 51 Dec 18 10:13 dovecot-keywords -rw------- 1 vmail vmail 221638 Dec 27 02:42 dovecot-uidlist -rw------- 1 vmail vmail 8 Dec 18 09:56 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 Jun 9 2012 dovecot-uidvalidity.4fd32805 ls -al /.../user/cur (copy/pasted newest thru 12/25 - this list is always the same after a sync) -rw------- 1 vmail vmail 24904 Dec 25 15:47 1388004452.Vfe02Ic72976M281736.oldhost.example.com:2, -rw------- 1 vmail vmail 5825360 Dec 25 22:52 1388029948.Vfe02Ic7306fM556006.oldhost.example.com:2, -rw------- 1 vmail vmail 27718 Dec 26 02:19 1388042391.Vfe02Ic33b40M543019.oldhost.example.com:2, -rw------- 1 vmail vmail 28083 Dec 26 07:11 1388059893.Vfe02Ic76388M193423.oldhost.example.com:2,S -rw------- 1 vmail vmail 100651 Dec 26 08:02 1388062961.Vfe02Ic763c2M415005.oldhost.example.com:2, -rw------- 1 vmail vmail 5286 Dec 26 09:41 1388068882.Vfe02Ic7642dM83715.oldhost.example.com:2,S -rw------- 1 vmail vmail 53203 Dec 26 09:55 1388069721.Vfe02Ic7646fM716189.oldhost.example.com:2,S -rw------- 1 vmail vmail 12039 Dec 26 12:48 1388080111.Vfe02Ic76742M972942.oldhost.example.com:2,RS -rw------- 1 vmail vmail 13531 Dec 26 13:14 1388081648.Vfe02Ic7674cM68343.oldhost.example.com:2,S -rw------- 1 vmail vmail 25161 Dec 26 15:47 1388090846.Vfe02Ic768acM489505.oldhost.example.com:2, -rw------- 1 vmail vmail 5037 Dec 26 16:27 1388093257.Vfe02Ic76918M766778.oldhost.example.com:2, -rw------- 1 vmail vmail 3157 Dec 26 17:01 1388095312.Vfe02Ic76997M703744.oldhost.example.com:2, -rw------- 1 vmail vmail 22480 Dec 26 17:50 1388098239.Vfe02Ic769deM225078.oldhost.example.com:2, -rw------- 1 vmail vmail 10043 Dec 26 19:59 1388105984.Vfe02Ic76a25M12505.oldhost.example.com:2, -rw------- 1 vmail vmail 10635 Dec 26 21:11 1388110298.Vfe02Ic76a65M649895.oldhost.example.com:2, -rw------- 1 vmail vmail 8695 Dec 26 21:11 1388110319.Vfe02Ic76a6fM696948.oldhost.example.com:2, -rw------- 1 vmail vmail 11045 Dec 26 21:56 1388112965.Vfe02Ic76a57M185504.oldhost.example.com:2, -rw------- 1 vmail vmail 823 Dec 26 22:40 1388115600.Vfe02Ib61cf5M913598.oldhost.example.com:2,ST -rw------- 1 vmail vmail 815 Dec 26 22:40 1388115627.Vfe02Ib63443M811945.oldhost.example.com:2,ST -rw------- 1 vmail vmail 785 Dec 26 22:40 1388115628.Vfe02Ib659c9M617314.oldhost.example.com:2,ST -rw------- 1 vmail vmail 6156 Dec 27 00:05 1388120705.Vfe02Ib7aa31M58188.oldhost.example.com:2,ST -rw------- 1 vmail vmail 869 Dec 27 00:05 1388120713.Vfe02Ib8506aM185504.oldhost.example.com:2,ST -rw------- 1 vmail vmail 925 Dec 27 00:29 1388122155.Vfe02Ibb2a1fM764275.oldhost.example.com:2,ST -rw------- 1 vmail vmail 823 Dec 27 00:38 1388122687.Vfe02Ic2f69aM168075.oldhost.example.com:2,ST -rw------- 1 vmail vmail 801 Dec 27 00:38 1388122696.Vfe02Ic31befM507147.oldhost.example.com:2,ST -rw------- 1 vmail vmail 801 Dec 27 00:38 1388122709.Vfe02Ic3ac2bM981625.oldhost.example.com:2,ST -rw------- 1 vmail vmail 4576 Dec 27 00:57 1388123820.Vfe02Ic769e8M270744.oldhost.example.com:2,ST -rw------- 1 vmail vmail 8379 Dec 27 01:33 1388126003.Vfe02Ib7fd87M510118.oldhost.example.com:2,ST -rw------- 1 vmail vmail 27647 Dec 27 02:20 1388128838.Vfe02Ic7610fM483481.oldhost.example.com:2, -rw------- 1 vmail vmail 6373 Dec 27 02:42 1388130144.Vfe02Ic76a99M631316.oldhost.example.com:2,ST -rw------- 1 vmail vmail 3906 Dec 27 03:01 1388131281.Vfe02Ic76a9cM599830.oldhost.example.com:2,ST Start dovecot, select INBOX in Thunderbird for this account, it only displays these (I got this ls output from AFTER the messages in the cur directory are deleted per below - before doing any of the 3 aqctions below, ALL of the messages show in the ls output): ls -al /.../user/cur -rw------- 1 vmail vmail 24904 Dec 25 15:47 1388004452.Vfe02Ic72976M281736.oldhost.example.com:2, -rw------- 1 vmail vmail 5825360 Dec 25 22:52 1388029948.Vfe02Ic7306fM556006.oldhost.example.com:2, -rw------- 1 vmail vmail 27718 Dec 26 02:19 1388042391.Vfe02Ic33b40M543019.oldhost.example.com:2, -rw------- 1 vmail vmail 28083 Dec 26 07:11 1388059893.Vfe02Ic76388M193423.oldhost.example.com:2,S -rw------- 1 vmail vmail 100651 Dec 26 08:02 1388062961.Vfe02Ic763c2M415005.oldhost.example.com:2, -rw------- 1 vmail vmail 5286 Dec 26 09:41 1388068882.Vfe02Ic7642dM83715.oldhost.example.com:2,S -rw------- 1 vmail vmail 53203 Dec 26 09:55 1388069721.Vfe02Ic7646fM716189.oldhost.example.com:2,S -rw------- 1 vmail vmail 12039 Dec 26 12:48 1388080111.Vfe02Ic76742M972942.oldhost.example.com:2,RS -rw------- 1 vmail vmail 13531 Dec 26 13:14 1388081648.Vfe02Ic7674cM68343.oldhost.example.com:2,S -rw------- 1 vmail vmail 25161 Dec 26 15:47 1388090846.Vfe02Ic768acM489505.oldhost.example.com:2, -rw------- 1 vmail vmail 5037 Dec 26 16:27 1388093257.Vfe02Ic76918M766778.oldhost.example.com:2, -rw------- 1 vmail vmail 3157 Dec 26 17:01 1388095312.Vfe02Ic76997M703744.oldhost.example.com:2, -rw------- 1 vmail vmail 22480 Dec 26 17:50 1388098239.Vfe02Ic769deM225078.oldhost.example.com:2, -rw------- 1 vmail vmail 10043 Dec 26 19:59 1388105984.Vfe02Ic76a25M12505.oldhost.example.com:2, -rw------- 1 vmail vmail 10635 Dec 26 21:11 1388110298.Vfe02Ic76a65M649895.oldhost.example.com:2, -rw------- 1 vmail vmail 8695 Dec 26 21:11 1388110319.Vfe02Ic76a6fM696948.oldhost.example.com:2, -rw------- 1 vmail vmail 11045 Dec 26 21:56 1388112965.Vfe02Ic76a57M185504.oldhost.example.com:2, -rw------- 1 vmail vmail 27647 Dec 27 02:20 1388128838.Vfe02Ic7610fM483481.oldhost.example.com:2, This is weird, because it does show ONE new message from the 27th. And again, ls -al on the cur dir at this point still shows ALL of the messages (11 for the 27th, and 18 for the 26th) shown in the FIRST ls output, ABOVE this second listing (which is shown only to show you what Thunderbird is seeing, and what shows in the ls output AFTER doing any of the 3 actions below). Now... Doing ANY of the following results in MOST (BUT NOT ALL) OF THE NEW MESSAGES BEING DELETED ON THE SERVER - ie, ls -al output changes to the match what is immediately above (what was showing in Thunderbird right after selecting the Inbox right after the rsync). 1. Right-click on the Inbox > Properties > Repair Folder (in Thunderbird) 2. Right-click on INBOX > Compact (in Thunderbird) 3. Manually deleting the .msf file for the INBOX Obviously, I must find a resolution for this before I can pull the trigger on this migration. ************************************************************************ old server dovecon -n: oldhost : Fri Dec 27, 05:59:12 : ~ # doveconf -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 3.10.7-gentoo-r1 x86_64 Gentoo Base System release 2.2 auth_default_realm = example.com auth_mechanisms = plain login first_valid_uid = 207 last_valid_uid = 207 listen = * login_log_format_elements = user=<%u> method=%m rip=%r lport=%{lport} mpid=%e %c session=<%{session}> mail_gid = 207 mail_location = maildir:~/:INDEX=MEMORY mail_uid = 207 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 } service imap { process_limit = 2048 } ssl = required ssl_cert = method=%m %c rip=%r lport=%{lport} mail_gid = vmail mail_location = maildir:~ mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { service_count = 0 } service imap { process_limit = 2048 } ssl = required ssl_cert = References: <52BD8391.2070106@Media-Brokers.com> Message-ID: <52BD8AC4.2080601@thelounge.net> Am 27.12.2013 14:41, schrieb Charles Marcus: > Thunderbird (24.2) is set up to access the new account for testing > Problem: after rsync, ls shows new messages (11 for the 27th), but when Thunderbird accesses the maildir again > after another rsync, MOST (but not all) of the new messages are deleted (only one for the 27th remains) why the hell do you do a *second* rsync? rsync in case of mailservers is for *the first one and only* 1:1 migration "man imapsync" for futher sane options using IMAP and not mangle files -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From rick at havokmon.com Fri Dec 27 16:28:49 2013 From: rick at havokmon.com (Rick Romero) Date: Fri, 27 Dec 2013 08:28:49 -0600 Subject: [Dovecot] Server Migration Attempt - new messages DELETED after secondary rsyncs In-Reply-To: <52BD8391.2070106@Media-Brokers.com> References: <52BD8391.2070106@Media-Brokers.com> Message-ID: <20131227082849.Horde.vI1Beiv5mtlr8rlFBgp1BA9@www.vfemail.net> Quoting Charles Marcus : > Starting a new thread, as I've got a lot more details now... > > rsync command (dovecot is STOPPED before performing, source is the > latest snapshot of the active server): > > rsync -rltgovDHP --delete --delete-excluded --exclude-from > '/path/to/excludes.txt' /snapshot/.../vmail/example.com/user/ > /.../vmail/example.com/user/ I have done it this way: After the 1st rsync, the client should be accessing the new location - the server should be delivering to the new location, and you do one last rsync to catch any straggling deliveries. For your issue appears on first blush that Thunderbird is just removing the email marked as Trash (T flag). > I'm only syncing the one user until I get this problem resolved as > it 1388115600.Vfe02Ib61cf5M913598.oldhost.example.com:2,ST > Start dovecot, select INBOX in Thunderbird for this account, it only > displays these (I got this ls output from AFTER the messages in the > cur directory are deleted per below - before doing any of the 3 > aqctions below, ALL of the messages show in the ls output): > ls -al /.../user/cur No ,ST files, just ,S (Seen). Rick From davide.marchi at mail.cgilfe.it Fri Dec 27 16:33:30 2013 From: davide.marchi at mail.cgilfe.it (Davide) Date: Fri, 27 Dec 2013 15:33:30 +0100 Subject: [Dovecot] Question about mailformat migration Message-ID: <52BD8FBA.1080006@mail.cgilfe.it> Hi to all, my question is if it's possible to retrive only mail location and mailformat with user_query and for authentication to use vpopmail plugins for dovecot version 2.2.5 i want to put a column in my mysql tables that inherit to user (vpopmail db) like "maildir format" -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m at il: *davide.marchi at mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.* From CMarcus at Media-Brokers.com Fri Dec 27 16:33:57 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 09:33:57 -0500 Subject: [Dovecot] Server Migration Attempt - new messages DELETED after secondary rsyncs In-Reply-To: <20131227082849.Horde.vI1Beiv5mtlr8rlFBgp1BA9@www.vfemail.net> References: <52BD8391.2070106@Media-Brokers.com> <20131227082849.Horde.vI1Beiv5mtlr8rlFBgp1BA9@www.vfemail.net> Message-ID: <52BD8FD5.5040401@Media-Brokers.com> On 2013-12-27 9:28 AM, Rick Romero wrote: >> Start dovecot, select INBOX in Thunderbird for this account, it only >> displays these (I got this ls output from AFTER the messages in the >> cur directory are deleted per below - before doing any of the 3 >> aqctions below, ALL of the messages show in the ls output): >> ls -al /.../user/cur > > No ,ST files, just ,S (Seen). Damn! How did I miss that. The 'T' is fo 'trashed', so of course, when the Inbox is expunged, they will be deleted... Thanks Rick, for the gentle clue stick... On 2013-12-27 9:12 AM, Reindl Harald wrote: > why the hell do you do a *second* rsync? Reindl, how the hell did you fall out of my PLONK filter?? -- Best regards, */Charles/*** From Ralf.Hildebrandt at charite.de Fri Dec 27 16:36:47 2013 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 27 Dec 2013 15:36:47 +0100 Subject: [Dovecot] v2.2.10 released In-Reply-To: <290D21FB-FD16-43E9-992A-C2CBD077C53C@iki.fi> References: <290D21FB-FD16-43E9-992A-C2CBD077C53C@iki.fi> Message-ID: <20131227143647.GK366@charite.de> * Timo Sirainen : > http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.10.tar.gz.sig Working OK here! -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From CMarcus at Media-Brokers.com Fri Dec 27 16:37:19 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 09:37:19 -0500 Subject: [Dovecot] SOLVED (user error) - WAS Re: Server Migration Attempt - new messages DELETED after secondary rsyncs In-Reply-To: <52BD8FD5.5040401@Media-Brokers.com> References: <52BD8391.2070106@Media-Brokers.com> <20131227082849.Horde.vI1Beiv5mtlr8rlFBgp1BA9@www.vfemail.net> <52BD8FD5.5040401@Media-Brokers.com> Message-ID: <52BD909F.4090008@Media-Brokers.com> On 2013-12-27 9:33 AM, Charles Marcus wrote: > Damn! How did I miss that. The 'T' is for 'trashed', so of course, > when the Inbox is expunged, they will be deleted... > > Thanks Rick, for the gentle clue stick... Apologies to all for the noise. -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Fri Dec 27 16:44:47 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 09:44:47 -0500 Subject: [Dovecot] SOLVED (user error) WAS Re: Thunderbird message cache out of sync after repetitive rsyncs... In-Reply-To: <52BC8FE0.4030809@Media-Brokers.com> References: <52B9BE0A.2030001@Media-Brokers.com> <3317F06C-DB26-4743-ABBC-76EC07E81760@iki.fi> <52BC7662.6090403@Media-Brokers.com> <52BC7828.7020209@Media-Brokers.com> <84A2EE13-28AD-4083-9820-013C72FD397F@iki.fi> <52BC7D29.6020006@sys4.de> <52BC8FE0.4030809@Media-Brokers.com> Message-ID: <52BD925F.6050606@Media-Brokers.com> Just closing this related thread too... Again apologies to all. This is my first live server migration, so being very careful not to make any mistakes (especially involving losing mail)... On 2013-12-26 3:21 PM, Charles Marcus wrote: > Ok, I'll test two different ways... > > First, I'll test if just deleting the index files on the target before > accessing with Thunderbird shows all files. > > If it doesn't, then I'll test if deleting both the indexes and the > uid* files does the trick. -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Fri Dec 27 16:47:32 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 09:47:32 -0500 Subject: [Dovecot] dovecot-postfix stack imap_client_workarounds In-Reply-To: <52B9B999.5000704@gmail.com> References: <52B9B999.5000704@gmail.com> Message-ID: <52BD9304.3090909@Media-Brokers.com> This is really an ubuntu question... probably why you haven't had any responses. On 2013-12-24 11:43 AM, thufir wrote: > To use dovecot-postfix stack with thunderbird, do I put the > configuration into /usr/share/dovecot/protocols.d/impad.protocol? That > would seem to be how the stack is configured. > > "Thunderbird > > To use with Thunderbird, edit the file /etc/dovecot/dovecot.conf: > > protocol imap { > ... > login_greeting_capability = yes > imap_client_workarounds = tb-extra-mailbox-sep > }" > > > https://help.ubuntu.com/community/Dovecot > > thufir at dur:~$ > thufir at dur:~$ cat /usr/share/dovecot/protocols.d/imapd.protocol > protocols = $protocols imap > thufir at dur:~$ > thufir at dur:~$ dovecot -n > # 2.0.19: /etc/dovecot/dovecot.conf From CMarcus at Media-Brokers.com Fri Dec 27 18:48:42 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 11:48:42 -0500 Subject: [Dovecot] mail_location, user 'home', questions In-Reply-To: <52BC31D2.8050405@Media-Brokers.com> References: <52BC31D2.8050405@Media-Brokers.com> Message-ID: <52BDAF6A.5070402@Media-Brokers.com> On 2013-12-26 8:40 AM, Charles Marcus wrote: > Hi all, > > Ok, another question... > > I always like changes to the default settings whenever possible (KISS > principle)... ??? Must not have had my coffee yet. What that should have said was: "I always like to KEEP the default settings whenever possible..." Anyway, answered this question myself too after looking more closely at the SQL query... -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Fri Dec 27 20:32:22 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 13:32:22 -0500 Subject: [Dovecot] Enabling SIS (single instance storage) Message-ID: <52BDC7B6.8030907@Media-Brokers.com> Ok, didn't find much on this... The bottom of /etc/dovecot/conf.d/10-mail.conf has the following settings: #mail_attachment_dir = #mail_attachment_min_size = 128k #mail_attachment_fs = sis posix #mail_attachment_hash = %{sha1} all of which are apparently the defaults according to doveconf -d output - so no need to set them explicitly, unless I want to change them, right? So, enable the first one - but - the comments don't say anything about supporting variables. I'm assuming you can, otherwise all attachments for all domains would be in a single directory, which some admins might not like (I wouldn't)... so hopefully I can just set it to this: mail_attachment_dir = /var/vmail/%d/.attachments So how does this work during conversion? Users still on maildir simply don't engage it? But as users are converted to dbox, all attachments are de-duped, and then new mails coming in with attachments (for converted users) are de-duped at delivery? The wiki could do with a bit more on enabling and implementing it, especially what to expect when enabling it for the first time on a production system and what to expect along the way when converting existing users... -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Fri Dec 27 20:42:08 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 13:42:08 -0500 Subject: [Dovecot] Migrating from Maildir to dbox+SIS... sdbox or mdbox? Message-ID: <52BDCA00.9050904@Media-Brokers.com> Ok... Now that I've got the niggling issues resolved, on to bigger and better things. I want to convert everyone from Maildir to dbox and enable SIS (our users use a lot of large attachments), and after some reading/googling, I think it may be better to use dsync instead of rsync for the actual migration after all since it will do this at the same time as the syncing. If I'm not mistaken, once I've figured out the correct syntax for the command, I should be able to do the conversion and migration at the same time. So, that is what I want to do, but I still have to choose between sdbox and mdbox. I tend to feel a little safer with sdbox, just because it seems more stable - and I like the idea that if a file gets corrupted somehow, then it is only that one mail that may potentially be lost, but if mdbox indexes get corrupted, you are guaranteed to lose messages (maybe a lot)... But I also really like the idea of an order of magnitude fewer actual files (would make rsync based backups much faster, etc). Timo - the last comments I was able to find from you were back in 2011... would you mind commenting on the current stated of dbox - especially mdbox, as far as reliability goes? The 'scary warnings' about how important the index files are ... well ... scares me... ;) I know there were definitely some issues with mdbox a few years ago - I found the old thread from 2011, but nothing substantial since, so... So... are there any people here, especially larger installs, using mdbox? sdbox? I'd especially be interested in hearing from anyone who has used both, and picked one over the other, and their reasons for doing so. Thanks, -- Best regards, */Charles/* From madduck at madduck.net Fri Dec 27 20:53:33 2013 From: madduck at madduck.net (martin f krafft) Date: Sat, 28 Dec 2013 07:53:33 +1300 Subject: [Dovecot] Sieve's spamtest always returns 0 In-Reply-To: <20131227050416.GA5197@fishbowl.rw.madduck.net> References: <20131227050416.GA5197@fishbowl.rw.madduck.net> Message-ID: <20131227185333.GA28759@fishbowl.rw.madduck.net> also sprach martin f krafft [2013-12-27 18:04 +1300]: > I tested those regular expressions with sed -r, e.g. > > % sed -rne "s@^X-Spam-Status: [^,]*, score=-?[[:digit:]]+\.[[:digit:]] required=(-?[[:digit:]]+\.[[:digit:]]).*@\1 at p" mailfile > 5.0 > > and they work. > > Unfortunately, in sieve scripts, the spamtest value is always 0, > which is indicative of the spamtest "not having run", which in this > case I assume means that the regular expression didn't match. The documentation talks about "POSIX regular expressions", but the examples use extended regexps. This should probably be clarified. However, even if I remove the -r in the above sed call and escape the characters +?(), it does not work. Character classes, such as [:digit:] are available in regular POSIX regexps, to my knowledge. So: the documentation needs clarification, but my problem remains. Yes, I could just "text"-match against X-Spam-Flag (which I now do), but I'd prefer it if the user could match against a spam probability, e.g. already filter if SpamAssassin assigns 6 out of 10 required points. Thanks, -- martin | http://madduck.net/ | http://two.sentenc.es/ "geld ist das brecheisen der macht." - friedrich nietzsche spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From stephan at rename-it.nl Fri Dec 27 21:31:32 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 27 Dec 2013 20:31:32 +0100 Subject: [Dovecot] Sieve's spamtest always returns 0 In-Reply-To: <20131227050416.GA5197@fishbowl.rw.madduck.net> References: <20131227050416.GA5197@fishbowl.rw.madduck.net> Message-ID: <52BDD594.70606@rename-it.nl> On 12/27/2013 6:04 AM, martin f krafft wrote: > X-Spam-Status: Yes, score=84.6 required=5.0 tests=? > > and so I configured spamtest in conf.d/90-plugin.conf like so: > > sieve_spamtest_status_type = score > sieve_spamtest_status_header = X-Spam-Status: [^,]*, score=(-?[[:digit:]]+\.[[:digit:]]).* This configuration is incomplete. Your logs should show an error about that. Testing with sieve-test shows: stephan at klara:~/src/devel$ sieve-test ~/frop.sieve ~/frop.eml sieve-test(stephan): Error: sieve: spamtest: none of sieve_spamtest_max_header or sieve_spamtest_max_value is configured sieve-test(stephan): Error: sieve: spamtest: none of sieve_spamtest_max_header or sieve_spamtest_max_value is configured [...] For example, your config should look like this (with max value 10; i.e., the value beyond which it is spam with 100% certainty): sieve_spamtest_status_type = score sieve_spamtest_status_header = X-Spam-Status: [^,]*, score=(-?[[:digit:]]+\.[[:digit:]]).* sieve_spamtest_max_value = 10 The sieve-test tool can be used to verify: stephan at klara:~/src/devel$ sieve-test -t - -Tlevel=matching ~/frop.sieve ~/frop.eml ## Started executing script 'frop' 3: spamtest test [percent=false] 3: extracted score=84.600, max=10.000, ratio=100 % 3: starting `:is' match with `i;ascii-casemap' comparator: 3: matching value `10' 3: with key `0' => 0 3: finishing match with result: not matched 3: jump if result is false 3: jumping to line 4 ## Finished executing script 'frop' [...] Regards, Stephan. From CMarcus at Media-Brokers.com Fri Dec 27 22:41:52 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 15:41:52 -0500 Subject: [Dovecot] Dovecot 'Submission' service? Message-ID: <52BDE610.5090401@Media-Brokers.com> I do recall this being discussed, but I can't remember if it is actually in a working state now or not. According to the wiki, it is a work in progress: http://wiki2.dovecot.org/Roadmap?highlight=%28submission%29 So - is it in a functional state yet? Thanks, -- Best regards, */Charless/*** From stephan at rename-it.nl Fri Dec 27 23:01:25 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 27 Dec 2013 22:01:25 +0100 Subject: [Dovecot] Dovecot 'Submission' service? In-Reply-To: <52BDE610.5090401@Media-Brokers.com> References: <52BDE610.5090401@Media-Brokers.com> Message-ID: <52BDEAA5.3070809@rename-it.nl> On 12/27/2013 9:41 PM, Charles Marcus wrote: > I do recall this being discussed, but I can't remember if it is > actually in a working state now or not. > > According to the wiki, it is a work in progress: > > http://wiki2.dovecot.org/Roadmap?highlight=%28submission%29 > > So - is it in a functional state yet? It works, but it still needs work. I got a bit distracted by some Dovecot HTTP stuff, so I haven't worked on it for the last few months. The main thing is that I want to restructure it a bit to make a generic SMTP server API, so that no code is duplicated between submission, lmtp, and other future smtp-based services. It still only lives in my patch queue: http://hg.rename-it.nl/dovecot-2.2-patches For (my) convenience, there is a special Xi Debian repository (dovecot-2.2.patched) that includes this patch queue. If you want to test it: configuration should be pretty straightforward. It includes an example configuration fil. I haven't tested it in a while, so it may be broken at the moment. It does still compile though (which is continuously checked by Xi). It won't be included in Dovecot until v2.3. Regards, Stephan. From CMarcus at Media-Brokers.com Fri Dec 27 23:19:44 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 16:19:44 -0500 Subject: [Dovecot] Using DSync to convert from maildir to m/sdbox during migration of mail to new server Message-ID: <52BDEEF0.6020707@Media-Brokers.com> Ok, now to work out the precise method (config for the target server and dsync command) to use to perform the migration from the old server to the new one, converting to dbox (s or m, depending on how the other thread discussing this turns out). I'll update the old server to 2.2.10 tomorrow morning so they're both at the same version. So, assuming both servers are running 2.2.10, with OldServer: mail_location = maildir:~/:INDEX=MEMORY and NewServer: mail_location = sdbox:~/sdbox or mail_location = mdbox:~/mdbox After reading and re-reading: http://wiki2.dovecot.org/Tools/Dsync I'm not so sure... First problem - apparently it can only be used one user at a time? And - do you have to actually know the users password too? If so, then this probably isn't going to be easier, and maybe even harder than just rsyncing everything, then slowly converting each user one at a time. -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Fri Dec 27 23:21:47 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 27 Dec 2013 16:21:47 -0500 Subject: [Dovecot] Dovecot 'Submission' service? In-Reply-To: <52BDEAA5.3070809@rename-it.nl> References: <52BDE610.5090401@Media-Brokers.com> <52BDEAA5.3070809@rename-it.nl> Message-ID: <52BDEF6B.5040808@Media-Brokers.com> On 2013-12-27 4:01 PM, Stephan Bosch wrote: > On 12/27/2013 9:41 PM, Charles Marcus wrote: >> I do recall this being discussed, but I can't remember if it is >> actually in a working state now or not. >> >> According to the wiki, it is a work in progress: >> >> http://wiki2.dovecot.org/Roadmap?highlight=%28submission%29 >> >> So - is it in a functional state yet? > It works, but it still needs work. I got a bit distracted by some > Dovecot HTTP stuff, so I haven't worked on it for the last few months. > The main thing is that I want to restructure it a bit to make a generic > SMTP server API, so that no code is duplicated between submission, lmtp, > and other future smtp-based services. > > It still only lives in my patch queue: > > http://hg.rename-it.nl/dovecot-2.2-patches > > For (my) convenience, there is a special Xi Debian repository > (dovecot-2.2.patched) that includes this patch queue. > > If you want to test it: configuration should be pretty straightforward. > It includes an example configuration fil. I haven't tested it in a > while, so it may be broken at the moment. It does still compile though > (which is continuously checked by Xi). > > It won't be included in Dovecot until v2.3. Thanks for the update Stephen. I may play with it some after the migration, but I'd rather get that done first... -- Best regards, * Charles* From madduck at madduck.net Sat Dec 28 01:43:29 2013 From: madduck at madduck.net (martin f. krafft) Date: Sat, 28 Dec 2013 12:43:29 +1300 Subject: [Dovecot] Sieve's spamtest always returns 0 In-Reply-To: <52BDD594.70606@rename-it.nl> References: <20131227050416.GA5197@fishbowl.rw.madduck.net> <52BDD594.70606@rename-it.nl> Message-ID: <20131227234328.GA8658@fishbowl.rw.madduck.net> also sprach Stephan Bosch [2013-12-28 08:31 +1300]: > This configuration is incomplete. Your logs should show an error about > that. Testing with sieve-test shows: Oh, thank you for introducing me to sieve-test, somehow I have missed that. Sorry! And thank you also for your quick reply! Unfortunately, the problem remains, and sieve-test is not as helpful as I had hoped. My script is attached, as well as the wrapper I use for spamc. Here is the output generated by sieve-test. The spam message is bare and does *not* contain the wanted headers, because those are added by vnd.dovecot.filter invoking spamc: % sieve-test -D -t- -Tlevel=matching -x +spamtest /tmp/spam.sieve /tmp/spam.msg sieve-test(madduck): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. sieve-test(madduck): Debug: sieve: Pigeonhole Sieve Extprograms plugin version 0.1.0 loaded debug: script binary /tmp/spam.svbin successfully loaded. debug: binary save: not saving binary /tmp/spam.svbin, because it is already stored. ## Started executing script 'spam' 6: filter action 6: execute program `spamc' debug: filter action: piping message to program: spamc. debug: filter action: running program: spamc. debug: filter action: piping data to forked program `/etc/dovecot/sieve-filter/spamc'. 6: executed program successfully 6: changed message 8: header test 8: starting `:contains' match with `i;ascii-casemap' comparator: 8: extracting `X-Spam-Status' headers from message 8: matching value `Yes, score=66.5/5.0 tests=ADVANCE_FEE_2_NEW_FORM, ADVANCE_FEE_2_NEW_FRM_MNY,A...' 8: with key `score' => 1 8: finishing match with result: matched 8: jump if result is false 8: not jumping 9: debug_log "X-Spam-Score header present and contains 'score'" spam: line 9: info: DEBUG: X-Spam-Score header present and contains 'score'. 12: spamtest test [percent=false] 12: spamtest: header 'X-Spam-Status' not found in message 12: starting `:value-eq' match with `i;ascii-numeric' comparator: 12: matching value `0' 12: with key `0' => 1 12: finishing match with result: matched 12: jump if result is false 12: not jumping 13: debug_log "spamtest found no match!" spam: line 13: info: DEBUG: spamtest found no match!. 13: jumping to line 51 ## Finished executing script 'spam' Performed actions: (none) Implicit keep: * store message in folder: INBOX sieve-test(madduck): Info: final result: success So, as I had suspected in the original message, spamtest seems to look at the original message, not the one returned from the vnd.dovecot.filter. The regular sieve header match, however, *does* consult the filtered output. So I think that in addition to the clarification about regular vs. extended expressions in the docs, this is also a bug in need of fixing? ? or am I still doing something wrong? -- martin | http://madduck.net/ | http://two.sentenc.es/ "a man's very highest moment is, i have no doubt at all, when he kneels in the dust, and beats his breast, and tells all the sins of his life." -- oscar wilde spamtraps: madduck.bogus at madduck.net -------------- next part -------------- #!/bin/sh set -eu if find /tmp/dovecot-hack -mmin -1 | grep -q /; then exit 1 fi # HACK because vnd.dovecot.filter needs the filter to soak up all input before # it will even start reading its output. TMPFILE=$(tempfile -p spamc) cleanup() { rm -f $TMPFILE; trap - EXIT; } trap cleanup EXIT cat > "$TMPFILE" spamc "$@" < "$TMPFILE" cleanup -------------- next part -------------- require [ "vnd.dovecot.filter"]; require [ "spamtest", "relational", "comparator-i;ascii-numeric" ]; require [ "fileinto", "mailbox" ]; require [ "vnd.dovecot.debug" ]; filter "spamc" [ "--no-safe-fallback" ]; if header :contains "X-Spam-Status" "score" { debug_log "X-Spam-Status header present and contains 'score'"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "0" { debug_log "spamtest found no match!"; } elsif spamtest :value "ge" :comparator "i;ascii-numeric" "2" { if spamtest :value "eq" :comparator "i;ascii-numeric" "1" { debug_log "spamtest value == 1"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "2" { debug_log "spamtest value == 2"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "3" { debug_log "spamtest value == 3"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "4" { debug_log "spamtest value == 4"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "5" { debug_log "spamtest value == 5"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "6" { debug_log "spamtest value == 6"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "7" { debug_log "spamtest value == 7"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "8" { debug_log "spamtest value == 8"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "9" { debug_log "spamtest value == 9"; } if spamtest :value "eq" :comparator "i;ascii-numeric" "10" { debug_log "spamtest value == 10"; } #if header "X-Spam-Flag" "YES" { if mailboxexists "Junk" { debug_log "file spam into existing mailbox 'Junk'"; fileinto "Junk"; } elsif mailboxexists "junk" { debug_log "file spam into existing mailbox 'junk'"; fileinto "junk"; } elsif mailboxexists "spam" { debug_log "file spam into existing mailbox 'spam'"; fileinto "spam"; } else { debug_log "file spam into mailbox 'Spam'"; fileinto :create "Spam"; } stop; debug_log "after stop"; } else { debug_log "spamtest asserts message free of spam"; } -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From cr at sys4.de Sat Dec 28 15:05:55 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Sat, 28 Dec 2013 14:05:55 +0100 Subject: [Dovecot] pop3 rate limit Message-ID: <0F1F4650-52B7-4DC9-800C-A5251EB057B0@sys4.de> Hi, we have customers with Exchange servers that are polling for new mail every minute with dozens of pop3 accounts. I am looking for a mechanism to rate limit this per user. So what I am looking for is a way to block users from polling, if a user asks for new mail more than every 5 minutes (for example). Is this possible? Can this be achieved within Dovecot or does it need external scripting? (I thought about fail2ban, but also want IPv6 support) Thanks in advance -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From genie at geniechka.ru Sun Dec 29 20:31:07 2013 From: genie at geniechka.ru (Eugene) Date: Sun, 29 Dec 2013 22:31:07 +0400 Subject: [Dovecot] LMTP with virtual and system users In-Reply-To: <52BA8668.5000502@zid.tuwien.ac.at> References: <52BA8668.5000502@zid.tuwien.ac.at> Message-ID: <66E6180B5F65459592E002661132DBA4@geniepc2011> Hello, Personally, I think it is more simple and convenient to migrate system users' mail to the virtual-user setup (i.e. two separate logins, e.g. 'user' for SSH and 'user at domain.com' for mail ). Here are the relevant portions of my postfix config: mydestination = localhost local_recipient_maps = $virtual_mailbox_maps $virtual_alias_maps mydomain = domain.com # your 'local' host/domain name myhostname = domain.com # your 'local' host/domain name smtpd_recipient_restrictions = ....., reject_unverified_recipient, ..... # to do LMTP-based verification of incoming mail unknown_local_recipient_reject_code = 550 unverified_recipient_reject_code = 550 virtual_alias_maps = hash:/usr/ext/mail/valias virtual_mailbox_domains = hash:/usr/ext/mail/vdomains virtual_transport = lmtp:unix:private/dovecot-lmtp /usr/ext/mail/valias defines additional redirections like postmaster at domain.com admin at domain.com root at domain.com admin at domain.com /usr/ext/mail/vdomains is an access-map file with records for supported domains, like: domain.com OK Also adjust 'root' record in /etc/mail/aliases to point to qualified admin's mail address (admin at domain.com) Best wishes Eugene -----Original Message----- From: Philipp Kolmann Sent: Wednesday, December 25, 2013 11:16 AM To: Dovecot Mailing List Subject: [Dovecot] LMTP with virtual and system users Hi, I have a mailsystem where i have some local users with shell access and full home dirs which receive mail and also several SQL virtual users only for mail. With the virtual users, everything works fine. Mail is delivered via LMTP and also sieve works :) The SQL Lookup knows what to do with username at domain.com The problem is the system user. If exim delivers the mail to the lmtp socket, the LMTPd can't find username at local.host I would be able to specify the global auth_username_format=%n but then my SQL queries break and I like the possibility to have xx at domain1.com and xx at domain2.com routed to two different accounts. As I have seen in the source, I can't specify username_format=%n in the passdb { driver = pam } backend. Do you have any suggestion how to solve this issue? thanks Philipp From michael at vivid.net.nz Mon Dec 30 03:35:23 2013 From: michael at vivid.net.nz (michael) Date: Mon, 30 Dec 2013 14:35:23 +1300 Subject: [Dovecot] pop3 rate limit Message-ID: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> On 2013-12-29 02:05, Christian R??ner wrote: > Hi, > > we have customers with Exchange servers that are polling for new mail > every minute with dozens of pop3 accounts. I am looking for a > mechanism to rate limit this per user. So what I am looking for is a > way to block users from polling, if a user asks for new mail more > than > every 5 minutes (for example). > > Is this possible? Can this be achieved within Dovecot or does it need > external scripting? (I thought about fail2ban, but also want IPv6 > support) > > Thanks in advance > > -Christian R??ner See: www.policyd.org You'll need to use v2.1 to get IPV6 support. Michael Hallager From mihai at badici.ro Mon Dec 30 00:03:01 2013 From: mihai at badici.ro (Mihai Badici) Date: Mon, 30 Dec 2013 00:03:01 +0200 Subject: [Dovecot] how to separate virtual delivery and authentication? Message-ID: <1728139.NAVRg0enP2@arhivio> I have a "pure ldap" setting with postfix and dovecot. When using dovecot delivery, the recipient is checked via ldap. The same ldap query is used when authenticate. So, if I want to authenticate with the uid , I can't use a filter like uid=%u because the delivery will fail. I don't want to use %nor something else because I could use multiple e-mail addresses on a single account. I actually use a filter like ( mail=%u)|(uid=%u) but I think for more complex situations should be better to have two separate filters, one for authentication and the other for the delivery. What is your oppinion? -- Mihai B?dici http://mihai.badici.ro From mihai at badici.ro Sun Dec 29 11:52:23 2013 From: mihai at badici.ro (Mihai Badici) Date: Sun, 29 Dec 2013 11:52:23 +0200 Subject: [Dovecot] tests with metadata module In-Reply-To: <16526123.pst3BNDYgE@arhivio> References: <16526123.pst3BNDYgE@arhivio> Message-ID: <37523241.XXYUV5FtXJ@arhivio> On Thursday 26 December 2013 12:23:18 you wrote: > --Repost after subscription as list member --- > > I made some tests with metadata support in dovecot 2.2.10. > Previously I had dovecot 2.2.4 with external metadata plugin who work well. > > I use dovecot with roundcube and roundcube plugins from kolab project . > First, the feature activation was tricky and rather undocumented. > I spent about half hour googling, after that I set: > > imap_metadata = yes > and > mail_attribute_dict = file:%h/shared_metadata It worked after I changed here : file:%s/shared_metadata A new folder "imap" was created and the "shared_metadata" file is in that folder. With previous settings that file was in the mailbox root directory and was not properly readed. > > I think you cold put those lines in the 20-imap.conf example file > commented; that way will be easy for us to activate. > > Because I changed the location of shared_metadata, all folders was > unannotated . > I went in folder manager in roundcube and set folder "calendar" as calendar > type and so on. > That worked and i have: > > cat shared_metadata: > shared/c4268a04da44bb527c5b0000193e0904/vendor/kolab/folder-type > event > shared/cd5792367fc9cd5196170000193e0904/vendor/kolab/folder-type > event > shared/33f55d2e8912195209290000193e0904/vendor/kolab/folder-type > event > shared/32f55d2e8912195209290000193e0904/vendor/kolab/folder-type > contact > > > However, it looks like the metadata is not properly read after. Calendar and > Contacts folders don't appear in roundcube. > I have this crash in dovecot's log: > > Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x67d81) > [0xb7625d81] -> /usr/lib/dovecot/libdovecot.so.0(+0x67e11) [0xb7625e11] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75d6af9] -> dovecot/imap() > [0x805d3b2] -> dovecot/imap() [0x805d5bc] -> dovecot/imap() [0x805d6c9] -> > dovecot/imap(client_handle_input+0x56) [0x805d836] -> > dovecot/imap(client_input+0x72) [0x805dcc2] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x38) [0xb7638d98] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x10e) [0xb7639d6e] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb7638818] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x28) [0xb75dcb68] -> > dovecot/imap(main+0x284) [0x8050f34] -> > /lib/libc.so.6(__libc_start_main+0xf5) [0xb743f5a5] -> dovecot/imap() > [0x80510a5] > Dec 26 09:28:49 imap(mihai.badici): Fatal: master: service(imap): child 4919 > killed with signal 6 (core dumps disabled) > > I logged imap sessions in roundcube and I have: > > A0003 GETMETADATA "*" (/private/vendor/kolab/folder-type > /shared/vendor/kolab/folder-type) > > On a similar server with the "old" metadata plugin, I have here listed all > folders with coresponding annotations. > > How I can debug further? This is a test server so I can stress it. -- Mihai B?dici http://mihai.badici.ro From stephan at rename-it.nl Sat Dec 28 10:45:14 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 28 Dec 2013 09:45:14 +0100 Subject: [Dovecot] Sieve's spamtest always returns 0 In-Reply-To: <20131227234328.GA8658@fishbowl.rw.madduck.net> References: <20131227050416.GA5197@fishbowl.rw.madduck.net> <52BDD594.70606@rename-it.nl> <20131227234328.GA8658@fishbowl.rw.madduck.net> Message-ID: <52BE8F9A.7020309@rename-it.nl> On 12/28/2013 12:43 AM, martin f. krafft wrote: > also sprach Stephan Bosch [2013-12-28 08:31 +1300]: >> This configuration is incomplete. Your logs should show an error about >> that. Testing with sieve-test shows: > Oh, thank you for introducing me to sieve-test, somehow I have > missed that. Sorry! > > And thank you also for your quick reply! > > So, as I had suspected in the original message, spamtest seems to > look at the original message, not the one returned from the > vnd.dovecot.filter. The regular sieve header match, however, *does* > consult the filtered output. You are right. This should fix it (and improves test suite): http://hg.rename-it.nl/dovecot-2.2-pigeonhole/rev/f9fd5606b3e7 > So I think that in addition to the clarification about regular vs. > extended expressions in the docs, this is also a bug in need of > fixing? Did that too. Regards, Stephan. From p at sys4.de Mon Dec 30 09:36:51 2013 From: p at sys4.de (Patrick Ben Koetter) Date: Mon, 30 Dec 2013 08:36:51 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> Message-ID: <20131230073651.GB14830@sys4.de> * michael : > On 2013-12-29 02:05, Christian R??ner wrote: > >Hi, > > > >we have customers with Exchange servers that are polling for new mail > >every minute with dozens of pop3 accounts. I am looking for a > >mechanism to rate limit this per user. So what I am looking for is a > >way to block users from polling, if a user asks for new mail more > >than > >every 5 minutes (for example). > > > >Is this possible? Can this be achieved within Dovecot or does it need > >external scripting? (I thought about fail2ban, but also want IPv6 > >support) > > > >Thanks in advance > > > >-Christian R??ner > > See: > www.policyd.org > > You'll need to use v2.1 to get IPV6 support. policyd can rate limit dovecot POP3 users? p at rick -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From michael at vivid.net.nz Mon Dec 30 09:42:02 2013 From: michael at vivid.net.nz (michael) Date: Mon, 30 Dec 2013 20:42:02 +1300 Subject: [Dovecot] pop3 rate limit In-Reply-To: <20131230073651.GB14830@sys4.de> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> Message-ID: >> >Is this possible? Can this be achieved within Dovecot or does it >> need >> >external scripting? (I thought about fail2ban, but also want IPv6 >> >support) >> > >> >Thanks in advance >> > >> >-Christian R??ner >> >> See: >> www.policyd.org >> >> You'll need to use v2.1 to get IPV6 support. > > policyd can rate limit dovecot POP3 users? > > p at rick Yes - put your Dovecot on a dedicated IP address and set a Policyd quota limit based on user IP address. Only option I am aware of to granulate to port level is IP tables (or comparable FW) Cheers, Michael Hallager From rs at sys4.de Mon Dec 30 10:03:43 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 30 Dec 2013 09:03:43 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <0F1F4650-52B7-4DC9-800C-A5251EB057B0@sys4.de> References: <0F1F4650-52B7-4DC9-800C-A5251EB057B0@sys4.de> Message-ID: <52C128DF.9040403@sys4.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Am 28.12.2013 14:05, schrieb Christian R??ner: > Hi, > > we have customers with Exchange servers that are polling for new > mail every minute with dozens of pop3 accounts. I am looking for a > mechanism to rate limit this per user. So what I am looking for is > a way to block users from polling, if a user asks for new mail more > than every 5 minutes (for example). > > Is this possible? Can this be achieved within Dovecot or does it > need external scripting? (I thought about fail2ban, but also want > IPv6 support) Hi Christian, i have about 1000 pop3 logins per minute, with little tuning dovecot has no problem with it but however you may use iptables recent, but for sure its not optimal cause of nat and/or grep login timestamps syslog and echo in deny list http://wiki2.dovecot.org/Authentication/RestrictAccess perhaps fail2ban can be configured to do equal actions > > Thanks in advance > > -Christian R??ner > > -- [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 > M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein > Best Regards MfG Robert Schetterer - -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJSwSjZAAoJEP8jBObu0LlE1n0IALpzRi2k7QaDkILMthMcRZwz K7ukF0EVZmtGUt8uFJiEW1hWyyWRM3F5/KCwK7d39mTA+fEo54GhoAzrQrJkomnO z+N3qWUj8MbKNx6vNbMH6b6qpSPKIPr913Al2vhxQ4Mp2EYI/630Xu1GuVVCzWyI cUURYWFwNBNwExzzphYgKS8V1MU6EBt1g/ElaYY0uVwH0m3f8kxmLNbaswuQ5pga dczxDtcIzMCsK/bxoSot8SKpSmNOkLEexBM5rb8UWKmHXFym1vTdHQHf/gYsAuv2 7ePsUcG3JCQO5pfi6q6psFDFTodXNttS89Np+0tdwVLqoSZ3DA3rdpknjnQALXQ= =cYCD -----END PGP SIGNATURE----- From kolmann at zid.tuwien.ac.at Mon Dec 30 10:40:58 2013 From: kolmann at zid.tuwien.ac.at (Philipp Kolmann) Date: Mon, 30 Dec 2013 09:40:58 +0100 Subject: [Dovecot] LMTP with virtual and system users In-Reply-To: <52BC10F6.7070306@ente.limmat.ch> References: <52BA8668.5000502@zid.tuwien.ac.at> <52BC10F6.7070306@ente.limmat.ch> Message-ID: <52C1319A.6070309@zid.tuwien.ac.at> Hi Adrian, Am 26.12.2013 12:20, schrieb Adrian Zaugg: > You can use exim to prepare the address as you wish: only the user name > for pam users and the full address for virtual users. > > Configure a new router to strip the domain part for pam users: > > local_pam_users: > debug_print = "R: strip domain for local pam users" > driver = redirect > check_local_user > domains = @ : localhost : ${primary_hostname} > data = ${local_part} > redirect_router = local_user > > I'm not 100% sure of the domains condition; it should restrict the > router to your domain(s) where your pam users receive their email. The > redirect_router designates the router which routes your local deliveries > to your lmtp transport. Place the new router to run just before your > "local_user" router. > > Since your config works for your virtual users, you don't need to do > anything in addition. I had tried this once already. I have used your snipplet and attached the debug output from exim. Sadly it didn't work, because the mtp process got the foll email again and not just the username. thanks Philipp -- ----------------------------------------------------------------------- DI Mag. Philipp Kolmann mail: kolmann at zid.tuwien.ac.at Technische Universitaet Wien web: www.zid.tuwien.ac.at Zentraler Informatikdienst (ZID) tel: +43(1)58801-42011 Wiedner Hauptstr. 8-10, A-1040 Wien DVR: 0005886 ----------------------------------------------------------------------- -------------- next part -------------- 17788 --------> local_pam_users router <-------- 17788 local_part=pkolmann domain=lukas.rudolfina.at 17788 checking domains 17788 lukas.rudolfina.at in "@ : localhost : lukas.rudolfina.at"? yes (matched "@") 17788 checking for local user 17788 seeking password data for user "pkolmann": using cached result 17788 getpwnam() succeeded uid=1002 gid=1002 17788 R: strip domain for local pam users 17788 calling local_pam_users router 17788 rda_interpret (string): ${local_part} 17788 expanded: pkolmann 17788 file is not a filter file 17788 parse_forward_list: pkolmann 17788 extract item: pkolmann 17788 local_pam_users router generated pkolmann at lukas.rudolfina.at 17788 errors_to=NULL transport=NULL 17788 uid=unset gid=unset home=NULL 17788 routed by local_pam_users router 17788 envelope to: pkolmann at lukas.rudolfina.at 17788 transport: 17788 locking /var/spool/exim4/db/retry.lockfile 17788 locked /var/spool/exim4/db/retry.lockfile 17788 EXIM_DBOPEN(/var/spool/exim4/db/retry) 17788 returned from EXIM_DBOPEN 17788 opened hints database /var/spool/exim4/db/retry: flags=O_RDONLY 17788 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 17788 Considering: pkolmann at lukas.rudolfina.at 17788 unique = \0\pkolmann at lukas.rudolfina.at 17788 dbfn_read: key=R:lukas.rudolfina.at 17788 dbfn_read: key=R:pkolmann at lukas.rudolfina.at 17788 dbfn_read: key=R:pkolmann at lukas.rudolfina.at: 17788 no domain retry record 17788 no address retry record 17788 pkolmann at lukas.rudolfina.at: queued for routing 17788 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 17788 routing pkolmann at lukas.rudolfina.at 17788 --------> local_user router <-------- 17788 local_part=pkolmann domain=lukas.rudolfina.at 17788 checking domains 17788 search_open: mysql "NULL" 17788 cached open 17788 search_find: file="NULL" 17788 key="SELECT domain FROM domain WHERE domain='lukas.rudolfina.at';" partial=-1 affix=NULL starflags=0 17788 LRU list: 17788 :/etc/aliases 17788 End 17788 internal_search_find: file="NULL" 17788 type=mysql key="SELECT domain FROM domain WHERE domain='lukas.rudolfina.at';" 17788 cached data used for lookup of SELECT domain FROM domain WHERE domain='lukas.rudolfina.at'; 17788 lookup failed 17788 lukas.rudolfina.at in "@:localhost:"? yes (matched "@") 17788 lukas.rudolfina.at in "+local_domains"? yes (matched "+local_domains") 17788 checking local_parts 17788 pkolmann in "! root"? yes (end of list) 17788 checking for local user 17788 seeking password data for user "pkolmann": using cached result 17788 getpwnam() succeeded uid=1002 gid=1002 17788 R: local_user for pkolmann at lukas.rudolfina.at 17788 calling local_user router 17788 local_user router called for pkolmann at lukas.rudolfina.at 17788 domain = lukas.rudolfina.at 17788 set transport dovecot_lmtp 17788 queued for dovecot_lmtp transport: local_part = pkolmann 17788 domain = lukas.rudolfina.at 17788 errors_to=NULL 17788 domain_data=NULL localpart_data=NULL 17788 routed by local_user router 17788 envelope to: pkolmann at lukas.rudolfina.at 17788 transport: dovecot_lmtp 17788 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 17788 After routing: 17788 Local deliveries: 17788 pkolmann at lukas.rudolfina.at 17788 Remote deliveries: 17788 Failed addresses: 17788 Deferred addresses: 17788 search_tidyup called 17788 close MYSQL connection: localhost/exim/exim 17788 >>>>>>>>>>>>>>>> Local deliveries >>>>>>>>>>>>>>>> 17788 --------> pkolmann at lukas.rudolfina.at <-------- 17788 locking /var/spool/exim4/db/retry.lockfile 17788 locked /var/spool/exim4/db/retry.lockfile 17788 EXIM_DBOPEN(/var/spool/exim4/db/retry) 17788 returned from EXIM_DBOPEN 17788 opened hints database /var/spool/exim4/db/retry: flags=O_RDONLY 17788 dbfn_read: key=T:pkolmann at lukas.rudolfina.at 17788 no retry record exists 17788 search_tidyup called 17791 changed uid/gid: local delivery to pkolmann transport=dovecot_lmtp 17791 uid=1002 gid=1002 pid=17791 17791 auxiliary group list: 17791 home=/home/pkolmann current=/home/pkolmann 17791 set_process_info: 17791 delivering 1VxWnG-0004cr-Cr to pkolmann using dovecot_lmtp 17791 dovecot_lmtp transport entered 17791 using socket /var/run/dovecot/lmtp 17791 LMTP<< 220 lukas.rudolfina.at Dovecot ready. 17791 LMTP>> LHLO lukas.rudolfina.at 17791 LMTP<< 250-lukas.rudolfina.at 17791 LMTP<< 250-8BITMIME 17791 LMTP<< 250-ENHANCEDSTATUSCODES 17791 LMTP<< 250 PIPELINING 17791 LMTP>> MAIL FROM: 17791 LMTP<< 250 2.1.0 OK 17791 LMTP>> RCPT TO: 17791 LMTP<< 550 5.1.1 User doesn't exist: pkolmann at lukas.rudolfina.at 17791 LMTP>> QUIT 17791 LMTP<< 221 2.0.0 Client quit 17791 dovecot_lmtp transport yields 1 17791 search_tidyup called 17788 dovecot_lmtp transport returned FAIL for pkolmann at lukas.rudolfina.at 17788 post-process pkolmann at lukas.rudolfina.at (2) 17788 LOG: MAIN 17788 ** pkolmann at lukas.rudolfina.at R=local_user T=dovecot_lmtp: LMTP error after RCPT TO:: 550 5.1.1 User doesn't exist: pkolmann at lukas.rudolfina.at 17788 >>>>>>>>>>>>>>>> deliveries are done >>>>>>>>>>>>>>>> From me at junc.eu Mon Dec 30 11:53:41 2013 From: me at junc.eu (Benny Pedersen) Date: Mon, 30 Dec 2013 10:53:41 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> Message-ID: <93d84d9a92e9e8dc431bde731eacfa90@junc.eu> michael skrev den 2013-12-30 02:35: > www.policyd.org > You'll need to use v2.1 to get IPV6 support. incorrect, policyd v1 still supports ipv6 greylistning, but it cant be used as a ipv6 server from postfix is another problem same holds water with sqlgrey From me at junc.eu Mon Dec 30 11:57:13 2013 From: me at junc.eu (Benny Pedersen) Date: Mon, 30 Dec 2013 10:57:13 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <20131230073651.GB14830@sys4.de> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> Message-ID: <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> Patrick Ben Koetter skrev den 2013-12-30 08:36: > policyd can rate limit dovecot POP3 users? sure :) i just think dovecot does it better last resort would be ip6table/iptable From michael at vivid.net.nz Mon Dec 30 11:59:07 2013 From: michael at vivid.net.nz (michael) Date: Mon, 30 Dec 2013 22:59:07 +1300 Subject: [Dovecot] pop3 rate limit In-Reply-To: <93d84d9a92e9e8dc431bde731eacfa90@junc.eu> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <93d84d9a92e9e8dc431bde731eacfa90@junc.eu> Message-ID: On 2013-12-30 22:53, Benny Pedersen wrote: > michael skrev den 2013-12-30 02:35: > >> www.policyd.org >> You'll need to use v2.1 to get IPV6 support. > > incorrect, policyd v1 still supports ipv6 greylistning, but it cant > be used as a ipv6 server from postfix is another problem > > same holds water with sqlgrey v2.0 is supposed to support IPV6 but it is buggy (in my experience unusable). This is why I recommended v2.1 ewven though it is still in development. From grobian at gentoo.org Mon Dec 30 13:34:22 2013 From: grobian at gentoo.org (Fabian Groffen) Date: Mon, 30 Dec 2013 12:34:22 +0100 Subject: [Dovecot] dsync-local crashes due to assertion failures In-Reply-To: <20131208152614.GI993@gentoo.org> References: <20131208152614.GI993@gentoo.org> Message-ID: <20131230113422.GO77699@gentoo.org> On 08-12-2013 16:26:15 +0100, Fabian Groffen wrote: > I have two servers that share nothing, running dovecot version 2.2.9. > The first server hosts the original mail base, which I want to sync > using dovecot to the second server. With some trial and error I managed > to get synchronisation running using tcp sockets. Now for some accounts > I see dsync-local crashing on the server that has the original mail base > (which is still the only of the two that receives new mail). The log > shows: > > Dec 8 03:13:14 zeus dovecot: dsync-local(someuser): Panic: file mail-index-tr > ansaction-export.c: line 203 (log_append_ext_hdr_update): assertion failed: (u32 > .offset + u32.size <= ext_hdr_size) Turns out I didn't remove all index files. After I did (dovecot.index + dovecot.list.index) the assertion has gone away. Interesting side-note: after removal of the indices, some of my mailboxes showed new emails from long ago, that I hadn't seen previously. Now, from the first look and sizes, synchronisation seems to have succeeded after a night. -- Fabian Groffen Gentoo on a different level -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 195 bytes Desc: Digital signature URL: From giovanni at neweden.uk.to Mon Dec 30 15:29:55 2013 From: giovanni at neweden.uk.to (giovanni at neweden.uk.to) Date: Mon, 30 Dec 2013 14:29:55 +0100 Subject: [Dovecot] =?utf-8?q?dovecot_2=2E2=2E10_-_imap=3A_Error=3A_Can=27t?= =?utf-8?q?_load_plugin_imap=5Fstats=5Fplugin=3A?= Message-ID: <1f552b0b34af65036e66060b14639646@neweden.uk.to> dovecot 2.2.10 is raising this error on my installation. Dec 30 13:57:59 imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: mail_plugins=$mail_plugins stats) Dec 30 13:57:59 imap: Fatal: Couldn't load required plugins This error occurs at logging phase. The dovecot configuration looks correct to me, here below an excerpt of it: ... ... mail_plugins=$mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats } plugin { # how often to session statistics stats_refresh = 30 secs # track per-IMAP command statistics stats_track_cmds = yes } ... ... I was already using this configuration but only now I am getting this error. From STRACE I see that the stat plugin is correctly localed . Is anybody else getting this error? or am I missing something? Here below an except of the strace message. [pid 17112] open("/usr/local/lib/dovecot/lib95_imap_stats_plugin.so", O_RDONLY) = 14 [pid 17112] read(14, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0`\t\0\0004\0\0\0"..., 512) = 512 [pid 17112] fstat64(14, {st_mode=S_IFREG|0755, st_size=53122, ...}) = 0 [pid 17112] mmap2(NULL, 8908, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 14, 0) = 0xf7609000 [pid 17112] mmap2(0xf760b000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 14, 0x1) = 0xf760b000 [pid 17112] close(14) = 0 [pid 17112] open("/usr/local/lib/dovecot/lib90_stats_plugin.so", O_RDONLY) = 14 [pid 17112] read(14, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0@\24\0\0004\0\0\0"..., 512) = 512 [pid 17112] fstat64(14, {st_mode=S_IFREG|0755, st_size=100054, ...}) = 0 [pid 17112] mmap2(NULL, 20320, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 14, 0) = 0xf7604000 [pid 17112] mmap2(0xf7608000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 14, 0x3) = 0xf7608000 [pid 17112] close(14) = 0 [pid 17112] write(2, "\1\01017112 prefix=imap: \n", 22) = 22 [pid 17112] write(2, "\1\00417112 Can't load plugin imap_s"..., 127) = 127 [pid 17112] munmap(0xf7609000, 8908) = 0 [pid 17112] munmap(0xf7604000, 20320) = 0 [pid 17112] write(2, "\1\00517112 Couldn't load required p"..., 39) = 39 [pid 17112] exit_group(89) = ? Process 17112 detached From h.reindl at thelounge.net Mon Dec 30 15:33:43 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 30 Dec 2013 14:33:43 +0100 Subject: [Dovecot] dovecot 2.2.10 - imap: Error: Can't load plugin imap_stats_plugin: In-Reply-To: <1f552b0b34af65036e66060b14639646@neweden.uk.to> References: <1f552b0b34af65036e66060b14639646@neweden.uk.to> Message-ID: <52C17637.9080600@thelounge.net> Am 30.12.2013 14:29, schrieb giovanni at neweden.uk.to: > dovecot 2.2.10 is raising this error on my installation. > > Dec 30 13:57:59 imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: > mail_plugins=$mail_plugins stats) > Dec 30 13:57:59 imap: Fatal: Couldn't load required plugins > > This error occurs at logging phase. > > The dovecot configuration looks correct to me, here below an excerpt of it: how do you come to that conclusion by quoting the error above? "you must set: mail_plugins=$mail_plugins stats" and have "stats" *not* configured - notice the word *also* above > mail_plugins=$mail_plugins stats > protocol imap { > mail_plugins = $mail_plugins imap_stats > } > plugin { > # how often to session statistics > stats_refresh = 30 secs > # track per-IMAP command statistics > stats_track_cmds = yes > } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From h.reindl at thelounge.net Mon Dec 30 15:43:09 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 30 Dec 2013 14:43:09 +0100 Subject: [Dovecot] dovecot 2.2.10 - imap: Error: Can't load plugin imap_stats_plugin: In-Reply-To: <52C17637.9080600@thelounge.net> References: <1f552b0b34af65036e66060b14639646@neweden.uk.to> <52C17637.9080600@thelounge.net> Message-ID: <52C1786D.1000602@thelounge.net> Am 30.12.2013 14:33, schrieb Reindl Harald: > Am 30.12.2013 14:29, schrieb giovanni at neweden.uk.to: >> dovecot 2.2.10 is raising this error on my installation. >> >> Dec 30 13:57:59 imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: >> mail_plugins=$mail_plugins stats) >> Dec 30 13:57:59 imap: Fatal: Couldn't load required plugins >> >> This error occurs at logging phase. >> >> The dovecot configuration looks correct to me, here below an excerpt of it: > > how do you come to that conclusion by quoting the error above? > "you must set: mail_plugins=$mail_plugins stats" and have > "stats" *not* configured - notice the word *also* above > >> mail_plugins=$mail_plugins stats >> protocol imap { >> mail_plugins = $mail_plugins imap_stats >> } >> plugin { >> # how often to session statistics >> stats_refresh = 30 secs >> # track per-IMAP command statistics >> stats_track_cmds = yes >> } sorry - indeed i missed the first line and faced only "mail_plugins" in the imap section :-( -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From mihai at badici.ro Mon Dec 30 16:25:12 2013 From: mihai at badici.ro (Mihai Badici) Date: Mon, 30 Dec 2013 16:25:12 +0200 Subject: [Dovecot] tests with metadata module In-Reply-To: <37523241.XXYUV5FtXJ@arhivio> References: <16526123.pst3BNDYgE@arhivio> <37523241.XXYUV5FtXJ@arhivio> Message-ID: <2076911.g1DvFl5trc@arhivio> On Sunday 29 December 2013 11:52:23 Mihai Badici wrote: > On Thursday 26 December 2013 12:23:18 you wrote: > > --Repost after subscription as list member --- > > > > I made some tests with metadata support in dovecot 2.2.10. > > Previously I had dovecot 2.2.4 with external metadata plugin who work > > well. > > > > I use dovecot with roundcube and roundcube plugins from kolab project . > > First, the feature activation was tricky and rather undocumented. > > I spent about half hour googling, after that I set: > > > > imap_metadata = yes > > and > > mail_attribute_dict = file:%h/shared_metadata > > It worked after I changed here : file:%s/shared_metadata I made some investigation and I found Roundcube perform a GETMETADATA "*" (/private/vendor/kolab/folder-type) to list all special folders. In cmd-getmetadata.c there is a "if" (line 455) who is intended, I think, to avoid the use of wildcards in mailbox name, but at the end the result is an attempt to open a NULL mailbox name who produce the crash. When I remove this condition and recompile dovecot, there are no crashes. It's not clear for me if GETMETADATA "*" is still legal (there is a reference to rfc 5464 in the code) ; but in both cases there is a bug in the code. From alec at alec.pl Mon Dec 30 17:48:58 2013 From: alec at alec.pl (A.L.E.C) Date: Mon, 30 Dec 2013 16:48:58 +0100 Subject: [Dovecot] tests with metadata module In-Reply-To: <2076911.g1DvFl5trc@arhivio> References: <16526123.pst3BNDYgE@arhivio> <37523241.XXYUV5FtXJ@arhivio> <2076911.g1DvFl5trc@arhivio> Message-ID: <52C195EA.9060105@alec.pl> On 12/30/2013 03:25 PM, Mihai Badici wrote: > I made some investigation and I found Roundcube perform a > GETMETADATA "*" (/private/vendor/kolab/folder-type) > to list all special folders. This is indeed not specified in RFC5464, but it was in ANNOTATEMORE extension draft. This is very handy and it is supported by Cyrus. Timo fixed this in http://hg.dovecot.org/dovecot-2.2/rev/0c3071ebe44b one day before 2.2.10 release. Didn't it make to the release? -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From duihi77 at gmail.com Mon Dec 30 17:59:37 2013 From: duihi77 at gmail.com (Duane Hill) Date: Mon, 30 Dec 2013 15:59:37 +0000 Subject: [Dovecot] pop3 rate limit In-Reply-To: <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> Message-ID: <3210472231.20131230155937@gmail.com> Hello Benny, Monday, December 30, 2013, 9:57:13 AM, you wrote: > Patrick Ben Koetter skrev den 2013-12-30 08:36: >> policyd can rate limit dovecot POP3 users? > sure :) > i just think dovecot does it better > last resort would be ip6table/iptable We're talking Dovecot, not Postfix. Policyd AFAIK is ran as a policy from within Postfix. That would be over SMTP and not POP3. If there is some config within Dovecot to allow usage of policys written for Postfix, please point that out. Searching the policyd.org site for terms like 'POP3' or 'Dovecot' yield no results. -- Best regards, Duane mailto:duihi77 at gmail.com From sca at andreasschulze.de Mon Dec 30 18:00:05 2013 From: sca at andreasschulze.de (Andreas Schulze) Date: Mon, 30 Dec 2013 17:00:05 +0100 Subject: [Dovecot] tests with metadata module In-Reply-To: <52C195EA.9060105@alec.pl> References: <16526123.pst3BNDYgE@arhivio> <37523241.XXYUV5FtXJ@arhivio> <2076911.g1DvFl5trc@arhivio> <52C195EA.9060105@alec.pl> Message-ID: <20131230170005.Horde.Rx2kfrq0uDBsrFaH36LsRA1@horde.andreasschulze.de> Zitat von "A.L.E.C" : > Timo fixed this in http://hg.dovecot.org/dovecot-2.2/rev/0c3071ebe44b > one day before 2.2.10 release. Didn't it make to the release? yes From mihai at badici.ro Mon Dec 30 18:05:39 2013 From: mihai at badici.ro (Mihai Badici) Date: Mon, 30 Dec 2013 18:05:39 +0200 Subject: [Dovecot] tests with metadata module In-Reply-To: <52C195EA.9060105@alec.pl> References: <16526123.pst3BNDYgE@arhivio> <2076911.g1DvFl5trc@arhivio> <52C195EA.9060105@alec.pl> Message-ID: <6429423.JUf8vYx5SM@arhivio> On Monday 30 December 2013 16:48:58 A.L.E.C wrote: > On 12/30/2013 03:25 PM, Mihai Badici wrote: > > I made some investigation and I found Roundcube perform a > > GETMETADATA "*" (/private/vendor/kolab/folder-type) > > to list all special folders. > > This is indeed not specified in RFC5464, but it was in ANNOTATEMORE > extension draft. This is very handy and it is supported by Cyrus. > > Timo fixed this in http://hg.dovecot.org/dovecot-2.2/rev/0c3071ebe44b > one day before 2.2.10 release. Didn't it make to the release? I will check further. Dovecot crashes only in some particular conditions but it looks like is related with this "*" . There are values for " mail_location" and "mail_attribute_dict" who crash dovecot. With: mail_location = maildir:~/MAILDIR and mail_attribute_dict= file:%u/shared_metadata dovecot works well. So I think the fix is applied but there is a side effect remaining. -- Mihai B?dici http://mihai.badici.ro From cr at sys4.de Mon Dec 30 18:28:33 2013 From: cr at sys4.de (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Mon, 30 Dec 2013 17:28:33 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <3210472231.20131230155937@gmail.com> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> <3210472231.20131230155937@gmail.com> Message-ID: <666F1B19-DC75-4CB7-BB47-42E6BC318C42@sys4.de> Hi, >>> policyd can rate limit dovecot POP3 users? > >> sure :) > >> i just think dovecot does it better > >> last resort would be ip6table/iptable > > We're talking Dovecot, not Postfix. Policyd AFAIK is ran as a policy > from within Postfix. That would be over SMTP and not POP3. > > If there is some config within Dovecot to allow usage of policys > written for Postfix, please point that out. > > Searching the policyd.org site for terms like 'POP3' or 'Dovecot' > yield no results. That?s what I thought ;-) In fact I would have to write an external policy service that really counts user/time. But as Robert said, there seems not to be a bigger problem with lots of connections, so I do not try to find a solution here anymore :-) Thanks everybody -Christian R??ner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From me at junc.eu Mon Dec 30 18:30:41 2013 From: me at junc.eu (Benny Pedersen) Date: Mon, 30 Dec 2013 17:30:41 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <3210472231.20131230155937@gmail.com> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> <3210472231.20131230155937@gmail.com> Message-ID: Duane Hill skrev den 2013-12-30 16:59: > Searching the policyd.org site for terms like 'POP3' or 'Dovecot' > yield no results. yes if its undokumented, then its unsupported, if dovecot anvil / dovecot pop3 cant do it then it could be added, if pop3 is a problem why not change to imap ?, where idle is supported else its more or less just possible to use iptable recent to limit it From me at junc.eu Mon Dec 30 18:33:45 2013 From: me at junc.eu (Benny Pedersen) Date: Mon, 30 Dec 2013 17:33:45 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: <666F1B19-DC75-4CB7-BB47-42E6BC318C42@sys4.de> References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> <3210472231.20131230155937@gmail.com> <666F1B19-DC75-4CB7-BB47-42E6BC318C42@sys4.de> Message-ID: <03bbcebe0ada090dabab34e1e993ba92@junc.eu> Christian R??ner skrev den 2013-12-30 17:28: > That?s what I thought ;-) > > In fact I would have to write an external policy service that really > counts user/time. But as Robert said, there seems not to be a bigger > problem with lots of connections, so I do not try to find a solution > here anymore :-) think of rsyslog, that update dovecot sql table pop3 enable disable ? :=) sorry just thinking loudly now, so close to new years eye From alex.vitola at gmail.com Mon Dec 30 18:34:51 2013 From: alex.vitola at gmail.com (Alex Vitola) Date: Mon, 30 Dec 2013 14:34:51 -0200 Subject: [Dovecot] Warning: fscking index file /.../dovecot.index Message-ID: We have often found the below error in VPS servers using OpenVZ, and some cases using OpenStack, in neither case is used for storage or sharing ISCSI or NFS Client can not receive messages via POP3 or IMAP In /var/log/maillog the message below is seen Oct 31 15:28:26 vps dovecot: pop3(user at domain.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718e07400] -> /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718e07456] -> /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718e06df3] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718b6566b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x89) [0x2b3718b5ced9] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718aeae4d] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718aea357] -> /usr/lib64/dovecot/libdovecot-storage.so.0 [0x2b3718aea698] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xbb) [0x2b3718aea83b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x2b3718b15e31] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x2b3718b18537] -> dovecot/pop3(client_create+0x332) [0x405702] -> dovecot/pop3 [0x40414b] -> dovecot/pop3 [0x404708] -> /usr/lib64/dovecot/libdovecot.so.0 [0x2b3718dc9a52] -> /usr/lib Both POP3 as IMAP Oct 31 15:24:42 vps dovecot: imap(user at domain.com): Warning: fscking index file /home/user/mail/domain.com/user/dovecot.index Oct 31 15:28:26 vps dovecot: pop3(user at domain.com): Warning: fscking index file /home/user/mail/domain.com/user/dovecot.index Today I do to solve this the procedure below - Access the directory mailbox - Remove files dovecot.index * - Run the command doveadm index-u $ user @ $ domain-q INBOX The question is for what reason this only occurs with VPS servers, I do not find this error on any single physical server to virtual and dovecot settings are the same. att Alex Vitola From h.reindl at thelounge.net Mon Dec 30 18:35:30 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 30 Dec 2013 17:35:30 +0100 Subject: [Dovecot] pop3 rate limit In-Reply-To: References: <836fe5967c1d2365522d20ab6fa36b7e@mail.vivid.net.nz> <20131230073651.GB14830@sys4.de> <94c421c4ff4dc04e435a7225108f1dfb@junc.eu> <3210472231.20131230155937@gmail.com> Message-ID: <52C1A0D2.80608@thelounge.net> Am 30.12.2013 17:30, schrieb Benny Pedersen: > Duane Hill skrev den 2013-12-30 16:59: >> Searching the policyd.org site for terms like 'POP3' or 'Dovecot' >> yield no results. > > yes if its undokumented, then its unsupported so what you are talking about? > if dovecot anvil / dovecot pop3 cant do it then it could be added if it could cook it would not by a mobile-phone or what? > if pop3 is a problem why not change to imap ?, where idle is supported why not stop talking about things you do not understand? read the OP again - the topic is fetch email with exchange-connector > else its more or less just possible to use iptable recent to limit it yes, but that was not the question -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From gayleard at alice.it Tue Dec 31 01:44:19 2013 From: gayleard at alice.it (Timothy Murphy) Date: Tue, 31 Dec 2013 00:44:19 +0100 Subject: [Dovecot] How to add dovecot plugin? Message-ID: <2231863.KVE73dvfK2@rose.gayleard.eu> I'm running dovecot version 2.0.9 under CentOS-6.5 . I want to add the following plugin: ==================== require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Spam"; } ==================== Could some kind soul tell me where exactly I should place this script (eg "anywhere in /etc/dovecot/dovecot.conf" or "anywhere in /etc/dovecot/conf.d/90-plugin.conf"), and do I need to take any other action? Actually, the folder I should like spam to go to is ~/Maildir/.Spam/cur/ - should I modify the above script? If these queries are anwered clearly in some dovecot documentation, please point me to that. -- Timothy Murphy e-mail: gayleard /at/ eircom.net School of Mathematics, Trinity College, Dublin 2, Ireland From h.reindl at thelounge.net Tue Dec 31 05:02:06 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 31 Dec 2013 04:02:06 +0100 Subject: [Dovecot] How to add dovecot plugin? In-Reply-To: <2231863.KVE73dvfK2@rose.gayleard.eu> References: <2231863.KVE73dvfK2@rose.gayleard.eu> Message-ID: <52C233AE.3070401@thelounge.net> Am 31.12.2013 00:44, schrieb Timothy Murphy: > I'm running dovecot version 2.0.9 under CentOS-6.5 . > I want to add the following plugin: > ==================== > require "fileinto"; > if header :contains "X-Spam-Flag" "YES" { > fileinto "Spam"; > } > ==================== > Could some kind soul tell me where exactly I should place this script > (eg "anywhere in /etc/dovecot/dovecot.conf" > or "anywhere in /etc/dovecot/conf.d/90-plugin.conf"), > and do I need to take any other action? > > Actually, the folder I should like spam to go to is > ~/Maildir/.Spam/cur/ - should I modify the above script? > > If these queries are anwered clearly in some dovecot documentation, > please point me to that this is a *sieve script* not a plugin itself http://wiki2.dovecot.org/Pigeonhole/Sieve -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: