From skdovecot at smail.inf.fh-brs.de Tue Mar 1 07:50:50 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 1 Mar 2016 08:50:50 +0100 (CET) Subject: Returning custom autoexpunge for user's INBOX In-Reply-To: <776B1657-FE9F-40F1-836B-0412E54A9211@terramar.net> References: <776B1657-FE9F-40F1-836B-0412E54A9211@terramar.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 29 Feb 2016, Tom Johnson wrote: > I want to be able to have custom autoexpunge settings for different users. > > I have it working for various folders (draft, junk, trash), but I can't seem to get it working for the user's primary inbox. How did you've configured autoexpunge for the primary INBOX in the conf-files? > In my user_query (I'm using mysql), I'm returning entries like this in the userdb_import field: > > namespace/inbox/mailbox/autoexpunge=5d namespace/inbox/mailbox/Drafts/autoexpunge=5d namespace/inbox/mailbox/Junk/autoexpunge=5d namespace/inbox/mailbox/Trash/autoexpunge=5d > > > And everything works fine for Drafts, Junk, and Trash, but not for the main inbox. The logs show: > > Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/autoexpunge=5d > > I've also tried variations, trying to get the namespace correct for the main inbox, but they all get the same "Unknown userdb setting" error: > > namespace/inbox/mailbox/autoexpunge=5d > namespace/inbox/mailbox/inbox/autoexpunge=5d > namespace/inbox/mailbox/Inbox/autoexpunge=5d > namespace/inbox/mailbox/INBOX/autoexpunge=5d > > I suspect I'm just giving the wrong namespace for the primary inbox. > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVtVJ2nz1H7kL/d9rAQIvbQgAk9iLNsHGKpLeZpRC52yAMhfvLaOClCd1 /FcW8CI6J/Wk7GBdpk4qFaIDyttF1XBa/srXMer23xOR/AJnpRX04ibhBQlCQvad IbMeR+6Mi98tP7qrLlqs61r35lFhOwmWVHKVrAyBoZ2KyvMpgFA+u3yo3Zx2d9z2 romvqK3xtOZJPg/5VgrcKB/UftIpTkthvH+Lsiwtr4WZ/hezbo3cM1aI2ElL2zx0 eLTyHH6MdUJWh0j7s441Ouq4DcSOg489E7D+Um89q2/JwrDSqnzJsKHoYLuuMKHM C0NLspwhP2EHQ8WnodlA+0aPr2zO+sCoVd5HxUatZ2020MFquF5qQA== =mC2X -----END PGP SIGNATURE----- From pkoorts at host-it.co.uk Tue Mar 1 10:50:28 2016 From: pkoorts at host-it.co.uk (Pieter Koorts) Date: Tue, 1 Mar 2016 10:50:28 +0000 Subject: What happened to dovecot.fi? Message-ID: Hi All, Any news about what happened to dovecot.fi ? Is enterprise or the S3 backend plugin still available? Reason for asking is every attempt to access the dovecot.fi website shows it as down and has done for a while. Pieter From aki.tuomi at dovecot.fi Tue Mar 1 11:03:34 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Tue, 1 Mar 2016 13:03:34 +0200 Subject: What happened to dovecot.fi? In-Reply-To: References: Message-ID: <56D57706.4000504@dovecot.fi> On 01.03.2016 12:50, Pieter Koorts wrote: > Hi All, > > Any news about what happened to dovecot.fi ? > Is enterprise or the S3 backend plugin still available? > > Reason for asking is every attempt to access the dovecot.fi website shows it as down and has done for a while. > > Pieter Hi! We are currently investigating and will fix it as soon as possible. Aki Tuomi Dovecot Oy From sfffaaa at gmail.com Tue Mar 1 11:20:00 2016 From: sfffaaa at gmail.com (=?UTF-8?B?5r2Y5L+h5YKR?=) Date: Tue, 1 Mar 2016 19:20:00 +0800 Subject: Dsync induces redundant mail after rapid append/expunge repeatedly Message-ID: ?I meet the problem about dsync with ?expunge. The problems is expunged mail would reappear after dsyncing and it is easily to reproduce. ?Environment Settings: - Two servers(serverA, serverB) both enabled plugin "*replication"* - And more detail get by "dovecot -n" show below ?Reproduce flow: ?- ?Run two processes pA and pB both would run in while loop ?- pA?(All behavior is on Draft mailbox and all on serverA): - Clean "Draft" mailbox of userA - Run the following imap command of userA - imap save (save new mail to Draft) - imap delete (delete old mail on Draft) - imap expunge * - Check if draft only have one email (it would be failed in about 50 loops)* ?- pB?(Send mail to serverB): - Send new mail to userA (which would be save in INBOX) ?It would be easier reproduce by increasing server loading.? I have found something ?- T he expunge changes from server A in dsync connection don't send immediately, these expunge changes appear after 1~2 dsync connection over. - The replicated ? mail is generated from serverB and sync back to serverA so expunged mail reappeared. ? dovecot -n (ServerA) # 2.2.19: /etc/dovecot/dovecot.conf # OS: Linux 3.10.77 x86_64 ext4 auth_mechanisms = plain login default_internal_user = root default_login_user = dovecot default_vsz_limit = 0 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u dsync_target_servers = tcps:10.13.23.139:24245 lda_mailbox_autocreate = yes mail_debug = yes mail_fsync = never mail_location = maildir:/var/spool/mail/%d/%-4.04i/%i/Maildir mail_max_userip_connections = 30 mail_never_cache_fields = * mail_plugins = " notify replication mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@._/\~&,()[]" mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size flags from subject } postmaster_address = postmaster at localhost protocols = imap pop3 lmtp imap pop3 sieve replication_dsync_parameters = -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { group = users mode = 0666 user = admin } unix_listener replication-notify { group = users mode = 0666 user = admin } } service doveadm { inet_listener { address = 10.13.23.136,127.0.0.1 port = 24245 ssl = yes } } service imap-login { inet_listener imap { address = 10.13.23.136,127.0.0.1 port = 143 } inet_listener imaps { address = 10.13.23.136,127.0.0.1 port = 993 ssl = yes } process_limit = 256 service_count = 0 } service indexer-worker { process_limit = 8 } service pop3-login { inet_listener pop3 { address = 10.13.23.136,127.0.0.1 port = 110 } inet_listener pop3s { address = 10.13.23.136,127.0.0.1 port = 995 ssl = yes } process_limit = 256 service_count = 0 } service replicator { unix_listener replicator-doveadm { mode = 0666 } } userdb { driver = passwd } protocol lda { mail_plugins = " notify replication mail_log sieve" } dovecot -n (ServerB) $ ./sbin/dovecot -n # 2.2.19: /etc/dovecot/dovecot.conf # OS: Linux 3.10.77 x86_64 auth_mechanisms = plain login default_internal_user = root default_login_user = dovecot default_vsz_limit = 0 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u dsync_target_servers = tcps:10.13.23.136:24245 lda_mailbox_autocreate = yes mail_debug = yes mail_fsync = always mail_location = maildir:/var/spool/mail/%d/%-4.04i/%i/Maildir mail_max_userip_connections = 30 mail_never_cache_fields = * mail_plugins = " notify replication mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational reg ex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@._/\~&,()[]" mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size flags from subject } postmaster_address = postmaster at localhost protocols = imap pop3 lmtp imap pop3 sieve replication_dsync_parameters = -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { group = users mode = 0666 user = admin } unix_listener replication-notify { group = users mode = 0666 user = admin } } service doveadm { inet_listener { address = 10.13.23.139,127.0.0.1 port = 24245 ssl = yes } } service imap-login { inet_listener imap { address = 10.13.23.139,127.0.0.1 port = 143 } inet_listener imaps { address = 10.13.23.139,127.0.0.1 port = 993 ssl = yes } process_limit = 256 service_count = 0 } service indexer-worker { process_limit = 4 } service pop3-login { inet_listener pop3 { address = 10.13.23.139,127.0.0.1 port = 110 } inet_listener pop3s { address = 10.13.23.139,127.0.0.1 port = 995 ssl = yes } process_limit = 256 service_count = 0 } service replicator { unix_listener replicator-doveadm { mode = 0666 } } userdb { driver = passwd } protocol lda { mail_plugins = " notify replication mail_log sieve" } Regards, Jay Pan From timo.sirainen at dovecot.fi Tue Mar 1 11:24:09 2016 From: timo.sirainen at dovecot.fi (Timo Sirainen) Date: Tue, 1 Mar 2016 13:24:09 +0200 Subject: Dsync induces redundant mail after rapid append/expunge repeatedly In-Reply-To: References: Message-ID: <0F100590-EB8A-4F46-8EBF-0CFE182A5A7F@dovecot.fi> On 01 Mar 2016, at 13:20, ??? wrote: > > ?I meet the problem about dsync with ?expunge. The problems is expunged mail would reappear after dsyncing and it is easily to reproduce. I've never been able to reproduce this easily. But I wonder if this fix would help here: https://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 From dove-io-drxf at foonet.de Tue Mar 1 16:40:34 2016 From: dove-io-drxf at foonet.de (J. Niklas) Date: Tue, 1 Mar 2016 17:40:34 +0100 Subject: severe fork() problems with new dovecot server Message-ID: <56D5C602.7070908@foonet.de> Hi all, I am getting to you because I am pretty desperate by now. Please read this and share your ideas. I set up a new Mail server with roughly 750 active accounts on it, based on the usual dovecot+postfix+amavis+sql based vmail setup. This is not the first time I did something like this, but admittedly my largest setup so far. I took my time to setup everything pretty straight and stable and migrated all accounts in time with almost no glitches using imapc and pop3c. Things started out smoothly - until the first business morning when the log suddenly began to pop messages like these: dovecot: master: Error: service(imap): fork() failed: Resource temporarily unavailable dovecot: master: Error: service(pop3): fork() failed: Resource temporarily unavailable The error is not confined to a certain service. There are no other messages in dmesg or syslog which could help in closing in on the root cause. The server always runs at load around 0.4 to 0.5 and has plenty of RAM and Disk, too. Of course I checked resource limits and cranked up everything I could possibly think of to numbers that should easily suffice: /etc/security/limits.conf: daemon soft nproc 2048 daemon hard nproc 3128 dovecot soft nproc 2048 dovecot hard nproc 3128 vmail soft nproc 2048 vmail hard nproc 3128 vmail soft nofile 32768 vmail hard nofile 49152 /etc/systemd/system/dovecot.service.d/ulimits.conf: [Service] LimitNOFILE=65534 However, all my attempts on resolving the problem were futile so far. To work around the problem I implemented a log watcher which constantly looks for the fork failure and dumps some debug info before restarting dovecot to make the problem "go away" - until dovecot hits whatever barrier there is again. Here are today's numbers I gathered from this: > forkdump_03-01_09-42: pop=3, imap=446, all=503, postfix:22, sys: 716 > forkdump_03-01_10-09: pop=9, imap=444, all=510, postfix:28, sys: 741 > forkdump_03-01_10-42: pop=5, imap=450, all=507, postfix:25, sys: 748 > forkdump_03-01_11-18: pop=5, imap=451, all=512, postfix:29, sys: 757 > forkdump_03-01_11-48: pop=3, imap=474, all=511, postfix:37, sys: 765 > forkdump_03-01_12-23: pop=7, imap=444, all=511, postfix:22, sys: 752 > forkdump_03-01_12-53: pop=3, imap=444, all=503, postfix:24, sys: 747 > forkdump_03-01_13-21: pop=3, imap=458, all=504, postfix:31, sys: 766 > forkdump_03-01_13-41: pop=4, imap=451, all=505, postfix:23, sys: 755 > forkdump_03-01_14-35: pop=5, imap=436, all=502, postfix:31, sys: 768 > forkdump_03-01_14-59: pop=3, imap=445, all=501, postfix:27, sys: 764 > forkdump_03-01_15-28: pop=6, imap=452, all=507, postfix:25, sys: 769 There you see the number of pop3 and imap childs in the process list as well as the total number of all dovecot processes and all postfix processes, summarized directly after the fork problem appears in the log. The last column is the sum of all processes in the system. Here is a run where the numbers are measured as the server approaches the last entry in the list above. > 15:26:15: pop=3, imap=432, all=485, VSZ: 14353k, postfix:30, sys: 749 > 15:26:30: pop=4, imap=435, all=490, VSZ: 14497k, postfix:30, sys: 754 > 15:26:45: pop=3, imap=439, all=492, VSZ: 14560k, postfix:28, sys: 754 > 15:27:00: pop=3, imap=444, all=497, VSZ: 14711k, postfix:28, sys: 760 > 15:27:15: pop=4, imap=442, all=496, VSZ: 14673k, postfix:25, sys: 756 > 15:27:30: pop=4, imap=444, all=497, VSZ: 14721k, postfix:25, sys: 757 > 15:27:46: pop=3, imap=446, all=498, VSZ: 14756k, postfix:25, sys: 758 > 15:28:01: pop=3, imap=446, all=497, VSZ: 14718k, postfix:24, sys: 756 > 15:28:16: pop=3, imap=455, all=507, VSZ: 15018k, postfix:25, sys: 767 > 15:28:18: pop=3, imap=455, all=507, VSZ: 15018k, postfix:25, sys: 767 > 15:28:20: pop=3, imap=452, all=504, VSZ: 14931k, postfix:25, sys: 764 ---- service(pop3): fork() failed: Resource temporarily unavailable ---- > 15:28:22: pop=4, imap=452, all=505, VSZ: 14954k, postfix:25, sys: 770 > 15:28:24: pop=4, imap=452, all=505, VSZ: 14954k, postfix:25, sys: 770 > 15:28:26: pop=4, imap=451, all=504, VSZ: 14925k, postfix:25, sys: 769 > 15:28:28: pop=5, imap=451, all=506, VSZ: 14980k, postfix:25, sys: 771 ---- dovecot restart complete ---- > 15:28:30: pop=3, imap=11, all=22, VSZ: 485k, postfix:25, sys: 282 > 15:29:00: pop=4, imap=65, all=83, VSZ: 2293k, postfix:26, sys: 344 > 15:29:31: pop=3, imap=91, all=111, VSZ: 3129k, postfix:27, sys: 373 It always seems to happen shortly after the number of dovecot processes goes beyond 500. The VSZ column is the VSZ sum of all dovecot procs. The number of files opened by vmail (lsof -u | wc -l) at that moment usually is between 13k and 15k. sysctl fs.file-nr mostly is around 16k total but the system limit is set way higher (at 1532853) However, as you can see in the following dump, there is no process_limit or whatever being set to 500 or 512 or similar. # --------- su vmail -c "ulimit -Ha:" --------------- core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 60026 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 49152 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) unlimited cpu time (seconds, -t) unlimited max user processes (-u) 3128 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited # ---------------- dovecot -n (mildly anonymized) --------------- # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.4.0-8-generic x86_64 Ubuntu Xenial Xerus (development branch) xfs auth_cache_negative_ttl = 0 auth_cache_size = 50 M auth_mechanisms = plain login default_client_limit = 10000 dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = my.mail.host imap_client_workarounds = delay-newmail lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = * mail_location = sdbox:/mailsrv/users/%d/%u mail_plugins = quota notify mail_log fts managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts_autoindex = yes quota = dict:User quota::proxy::quota sieve = file:~/sieve;active=~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30s stats_track_cmds = yes } postmaster_address = postmaster at my.mail.host protocols = " imap lmtp sieve pop3" service anvil { client_limit = 11227 } service auth { client_limit = 11324 unix_listener /mailsrv/spool/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_limit = 10000 process_min_avail = 5 service_count = 0 vsz_limit = 2 G } service imap { process_limit = 2048 vsz_limit = 2 G } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_limit = 1024 process_min_avail = 3 service_count = 0 vsz_limit = 2 G } service pop3 { process_limit = 1024 } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = References: <56D5C602.7070908@foonet.de> Message-ID: <56D5E97F.3020902@foonet.de> On 01.03.2016 18:21, Dolf Schimmel wrote: > Recently I played around a little with cgroups where you can limit the max number of processes per cgroup. > Could it be that, perhaps, you've stumbled upon such a limit? > Systemd does contain all services by default in their own cgroup afaik, > so it could be that you're using it unknowingly. Yes, yes, \o/ ;-) #> systemctl status dovecot.service * dovecot.service - Dovecot IMAP/POP3 email server Loaded: loaded (/lib/systemd/system/dovecot.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/dovecot.service.d `-ulimits.conf Active: active (running) since Tue 2016-03-01 15:28:29; 4h 24min ago Main PID: 10098 (dovecot) Tasks: 204 (limit: 512) CGroup: /system.slice/dovecot.service There ist my "512". The way of systemd, ignoring all the config stuff that has been there for decades while inposing its own, complex and very sparsely documented ruleset on top is beginning to seriously annoy me. At least I would have expected some sort of syslog message. Just for the records, this can be changed by adding e.g. TasksMax=4096 to the /etc/systemd/system/dovecot.service.d/ulimits.conf I cited in my OP. Now I'll have to wait and see how things will evolve tomorrow. Thank you so much for the great hint! -- kind regards, Jon From noel.butler at ausics.net Tue Mar 1 21:09:47 2016 From: noel.butler at ausics.net (Noel Butler) Date: Wed, 02 Mar 2016 07:09:47 +1000 Subject: severe fork() problems with new dovecot server In-Reply-To: <56D5E97F.3020902@foonet.de> References: <56D5C602.7070908@foonet.de> <56D5E97F.3020902@foonet.de> Message-ID: On 02/03/2016 05:11, J. Niklas wrote: > On 01.03.2016 18:21, Dolf Schimmel wrote: > >> Recently I played around a little with cgroups where you can limit the >> max number of processes per cgroup. >> Could it be that, perhaps, you've stumbled upon such a limit? >> Systemd does contain all services by default in their own cgroup >> afaik, >> so it could be that you're using it unknowingly. > > Yes, yes, \o/ ;-) > > #> systemctl status dovecot.service > * dovecot.service - Dovecot IMAP/POP3 email server > Loaded: loaded (/lib/systemd/system/dovecot.service; enabled; vendor > preset: enabled) > Drop-In: /etc/systemd/system/dovecot.service.d > `-ulimits.conf > Active: active (running) since Tue 2016-03-01 15:28:29; 4h 24min ago > Main PID: 10098 (dovecot) > Tasks: 204 (limit: 512) > CGroup: /system.slice/dovecot.service > > There ist my "512". The way of systemd, ignoring all the config stuff > that has been there for decades while inposing its own, complex and > very > sparsely documented ruleset on top is beginning to seriously annoy me. > At least I would have expected some sort of syslog message. > > Just for the records, this can be changed by adding e.g. > TasksMax=4096 > to the /etc/systemd/system/dovecot.service.d/ulimits.conf I cited > in my OP. > > Now I'll have to wait and see how things will evolve tomorrow. > Thank you so much for the great hint! even more proof that systemd is evil -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From tss at iki.fi Tue Mar 1 21:31:47 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 1 Mar 2016 23:31:47 +0200 Subject: Inconsistent mdbox index while running doveadm altmove In-Reply-To: <085a01d17338$aa2ec650$fe8c52f0$@gmail.com> References: <085a01d17338$aa2ec650$fe8c52f0$@gmail.com> Message-ID: <10F6AF8C-2511-4BAC-AA32-C942A1137414@iki.fi> On 29 Feb 2016, at 23:31, Ricardo Machini Barbosa wrote: > > Hello, > > I was performing doveadm altmove for one account while this mailbox was > being accessed. > > > > Dovecot version: 2.2.21 > > Mailbox format: mdbox > > > > Command: > > doveadm altmove -u user1 at domain.com.br before 360d Was it the first time you ran it for this user? > This command took about 5 minutes to finish and during the execution I found > some log messages: > > > > Feb 25 19:57:51 dovecot: imap(user1 at domain.com.br): Error: mdbox map > /var/mail/user1/mdbox/storage/dovecot.map.index corrupted: Unexpectedly lost > INBOX uid=77 map_uid=76 It's not necessarily the altmove that broke this. It could have just noticed this existing problem. > After that these messages moved to alternate storage disappeared from the > mailbox/IMAP but these files were all on alternative storage. > > I had to execute doveadm force-resync -u user1 at domain.com.br INBOX to > recovery this mailbox, but losing all e-mail's flags. This again shouldn't happen.. > I should do some kind of lock before running the command altmove ? No. I attempted to reproduce this with some stress testing, but wasn't able to. From tss at iki.fi Tue Mar 1 21:51:45 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 1 Mar 2016 23:51:45 +0200 Subject: Timout for LDAP connection In-Reply-To: <56D4613D.5050805@uni-greifswald.de> References: <56D4613D.5050805@uni-greifswald.de> Message-ID: On 29 Feb 2016, at 17:18, Gordon Grubert wrote: > > Hi, > > we are using a round robin dns record for connections to our ldap > system. This works fine for almost all cases. In particular, for > dovecot does this mean, when an ldap server is stopped, dovecot > instantly reconnects to another ldap server. > > But when the network connection to the active ldap server is broken, > dovecot sticks to the failed ldap server. Is there any possibility to > define a connection timeout? What should happen is that as long as new requests keep coming, Dovecot realizes after about 60 seconds that the LDAP server is hanging. It then reconnects and the reconnection should work. But... First of all, 60 seconds is likely a much too long timeout. But more importantly it looks like there's something weird now going on with OpenLDAP library. I added this somewhat recently and tested that it works: https://github.com/dovecot/core/commit/fb3178a1924dae52151d88c4d4ded879df43dd3f But now that I'm testing it, the timeout doesn't seem to be triggering. I don't know what happened to it that it suddenly doesn't work.. This also means that OpenLDAP seems to be internally stuck trying to connect to a server that isn't responding. Dovecot doesn't currently make the decisions on which LDAP server to connect to. It just passes through all the hosts to OpenLDAP library and lets it handle it. And it seems like OpenLDAP library can't right now do this failover. So maybe Dovecot should be responsible for that as well.. Anyway, for now you could set up haproxy to localhost and configure Dovecot LDAP to connect to haproxy and haproxy connect to the actual LDAP servers. From tss at iki.fi Tue Mar 1 21:53:10 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 1 Mar 2016 23:53:10 +0200 Subject: search problem dovecot 2.2.21 + fts - Solr In-Reply-To: References: Message-ID: On 24 Feb 2016, at 21:14, Anderson Barbosa wrote: > > Hello, > > Realized update dovecot on my server. Now the search is returning > differently from the previous version bringing reference information of > other messages . > For example when doing a search for anderson.joao this new version of the > dovecot dovecot 2.2.21 + fts - Solr response will be all email that has the > word anderson and joao, instead of returning only items with the word > anderson.joao. Fixed by https://github.com/dovecot/core/commit/f3b0efdcbd0bd9059574c8f86d6cb43e16c8e521 The plan is to release v2.2.22 somewhat soon.. From tss at iki.fi Tue Mar 1 21:58:30 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 1 Mar 2016 23:58:30 +0200 Subject: Alternative storage backend for Dovecot In-Reply-To: <11dc4571aa193d058a9c8446dc694db6@natalenko.name> References: <11dc4571aa193d058a9c8446dc694db6@natalenko.name> Message-ID: On 29 Feb 2016, at 13:31, Oleksandr Natalenko wrote: > > Hi. > > We have corporate Dovecot setup with GlusterFS as file storage. We store maildirs on GlueterFS share, mounting it via NFS. Mounting share via native GlusterFS FUSE client introduces visible performance overhead. Also, NFS mount does not provide us with HA. > > That's why I have an idea to use GlusterFS C API to access maildirs share. I'd like to preserve maildir structure, but get access to it not via FS mount point but with GlusterFS C API calls. > > I've discovered that Dovecot source tree has src/lib-fs infrastructure with fs-posix implemented on top of it. Is that the right place to start from? GlusterFS C API calls are POSIX-like, so they could be easily used as substitutions for VFS ops. Could such a backend be implemented as separate plugin? > > Are there any examples of alternative storage backend to look at? That isn't a small job. Currently the only mail storage backend that uses only lib-fs calls is the commercial object storage plugin. All the other storages use POSIX calls directly. Especially problematic is that lib-index uses POSIX calls also. So one possibility might be that you implement a storage backend that stores index files only locally, but if the user switches between backends the performance will likely be bad because there are no indexes for the user in the new server. I've some plans to change lib-index to use lib-fs calls, but that's not going to happen anytime soon. From tss at iki.fi Tue Mar 1 22:03:33 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 00:03:33 +0200 Subject: Error: istream-seekable: safe_mkstemp(/tmp/dovecot.imap.) failed In-Reply-To: <20160227082929.GA949@nihlus.leuxner.net> References: <20160227082929.GA949@nihlus.leuxner.net> Message-ID: <3F4A98A8-A903-487D-AB22-644756F0B798@iki.fi> On 27 Feb 2016, at 10:29, Thomas Leuxner wrote: > > I'm seeing these recently: > > Feb 27 09:24:01 nihlus dovecot: imap(tlx at leuxner.net): Error: istream-seekable: safe_mkstemp(/tmp/dovecot.imap.) failed: No such file or directory You don't have a /tmp directory or imap is chrooted somewhere where there is no /tmp?.. From tss at iki.fi Tue Mar 1 22:08:49 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 00:08:49 +0200 Subject: where is pop3_migration_ignore_missing_uidls=yes set? In-Reply-To: <56CE96CC.5000207@f-m.fm> References: <56CE96CC.5000207@f-m.fm> Message-ID: <857FD923-9340-4BF2-898E-7B6E0D8E3F48@iki.fi> > On 25 Feb 2016, at 07:53, Leon Kyneur wrote: > > While doing pop3 migrations with dsync I am getting an error: > > dsync(user at domain.net): Error: pop3_migration: 2 POP3 messages have no matching IMAP messages (first POP3 msg 2638 UIDL fb3d6f3299541e695a28585f5803ed1c) - set pop3_migration_ignore_missing_uidls=yes to continue anyway > dsync(user at domain.net): Error: Exporting mailbox INBOX failed: Can't lookup pop3-uidl for UID=3252: POP3 UIDLs couldn't be synced > > Can't see this is doveconf -a so it's not a setting? - tried configuring it as a plugin setting but that didn't work... It should have worked inside plugin { .. }. If not, maybe there was a bug. I did a bunch of fixes to pop3-migration after v2.2.21. From tss at iki.fi Tue Mar 1 22:20:58 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 00:20:58 +0200 Subject: dsync issues due to Prefix difference? In-Reply-To: References: <720942e870f0a0a762ad972d06c7e70f@koallo.com> <613815EF-A6AF-498D-9314-49243BAB13C8@iki.fi> Message-ID: <1F6838DC-4392-4803-AB9D-E3FBF361BD52@iki.fi> On 02 Feb 2016, at 17:04, Mark Little wrote: > > On 2016-02-02 07:22, Timo Sirainen wrote: >>> On 01 Feb 2016, at 23:39, Mark Little wrote: >>> Hi Timo, >>> Thank you very much for the information. I had seen the DSync page but I was confused as to how to configure it. I'd definitely love to be able to get the proper dsync migration working as I have some clients who use POP3 and others who use IMAP and I want to make this seamless for all if possible. >>> Could you please elaborate on how I specify the alternate dovecot.conf? I've gone through the man pages and I don't see anything referencing -c for doveadm? Or do you mean that I should be running the full dovecot server process from the source server with an alternate configuration? >> -c is a global option for all dovecot binaries, including doveadm. I >> guess all the global options should be included in all the man pages.. > > Ok great. I will try that out. So you are saying I could run the daemon on a source server specifying to use a different config with the namespace matching the other, and then when dsync connects it will see the namespaces as the same? I think my idea was that you keep the source server configuration as it is. The in destination server you have a dovecot-dsync.conf which is same as the regular dovecot.conf except you change the namespace prefix. Then run doveadm -c dovecot-dsync.conf sync .. >>> If I change the name space won't it fail to find the local folders in their mailbox? >> I'm not sure what you mean here. It's possible to switch between >> namespaces on the fly without losing anything (besides clients seeing >> them differently). > > Ok. I am just realizing that I am probably unable to have a transparent migration for IMAP, right? Seeing as my destination is using a different Prefix, that means some IMAP clients will not see their migrated folders by default unless they update their configuration. Right. > I am mainly concerned about POP3 I guess, because if IMAP has to re-download it's not as big of a deal because everything is already marked as read.. but re-downloading POP3 doesn't work the same. > > I tried following the dsync page but I cannot get it working. Do I just have to include the POP3 configuration examples, or the IMAP too? Do I need to use 'pop3c:' at the end of the line instead of imapc: (eg: 'doveadm -R -u user at domain pop3c:') to signify it needs to preserve the UIDL's? No. The dsync migration page should be correct. > Do I need to add the same settings to the source as well as destination? or just one side? I tried yesterday but then ended up breaking Dovecot on my destination server. After I added the pop3-migration namespace part to the namespace section, all users were failing with: 'Error: User initialization failed: namespace configuration error: list=yes namespace missing' This looks as if the only namespace you had was the pop3-migration, and you're missing the inbox namespace? I added it now to the wiki example also. From tss at iki.fi Tue Mar 1 22:27:57 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 00:27:57 +0200 Subject: dovecot local indexes and multiple servers In-Reply-To: <56CB037D.5060106@kerkhove.net> References: <56CB037D.5060106@kerkhove.net> Message-ID: <058F4338-C3E4-43EC-BE29-068C30152CF7@iki.fi> On 22 Feb 2016, at 14:47, alex wrote: > > Hi, > > I've been testing mdbox with local indexes on our nfs based directors + > multiple imap/lda/pop3 server setup. The performance is noticeably > better than maildir with indexes on nfs, so I'd like to make this work. > > About the possible direction to other servers the wiki says that it will > create a new index 'on the fly'. That is true, but after the index is > recreated, Thunderbird (imap) re-downloads all the messages and sees all > those messages as unread again! dbox format requires permanent indexes, so you must store them on NFS also. Only mbox and Maildir formats can recreate indexes on the fly without losing information. Is there still some documentation that talks about indexes being able to be recreated from scratch, without mentioning dbox? I tried quickly finding from wiki, but I only found the NFS page mentioning it and it specifically said mbox/Maildir. I added "(but not dbox!)" as clarification. Anywhere else?.. From tss at iki.fi Tue Mar 1 22:29:03 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 00:29:03 +0200 Subject: Setup changes 1.x to 2.x -- custom POP3 account handling required. In-Reply-To: <56CB01C7.7080203@affinityvision.com.au> References: <56CAB037.9000205@affinityvision.com.au> <56CB01C7.7080203@affinityvision.com.au> Message-ID: <04AB0907-0C8A-40F0-8BA2-C8C995A9B7AE@iki.fi> More complicated, but still possible: http://wiki2.dovecot.org/PostLoginScripting > On 22 Feb 2016, at 14:40, Andrew McGlashan wrote: > > No help? Is this possible to do as I had done before but with the newer > version? > > Thanks > A. > > On 22/02/2016 5:52 PM, Andrew McGlashan wrote: >> Hi, >> >> Previously I did /special/ processing for some email accounts; if a >> particular file existed in the user's home directory, then I caused the >> account to use /var/mail/$USER file for POP -- otherwise it used IMAP. >> >> Now, because I adjusted the setup for POP only, IMAP still worked >> perfectly well. Some users have both POP and IMAP access for various >> reasons. >> >> The special POP processing was done using a shell script [1] in place of: >> /usr/lib/dovecot/pop3 >> - which in turn called the normal binary once setting up the >> environment. >> >> Now, I have been forced to upgrade my Debian from squeeze-lts to wheezy >> and the dovecot setup is quite different. >> >> How can I implement my /wrapper/ script for POP handling now? >> >> Here is my current setup with dovecot -n ... >> >> # 2.1.7: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 7.9 >> mail_location = maildir:~/Maildir >> namespace inbox { >> inbox = yes >> location = >> mailbox Drafts { >> special_use = \Drafts >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> special_use = \Sent >> } >> mailbox "Sent Items" { >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> special_use = \Trash >> } >> prefix = >> } >> passdb { >> driver = pam >> } >> plugin { >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> } >> protocols = " imap pop3" >> service imap-login { >> inet_listener imap { >> port = 0 >> } >> } >> service pop3-login { >> inet_listener pop3 { >> port = 0 >> } >> } >> ssl = required >> ssl_cert = > ssl_key = > userdb { >> driver = passwd >> } >> >> >> [1] This is the content of the original wrapper script: >> >> #!/bin/sh >> >> if [ -f $HOME/.use-mbox-for-pop3s ]; then >> export MAIL=mbox:$HOME/mail:INBOX=/var/mail/$USER >> export USER_INBOX=/var/mail/$USER >> if [ -f $USER_INBOX ] >> then >> export USER_INBOX_GROUP=$(stat -c %G $USER_INBOX) >> if [ $USER_INBOX_GROUP != $USER ] >> then >> ( >> date >> ls -l $USER_INBOX >> chown Debian-exim:$USER $USER_INBOX >> ls -l $USER_INBOX >> ) >> /var/log/usr-lib-dovecot--pop3-affinity.log >> fi >> fi >> else >> if [ -d $HOME/Maildir ]; then >> export MAIL=Maildir:$HOME/Maildir >> else >> export MAIL=mbox:$HOME/mail:INBOX=/var/mail/$USER >> fi >> fi >> >> # Finally execute the imap/pop3. If you use both, you'll need two scripts. >> # - this customization just for POP3S ... >> exec /usr/lib/dovecot/pop3 >> >> >> >> Thanks >> AndrewM From sfffaaa at gmail.com Wed Mar 2 01:04:37 2016 From: sfffaaa at gmail.com (=?UTF-8?B?5r2Y5L+h5YKR?=) Date: Wed, 2 Mar 2016 09:04:37 +0800 Subject: Dsync induces redundant mail after rapid append/expunge repeatedly In-Reply-To: <0F100590-EB8A-4F46-8EBF-0CFE182A5A7F@dovecot.fi> References: <0F100590-EB8A-4F46-8EBF-0CFE182A5A7F@dovecot.fi> Message-ID: Hi Timo, Thanks for your reply, I've patched this commit before, but it cannot solve my problem. Besides, I log more information on server B and it shows server B generates the mail itself. (The mail which has UID 2128 is the redundant mail and sync back to server A) Feb 24 22:57:36 dsync-server(test 28740): Info: highest_seen_uid 2125, importer->local_uid_next 2124 Feb 24 22:57:36 dsync-server(test 28740): Debug: brain S: Import Drafts: unwanted UIDs: 2124:2125 Feb 24 22:57:36 dsync-server(test 28740): Debug: brain S: Import Drafts: Reassign UIDs: 2124 Feb 24 22:57:37 dsync-local(test 28748): Debug: brain M: Import Drafts: UID 2125 isn't usable, assigning new UID 2128 Feb 24 22:57:37 dsync-local(test 28748): Info: copy from Drafts: box=Drafts, uid=2128, msgid=<20151009090132.62413F6136D at test.yoyo.mail>, size=34744, from="wf skr" , subject=The wf skr..., flags=(\Seen) Feb 24 22:57:37 dsync-local(test 28748): Info: expunge: box=Drafts, uid=2125, msgid=<20151009090132.62413F6136D at test.yoyo.mail>, size=34744, from="wf skr" , subject=The wf skr..., flags=(\Seen) Best Regards, Jay Pan 2016-03-01 19:24 GMT+08:00 Timo Sirainen : > On 01 Mar 2016, at 13:20, ??? wrote: > > > ?I meet the problem about dsync with ?expunge. The problems is expunged > mail would reappear after dsyncing and it is easily to reproduce. > > > I've never been able to reproduce this easily. But I wonder if this fix > would help here: > > > https://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 > > From eric at ericabrahamsen.net Wed Mar 2 06:49:41 2016 From: eric at ericabrahamsen.net (Eric Abrahamsen) Date: Wed, 02 Mar 2016 14:49:41 +0800 Subject: user configuration question Message-ID: <87lh61nzlm.fsf@ericabrahamsen.net> I've been using mbsync to sync this email account to a local Dovecot installation. I used to use Gmail, through Google Apps, and a while ago switched the account to self-hosting. I didn't want to upload years' worth of old email to my old server, so I've had two accounts in my MUA: one talking to the local Dovecot account for the old emails, and a second talking directly to the server for the new emails. I'd like to sync the new account to Dovecot as well, and I'm having trouble wrapping my brain around how to configure the two side-by-side accounts in Dovecot (I know there are other solutions to this, but I'm also just trying to figure out how this works). What I don't grok is the exact effect of the different username fields in the passdb file, and how they combine with username_format. Right now my dovecot.conf has this: passdb { driver = passwd-file args = username_format=%u /etc/dovecot/passwd } userdb { driver = static args = uid=eric gid=users home=/home/eric/.mail/%d/%n username_format=%u default_fields = mail=maildir:/home/eric/.mail/%d/%n/mail } And /etc/dovecot/passwd: eric at ericabrahamsen.net:{PLAIN}password:eric at ericabrahamsen.net Say I want to keep my existing mail where it is, and have all the new mail go into ~/.mail/ericabrahamsen.net/eric-new/mail. Ie, when mbsync connects to the local Dovecot, it does so with the username eric-new at ericabrahamsen.net. Now, in Dovecot's conf, do I change the email address in the first field of /etc/dovecot/passwd, or the third field, or both? And, if it isn't too much trouble, what is the difference between the two? Thanks! Eric From flint42 at gmail.com Wed Mar 2 08:02:48 2016 From: flint42 at gmail.com (Jean-Baptiste Vignaud) Date: Wed, 2 Mar 2016 09:02:48 +0100 Subject: Dual certificate Message-ID: Hello all; Is anyone knows if it's possible to have a dual certificate setup on dovecot like in postfix or apache ? i tried to add several crts in local name section : local_name imap.server.tdl { ssl_cert = References: <56D4613D.5050805@uni-greifswald.de> Message-ID: <56D6A5D5.6020702@merit.unu.edu> Hi, We have experienced the same or similar problem, and not just with dovecot but also with postfix. Thanks for your HAProxy suggestion! We have the feeling that when the ldap connection is actually DOWN (gone, terminated), OpenLDAP will reconnect to another server. But if the ldap server becomes 'stuck' (as in: returning no data anymore, but not actually terminating the connection) a failover does not happen. (we have had the second scenario, with samba4 AD ldap) MJ On 03/01/2016 10:51 PM, Timo Sirainen wrote: > But now that I'm testing it, the timeout doesn't seem to be > triggering. I don't know what happened to it that it suddenly doesn't > work.. This also means that OpenLDAP seems to be internally stuck > trying to connect to a server that isn't responding. Dovecot doesn't > currently make the decisions on which LDAP server to connect to. It > just passes through all the hosts to OpenLDAP library and lets it > handle it. And it seems like OpenLDAP library can't right now do this > failover. So maybe Dovecot should be responsible for that as well.. > > Anyway, for now you could set up haproxy to localhost and configure > Dovecot LDAP to connect to haproxy and haproxy connect to the actual > LDAP servers. > From tlx at leuxner.net Wed Mar 2 08:54:27 2016 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 2 Mar 2016 09:54:27 +0100 Subject: Error: istream-seekable: safe_mkstemp(/tmp/dovecot.imap.) failed In-Reply-To: <3F4A98A8-A903-487D-AB22-644756F0B798@iki.fi> References: <20160227082929.GA949@nihlus.leuxner.net> <3F4A98A8-A903-487D-AB22-644756F0B798@iki.fi> Message-ID: <20160302085427.GA11532@nihlus.leuxner.net> * Timo Sirainen 2016.03.01 23:03: > > I'm seeing these recently: > > > > Feb 27 09:24:01 nihlus dovecot: imap(tlx at leuxner.net): Error: istream-seekable: safe_mkstemp(/tmp/dovecot.imap.) failed: No such file or directory > > You don't have a /tmp directory or imap is chrooted somewhere where there is no /tmp?.. No and no :) However the error message magically disappeared with newer builds. I'm not seeing it since Sunday... -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: Digital signature URL: From gordon.grubert+lists at uni-greifswald.de Wed Mar 2 11:03:10 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Wed, 2 Mar 2016 12:03:10 +0100 Subject: Timout for LDAP connection In-Reply-To: References: <56D4613D.5050805@uni-greifswald.de> Message-ID: <56D6C86E.70309@uni-greifswald.de> Hi Timo, On 03/01/2016 10:51 PM, Timo Sirainen wrote: > On 29 Feb 2016, at 17:18, Gordon Grubert wrote: >> >> Hi, >> >> we are using a round robin dns record for connections to our ldap >> system. This works fine for almost all cases. In particular, for >> dovecot does this mean, when an ldap server is stopped, dovecot >> instantly reconnects to another ldap server. >> >> But when the network connection to the active ldap server is broken, >> dovecot sticks to the failed ldap server. Is there any possibility to >> define a connection timeout? > > What should happen is that as long as new requests keep coming, Dovecot realizes after about 60 seconds that the LDAP server is hanging. It then reconnects and the reconnection should work. But... First of all, 60 seconds is likely a much too long timeout. > > But more importantly it looks like there's something weird now going on with OpenLDAP library. I added this somewhat recently and tested that it works: > > https://github.com/dovecot/core/commit/fb3178a1924dae52151d88c4d4ded879df43dd3f thx a lot. I'll test this ASAP. IMHO, this will not really help, because the timeout is relevant when connecting to the LDAP server only and not for an active session, or? > But now that I'm testing it, the timeout doesn't seem to be triggering. I don't know what happened to it that it suddenly doesn't work.. This also means that OpenLDAP seems to be internally stuck trying to connect to a server that isn't responding. Dovecot doesn't currently make the decisions on which LDAP server to connect to. It just passes through all the hosts to OpenLDAP library and lets it handle it. And it seems like OpenLDAP library can't right now do this failover. So maybe Dovecot should be responsible for that as well.. You're right, that there are some modifications in the OpenLDAP client. In 2014, the option BIND_POLICY in ldap.conf still existed. The current version does not support this option :-( > Anyway, for now you could set up haproxy to localhost and configure Dovecot LDAP to connect to haproxy and haproxy connect to the actual LDAP servers. I'll tke a look on it. Thx and best regards, Gordon -- Technischer Leiter & stellv. Direktor Universit?tsrechenzentrum (URZ) E.-M.-Arndt-Universit?t Greifswald Felix-Hausdorff-Str. 12 17489 Greifswald Germany Tel. +49 3834 86 1456 Fax. +49 3834 86 1401 From tss at iki.fi Wed Mar 2 14:13:48 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 16:13:48 +0200 Subject: Get mailbox from its guid through IMAP In-Reply-To: <56C1C3EE.5040501@myzel.net> References: <56C1C3EE.5040501@myzel.net> Message-ID: <424BC7E1-C564-41B0-AFBC-BD46A51444A6@iki.fi> On 15 Feb 2016, at 14:26, Peter Chiochetti wrote: > > In the shell I'do: > > doveadm fetch -u bob mailbox mailbox-guid $box uid 1 > > Is there a way through IMAP to get the same? Not directly, but: a STATUS mailbox (X-GUID) or for all: a LIST "" * RETURN (STATUS (X-GUID)) From tss at iki.fi Wed Mar 2 14:31:52 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 16:31:52 +0200 Subject: Found bug in quota-status + patch In-Reply-To: References: Message-ID: > On 08 Feb 2016, at 00:26, Thierry Coppey wrote: > > Hello, > > I've found a bug in the quota-status util (Dovecot 2.2.21, and probably below): it always return > OK (sufficient quota) because it fails to load the user properly. More specifically, the branch > " if (quser == NULL) return 1; " in src/plugins/quota/quota-status.c:59 is always taken. > (at least with postgresql backend, test your config with the (adapted) command below: > printf "recipient=mailbox at example.com\nsize=10000000000\n\n" | nc inet:mailstore.example.com 12340 > it should reject, unless you have no quota, or more than 10G). It works fine with me. Maybe you simply didn't enable quota-plugin for quota-status service? (e.g. you enabled inside protocol imap { .. } and elsewhere, but not globally) From tss at iki.fi Wed Mar 2 14:44:59 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 2 Mar 2016 16:44:59 +0200 Subject: Dual certificate In-Reply-To: References: Message-ID: <7830992C-B022-4DF4-8CE7-561E5E3255D3@iki.fi> On 02 Mar 2016, at 10:02, Jean-Baptiste Vignaud wrote: > > Hello all; > > > Is anyone knows if it's possible to have a dual certificate setup on > dovecot like in postfix or apache ? > > i tried to add several crts in local name section : > > local_name imap.server.tdl { > ssl_cert = ssl_key = ssl_cert = ssl_key = } > > but it seems that dovecot takes the last one (ecdsa) and that rsa cert is > not used. Would it work if you had a single .pem file containing both certs and a single file containing both keys? > In apache we have to duplicate the cert / key lines one for rsa, one for > edcda. > > In postfix, we have some specific ecdsa conf keys. > > So is there a way to do the same in dovecot ? Looks like from OpenSSL code point of view the same cert/key loading functions can simply be called multiple times. There's currently no way to trigger that in Dovecot. But maybe the single .pem file would happen to work as well? If not, this would need some config changes and I'm not sure what would be the nicest way.. From list at airstreamcomm.net Wed Mar 2 15:01:44 2016 From: list at airstreamcomm.net (list at airstreamcomm.net) Date: Wed, 2 Mar 2016 09:01:44 -0600 Subject: Dual certificate In-Reply-To: References: Message-ID: <177F1D0D-3E7F-4BB6-A0AE-E6D33D7BAA8F@airstreamcomm.net> Google multi domain certificates. Comodo sells a multi domain wild card certificate that we use to host multiple SSL domains on dovecot and postfix successfully. You install the single certificate and reissue and reinstall after adding a new domain. > On Mar 2, 2016, at 2:02 AM, Jean-Baptiste Vignaud wrote: > > Hello all; > > > Is anyone knows if it's possible to have a dual certificate setup on > dovecot like in postfix or apache ? > > i tried to add several crts in local name section : > > local_name imap.server.tdl { > ssl_cert = ssl_key = ssl_cert = ssl_key = } > > but it seems that dovecot takes the last one (ecdsa) and that rsa cert is > not used. > > > to check if booth are working, i check with openssl: > > openssl s_client openssl s_client -connect imap.server.tdl:143 -starttls > imap -servername imap.server.tdl -cipher ECDHE-RSA-AES128-GCM-SHA256 for > rsa > > and > > openssl s_client openssl s_client -connect imap.server.tdl:143 -starttls > imap -servername imap.server.tdl -cipher ECDHE-ECDSA-AES128-GCM-SHA256 for > ecdsa > > In apache we have to duplicate the cert / key lines one for rsa, one for > edcda. > > In postfix, we have some specific ecdsa conf keys. > > So is there a way to do the same in dovecot ? > From jk at ucls.uchicago.edu Wed Mar 2 20:27:30 2016 From: jk at ucls.uchicago.edu (John Krug) Date: Wed, 2 Mar 2016 14:27:30 -0600 Subject: Deleting / Removing users In-Reply-To: References: <1782EB97-5CF2-47E7-A86A-9B2A1BD76110@ucls.uchicago.edu> Message-ID: <67A271F9-C936-4AE7-A7F8-D03FBB66BA25@ucls.uchicago.edu> Thank you, sir. Sounds easy enough. To complicate issues, I have two-way dsync running between two servers. Since the index log files are used to track deleted mails (yes?), do I need to worry about replication trying to bring things back? Can I just rm the users files from each server and be OK? Thanks again, JK ----------------------------------------------------------------------- John "JK" Krug System Administrator The University of Chicago | Laboratory Schools 1362 East 59th Street | Chicago, IL 60637 Phone: (773) 834-4476 jk at ucls.uchicago.edu | http://helpdesk.ucls.uchicago.edu _______________________________________________ > On Feb 25, 2016, at 1:16 AM, Steffen Kaiser wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 24 Feb 2016, John Krug wrote: > >> i have a list of users that I?ve removed from LDAP and I want to delete their mail storage. >> >> sdbox >> Dovecot 2.2.15.8 >> >> I have mail messages in one location and indexes in another. Should I just >> rm -rf /messages/ >> rm -rf /indexes/ > > if that's where the mail_location points to. Also check out the home directory of eash user. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVs6qRnz1H7kL/d9rAQL8Hgf/fNlN1fuggq2eABGDrn6sv43+VE0geAXn > U3oMoQF8ABItuOU7kMagDwY7n+K35ZFY/b2sddZ3kc4eKLORRxUzrN3orl1+H9jl > bkqjeDmF7PazKd1lFtfCZpgjCT/UM6MQPn8Lxm4TaL+2tV50Gm//Og7PdeQ5N7UO > YQcWvYLQOVgkY8vbqhNTnp0QFlfttHT+oFT+Kp3mDj3GQ2Mg7nMSKFZAeanaX2Qd > XTSgsKtX9yaoG/E76o/2dvtW8jh0RS1OhX9oDaboFIsKj4OkI7ahaAxwmB6jZxX7 > pnnrOZzKMEDO8S7MmjtyWmG0MGIzzWwKfYSI/5mOpT3rkphHjihpwA== > =WH5K > -----END PGP SIGNATURE----- From chris2014 at postbox.xyz Thu Mar 3 05:32:39 2016 From: chris2014 at postbox.xyz (Chris) Date: Thu, 3 Mar 2016 06:32:39 +0100 Subject: Deliver to Public Mailbox Message-ID: Dear All, I'd like dovecot-lda (deliver) to post a message to a public mailbox. It doesn't seem to work when I just use the -m parameter with the IMAP-Mailbox path, e.g. Public/info . What parameters are required? Do I have to change the headers with formail in any way? TIA! - Chris From skdovecot at smail.inf.fh-brs.de Thu Mar 3 07:19:48 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 3 Mar 2016 08:19:48 +0100 (CET) Subject: Deleting / Removing users In-Reply-To: <67A271F9-C936-4AE7-A7F8-D03FBB66BA25@ucls.uchicago.edu> References: <1782EB97-5CF2-47E7-A86A-9B2A1BD76110@ucls.uchicago.edu> <67A271F9-C936-4AE7-A7F8-D03FBB66BA25@ucls.uchicago.edu> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 2 Mar 2016, John Krug wrote: > To complicate issues, I have two-way dsync running between two servers. > Since the index log files are used to track deleted mails (yes?), do I > need to worry about replication trying to bring things back? You've wrote: "users that I?ve removed from LDAP". Do you find any log entries of those users generated by dsync? Well, provided you have logs from dsync at all. > Can I just rm the users files from each server and be OK? That depends on how you invoke dsync. >> On Feb 25, 2016, at 1:16 AM, Steffen Kaiser wrote: >> >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Wed, 24 Feb 2016, John Krug wrote: >> >>> i have a list of users that I?ve removed from LDAP and I want to delete their mail storage. >>> >>> sdbox >>> Dovecot 2.2.15.8 >>> >>> I have mail messages in one location and indexes in another. Should I just >>> rm -rf /messages/ >>> rm -rf /indexes/ >> >> if that's where the mail_location points to. Also check out the home directory of eash user. >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1 >> >> iQEVAwUBVs6qRnz1H7kL/d9rAQL8Hgf/fNlN1fuggq2eABGDrn6sv43+VE0geAXn >> U3oMoQF8ABItuOU7kMagDwY7n+K35ZFY/b2sddZ3kc4eKLORRxUzrN3orl1+H9jl >> bkqjeDmF7PazKd1lFtfCZpgjCT/UM6MQPn8Lxm4TaL+2tV50Gm//Og7PdeQ5N7UO >> YQcWvYLQOVgkY8vbqhNTnp0QFlfttHT+oFT+Kp3mDj3GQ2Mg7nMSKFZAeanaX2Qd >> XTSgsKtX9yaoG/E76o/2dvtW8jh0RS1OhX9oDaboFIsKj4OkI7ahaAxwmB6jZxX7 >> pnnrOZzKMEDO8S7MmjtyWmG0MGIzzWwKfYSI/5mOpT3rkphHjihpwA== >> =WH5K >> -----END PGP SIGNATURE----- > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVtfllHz1H7kL/d9rAQJIxwf/YlqKOQNAQst17J65LzMdJppFjGzhQmcd AfmzPsQlqjJVkOyG9eM8E+Bem4BB0Ni0IAEsgzbsM6YxQw9LX9G9aGxkQxnLSaTj hA9P8V+xB9+Sdb8O003cQZHd00/8zps58M536fvghma1kT47G0my/NAtzeCbVjIu zoOGkxSFNZ0xqydeeVJRiwCVjmKYvgeU0KbWGw8o6MAyk4qJy2D9RzeiNK7Eb51v uAyqGjAzh236l8JNALPJHgyyl94uvSF9fdqvqpLpSoEQbu66uIU4eF73rX+hfJom vgvfGDtuYPmgYEnYdX+FBVM6DWx5ljggAnqM1EQtzDdzYeBbB85bNw== =wqER -----END PGP SIGNATURE----- From flint42 at gmail.com Thu Mar 3 08:08:42 2016 From: flint42 at gmail.com (Jean-Baptiste Vignaud) Date: Thu, 3 Mar 2016 09:08:42 +0100 Subject: Dual certificate In-Reply-To: <7830992C-B022-4DF4-8CE7-561E5E3255D3@iki.fi> References: <7830992C-B022-4DF4-8CE7-561E5E3255D3@iki.fi> Message-ID: On Wed, Mar 2, 2016 at 3:44 PM, Timo Sirainen wrote: > > > Would it work if you had a single .pem file containing both certs and a > single file containing both keys? > OK, just tried this configuration but only the first certificate is working. I used this order : rsa cert, ecdsa cert, intermediate and this one : rsa cert, intermediate, ecdsa cert, intermediate in this case, both rsa and ec are signed by the same intermediate. > > In apache we have to duplicate the cert / key lines one for rsa, one for > > edcda. > > > > In postfix, we have some specific ecdsa conf keys. > > > > So is there a way to do the same in dovecot ? > > Looks like from OpenSSL code point of view the same cert/key loading > functions can simply be called multiple times. There's currently no way to > trigger that in Dovecot. But maybe the single .pem file would happen to > work as well? If not, this would need some config changes and I'm not sure > what would be the nicest way.. > Perhaps the same way as postfix, to have a ssl_ecdsa_cert and a ssl_ecsda_key parameters ? Anyway, this is not urgent matters, it's just that now that let's encrypt give free rsa and ec certificates i wanted to use them both :) From Christian.Schmidt at chemie.uni-hamburg.de Thu Mar 3 08:09:39 2016 From: Christian.Schmidt at chemie.uni-hamburg.de (Christian Schmidt) Date: Thu, 3 Mar 2016 09:09:39 +0100 Subject: Timout for LDAP connection In-Reply-To: <56D4613D.5050805@uni-greifswald.de> References: <56D4613D.5050805@uni-greifswald.de> Message-ID: <56D7F143.6050600@chemie.uni-hamburg.de> Hello Gordon, On 29.02.2016 16:18, Gordon Grubert wrote: > we are using a round robin dns record for connections to our ldap > system. This works fine for almost all cases. In particular, for > dovecot does this mean, when an ldap server is stopped, dovecot > instantly reconnects to another ldap server. > > But when the network connection to the active ldap server is broken, > dovecot sticks to the failed ldap server. Is there any possibility to > define a connection timeout? What about replicating the directory onto the dovecot host and send the ldap queries to localhost? Regards Christian -- No signature available. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5326 bytes Desc: S/MIME Cryptographic Signature URL: From gordon.grubert+lists at uni-greifswald.de Thu Mar 3 08:55:32 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Thu, 3 Mar 2016 09:55:32 +0100 Subject: Timout for LDAP connection In-Reply-To: <56D7F143.6050600@chemie.uni-hamburg.de> References: <56D4613D.5050805@uni-greifswald.de> <56D7F143.6050600@chemie.uni-hamburg.de> Message-ID: <56D7FC04.1020206@uni-greifswald.de> Hello Christian, On 03/03/2016 09:09 AM, Christian Schmidt wrote: > Hello Gordon, > > On 29.02.2016 16:18, Gordon Grubert wrote: >> we are using a round robin dns record for connections to our ldap >> system. This works fine for almost all cases. In particular, for >> dovecot does this mean, when an ldap server is stopped, dovecot >> instantly reconnects to another ldap server. >> >> But when the network connection to the active ldap server is broken, >> dovecot sticks to the failed ldap server. Is there any possibility to >> define a connection timeout? > > What about replicating the directory onto the dovecot host and send the > ldap queries to localhost? of course, this would be possible. E.g., for our DNS we are using exactly this solution. But this means, there is one additional daemon. Additionally, this leads to an mailserver interruption when updating the local ldap daemon. But you are right, the "connection loss" problem over the network can be prevented. Best regards, Gordon From dovecot at flut.demon.nl Thu Mar 3 10:16:50 2016 From: dovecot at flut.demon.nl (dovecot at flut.demon.nl) Date: Thu, 3 Mar 2016 11:16:50 +0100 Subject: Implementation of TLS OCSP Stapling Message-ID: <56D80F12.2060902@flut.demon.nl> Hi all, About a year ago, Torsten already asked for OCSP stapling (http://dovecot.org/pipermail/dovecot/2015-April/100632.html). Unfortunately, there was no answer to his question. Now RFC 7633 ("TLS Feature Extension", https://tools.ietf.org/html/rfc7633, a.k.a. "Must Staple") has landed, revocation is getting serious! I personally would like to embed all my TLS certificates with the must-staple extension. The great project Let's Encrypt already supports it: https://github.com/letsencrypt/boulder/pull/1224 I'm aware most MTAs don't really care about the certificate, but big players as Google take TLS encryption very seriously: https://googleblog.blogspot.nl/2016/02/building-safer-web-for-everyone.html So I would like to know if Dovecot is planning to feature OCSP stapling. That way I know for sure my "must staple" certificates can be used by Dovecot. And in my opinion, every TLS offering daemon should be up to par to the capabilities of TLS.. Not lag behind :) What's your opinion on this matter? Thanks in advance for any anwser! Greets, Osiris From hs at schlittermann.de Thu Mar 3 10:54:01 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Thu, 3 Mar 2016 11:54:01 +0100 Subject: LMTP proxy does not pass RCPT TO: ... 5xx response back In-Reply-To: References: <20160211233716.GC30205@jumper.schlittermann.de> Message-ID: <20160303105401.GT18559@jumper.schlittermann.de> Hi Timo, sorry for the delay, but many thanks for your answer (I was busy with the current Exim release). Timo Sirainen (So 21 Feb 2016 02:57:55 CET): ? > Right.. RCPT TO in proxy answers immediately when it has verified that the user exists. It doesn't wait until it has connected to the backend and sent RCPT TO there. I'm also not entirely sure how good of an idea that is if it would, since at least without pipelining it would slow down all the LMTP operations when there are multiple recipients. But then again, if pipelining is used it wouldn't matter, at least in theory. It would require some more coding though. > The way it's commonly done in larger environments is that the over-quota is already checked by the MTA and have it fail the RCPT TO. You can have Dovecot update the over-quota flags via quota-warning scripts (and quota_over_script) in whatever way and have the MTA look that up. Then in Dovecot LMTP you could simply disable quota checks. Yes, that's the way we've to go now. But getting as much as possible information about the deliverability of a message by standard means would be good. And using the RCPT TO response would not need any magic mechanisms on the MTA side. We could use recipient verification via callouts (as we do to check the existence of the recipient, w/o the need to do some LDAP lookups). Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From sca at andreasschulze.de Thu Mar 3 12:04:39 2016 From: sca at andreasschulze.de (A. Schulze) Date: Thu, 03 Mar 2016 13:04:39 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <56D80F12.2060902@flut.demon.nl> Message-ID: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> dovecot: > So I would like to know if Dovecot is planning to feature OCSP stapling. > That way I know for sure my "must staple" certificates can be used by > Dovecot. And in my opinion, every TLS offering daemon should be up to > par to the capabilities of TLS.. Not lag behind :) > > What's your opinion on this matter? OCSP stapling [c|s]hould be implemented on a server if clients *use* that data. For WebBrowser this is true. But I'm not aware of any MUA or MTA that validate certificates via OCSP. Andreas From stephan at rename-it.nl Thu Mar 3 12:23:47 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 3 Mar 2016 13:23:47 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> Message-ID: <56D82CD3.5060700@rename-it.nl> Op 3-3-2016 om 13:04 schreef A. Schulze: > > dovecot: > >> So I would like to know if Dovecot is planning to feature OCSP stapling. >> That way I know for sure my "must staple" certificates can be used by >> Dovecot. And in my opinion, every TLS offering daemon should be up to >> par to the capabilities of TLS.. Not lag behind :) >> >> What's your opinion on this matter? > > OCSP stapling [c|s]hould be implemented on a server if clients *use* > that data. > For WebBrowser this is true. > > But I'm not aware of any MUA or MTA that validate certificates via OCSP. OCSP stapling [c|s]hould be implemented on a client if servers *provide* that data. So, who's going to be first... the chicken or the egg? :) Regards, Stephan. From Christian.Schmidt at chemie.uni-hamburg.de Thu Mar 3 12:25:04 2016 From: Christian.Schmidt at chemie.uni-hamburg.de (Christian Schmidt) Date: Thu, 3 Mar 2016 13:25:04 +0100 Subject: Timout for LDAP connection In-Reply-To: <56D7FC04.1020206@uni-greifswald.de> References: <56D4613D.5050805@uni-greifswald.de> <56D7F143.6050600@chemie.uni-hamburg.de> <56D7FC04.1020206@uni-greifswald.de> Message-ID: <56D82D20.4020706@chemie.uni-hamburg.de> Hi Gordon, On 03.03.2016 09:55, Gordon Grubert wrote: > On 03/03/2016 09:09 AM, Christian Schmidt wrote: >> What about replicating the directory onto the dovecot host and send the >> ldap queries to localhost? > > of course, this would be possible. E.g., for our DNS we are using > exactly this solution. But this means, there is one additional daemon. > Additionally, this leads to an mailserver interruption when updating > the local ldap daemon. Well, just switch dovecot to another LDAP server before local LDAP's "downtime". ;-) Regards, Christian -- No signature available. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5326 bytes Desc: S/MIME Cryptographic Signature URL: From skdovecot at smail.inf.fh-brs.de Thu Mar 3 12:29:41 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 3 Mar 2016 13:29:41 +0100 (CET) Subject: Timout for LDAP connection In-Reply-To: <56D82D20.4020706@chemie.uni-hamburg.de> References: <56D4613D.5050805@uni-greifswald.de> <56D7F143.6050600@chemie.uni-hamburg.de> <56D7FC04.1020206@uni-greifswald.de> <56D82D20.4020706@chemie.uni-hamburg.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 3 Mar 2016, Christian Schmidt wrote: > On 03.03.2016 09:55, Gordon Grubert wrote: >> On 03/03/2016 09:09 AM, Christian Schmidt wrote: >>> What about replicating the directory onto the dovecot host and send the >>> ldap queries to localhost? >> >> of course, this would be possible. E.g., for our DNS we are using >> exactly this solution. But this means, there is one additional daemon. >> Additionally, this leads to an mailserver interruption when updating >> the local ldap daemon. > > Well, just switch dovecot to another LDAP server before local LDAP's > "downtime". ;-) I don't understand, where the downtime shall come from? Do you use a LDAP server, that does not support replication on its own? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVtguNXz1H7kL/d9rAQKRqAf8DKnxiXu2rvjbvy4Y6RS/r90D/6dIMLbf tb6ghII1M0/nJiIH0zqm/OtS13hCUfWAut7L1Piizbr1SWxMlLTF0j4QrHb2oriG L6vfhzJRGBZTI6YL7NSqbVGiXe2CDeYxO4en100pNpCeWa47RCdvoWEFCLTm9bXs frJ0SO6ba6Pc9vD4QZIo3XNjBbI6jHHbSVHK2Ry5+uXIyN/IwbRNx9bCpATGI3y7 12hs/ulI5IWjyjojBydSOwxzh4TX+RqZQIa6onOxszkXRvuQqiUGH+wGXaJOViVJ GjOaNrvnnTUkLPgKR6nMp5DNlXtENpw3/P/qK2xNedCroXnA0RYIEA== =vGhF -----END PGP SIGNATURE----- From stephan at rename-it.nl Thu Mar 3 12:30:15 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 3 Mar 2016 13:30:15 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> Message-ID: <56D82E57.3000305@rename-it.nl> Op 3-3-2016 om 13:04 schreef A. Schulze: > > dovecot: > >> So I would like to know if Dovecot is planning to feature OCSP stapling. >> That way I know for sure my "must staple" certificates can be used by >> Dovecot. And in my opinion, every TLS offering daemon should be up to >> par to the capabilities of TLS.. Not lag behind :) >> >> What's your opinion on this matter? > > OCSP stapling [c|s]hould be implemented on a server if clients *use* > that data. > For WebBrowser this is true. > > But I'm not aware of any MUA or MTA that validate certificates via OCSP. BTW, I can imagine that Thunderbird can already do that, as it shares much of the Firefox code base. At least it should be relatively easy to add/enable there. Regards, Stephan. From dovecot at flut.demon.nl Thu Mar 3 12:15:51 2016 From: dovecot at flut.demon.nl (dovecot at flut.demon.nl) Date: Thu, 3 Mar 2016 13:15:51 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> Message-ID: <56D82AF7.4080107@flut.demon.nl> On 03-03-16 13:04, A. Schulze wrote: > > dovecot: > >> So I would like to know if Dovecot is planning to feature OCSP stapling. >> That way I know for sure my "must staple" certificates can be used by >> Dovecot. And in my opinion, every TLS offering daemon should be up to >> par to the capabilities of TLS.. Not lag behind :) >> >> What's your opinion on this matter? > > OCSP stapling [c|s]hould be implemented on a server if clients *use* > that data. > For WebBrowser this is true. > > But I'm not aware of any MUA or MTA that validate certificates via OCSP. > > Andreas Well, that's a nice case of the chicken vs. egg problem, now isn't it ;) Unfortunately, certificate validation doesn't have a very good track record when it comes to MTA's.. They'll accept self-signed certificates, untrusted certificates, heck, they'll trust as far as I know almost anything! Luckily, MUA's are a little bit more security-concerened, as is Google/GMail. But is that really a reason *not* to implement a feature? Shouldn't a developer think: "OK, I want my MTA to be the best! I want to be on the top of the list of all the MTA's out there." in stead of thinking "OK, I'm fine with being mediocre, I don't care.."? :) From aki.tuomi at dovecot.fi Thu Mar 3 12:58:43 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Thu, 3 Mar 2016 14:58:43 +0200 (EET) Subject: Implementation of TLS OCSP Stapling In-Reply-To: <56D82AF7.4080107@flut.demon.nl> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82AF7.4080107@flut.demon.nl> Message-ID: <22117102.23976.6e161d0f-e69a-4ba2-bc6a-8e29e71b33fc.open-xchange@appsuite.open-xchange.com> > On March 3, 2016 at 2:15 PM dovecot at flut.demon.nl wrote: > > > On 03-03-16 13:04, A. Schulze wrote: > > > > dovecot: > > > >> So I would like to know if Dovecot is planning to feature OCSP stapling. > >> That way I know for sure my "must staple" certificates can be used by > >> Dovecot. And in my opinion, every TLS offering daemon should be up to > >> par to the capabilities of TLS.. Not lag behind :) > >> > >> What's your opinion on this matter? > > > > OCSP stapling [c|s]hould be implemented on a server if clients *use* > > that data. > > For WebBrowser this is true. > > > > But I'm not aware of any MUA or MTA that validate certificates via OCSP. > > > > Andreas > > Well, that's a nice case of the chicken vs. egg problem, now isn't it ;) > > Unfortunately, certificate validation doesn't have a very good track > record when it comes to MTA's.. They'll accept self-signed certificates, > untrusted certificates, heck, they'll trust as far as I know almost > anything! Luckily, MUA's are a little bit more security-concerened, as > is Google/GMail. > > But is that really a reason *not* to implement a feature? Shouldn't a > developer think: "OK, I want my MTA to be the best! I want to be on the > top of the list of all the MTA's out there." in stead of thinking "OK, > I'm fine with being mediocre, I don't care.."? :) We will take this feature under consideration and see if it can be implemented in future release. Thank you for your suggestion! --- Aki Tuomi Dovecot Oy From Christian.Schmidt at chemie.uni-hamburg.de Thu Mar 3 12:58:49 2016 From: Christian.Schmidt at chemie.uni-hamburg.de (Christian Schmidt) Date: Thu, 3 Mar 2016 13:58:49 +0100 Subject: Timout for LDAP connection In-Reply-To: References: <56D4613D.5050805@uni-greifswald.de> <56D7F143.6050600@chemie.uni-hamburg.de> <56D7FC04.1020206@uni-greifswald.de> <56D82D20.4020706@chemie.uni-hamburg.de> Message-ID: <56D83509.9080705@chemie.uni-hamburg.de> Hi Steffen, On 03.03.2016 13:29, Steffen Kaiser wrote: > I don't understand, where the downtime shall come from? Gordon wrote "this leads to an mailserver interruption when updating the local ldap daemon" What he meant IMHO was updating the local ldap server software - not the data held in the directory. Regards, Christian -- No signature available. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5326 bytes Desc: S/MIME Cryptographic Signature URL: From dovecot at flut.demon.nl Thu Mar 3 13:04:07 2016 From: dovecot at flut.demon.nl (dovecot at flut.demon.nl) Date: Thu, 3 Mar 2016 14:04:07 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <22117102.23976.6e161d0f-e69a-4ba2-bc6a-8e29e71b33fc.open-xchange@appsuite.open-xchange.com> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82AF7.4080107@flut.demon.nl> <22117102.23976.6e161d0f-e69a-4ba2-bc6a-8e29e71b33fc.open-xchange@appsuite.open-xchange.com> Message-ID: <56D83647.5090608@flut.demon.nl> On 03-03-16 13:58, aki.tuomi at dovecot.fi wrote: >> On March 3, 2016 at 2:15 PM dovecot at flut.demon.nl wrote: >> >> >> On 03-03-16 13:04, A. Schulze wrote: >>> dovecot: >>> >>>> So I would like to know if Dovecot is planning to feature OCSP stapling. >>>> That way I know for sure my "must staple" certificates can be used by >>>> Dovecot. And in my opinion, every TLS offering daemon should be up to >>>> par to the capabilities of TLS.. Not lag behind :) >>>> >>>> What's your opinion on this matter? >>> OCSP stapling [c|s]hould be implemented on a server if clients *use* >>> that data. >>> For WebBrowser this is true. >>> >>> But I'm not aware of any MUA or MTA that validate certificates via OCSP. >>> >>> Andreas >> Well, that's a nice case of the chicken vs. egg problem, now isn't it ;) >> >> Unfortunately, certificate validation doesn't have a very good track >> record when it comes to MTA's.. They'll accept self-signed certificates, >> untrusted certificates, heck, they'll trust as far as I know almost >> anything! Luckily, MUA's are a little bit more security-concerened, as >> is Google/GMail. >> >> But is that really a reason *not* to implement a feature? Shouldn't a >> developer think: "OK, I want my MTA to be the best! I want to be on the >> top of the list of all the MTA's out there." in stead of thinking "OK, >> I'm fine with being mediocre, I don't care.."? :) > We will take this feature under consideration and see if it can be implemented > in future release. Thank you for your suggestion! > > --- > Aki Tuomi > Dovecot Oy Thank *you* for taking security seriously! Let's hope client development will also take a interest in OCSP stapling, including the TLS Feature Extension, if there are servers out there who actually implement it :) From gedalya at gedalya.net Thu Mar 3 13:09:29 2016 From: gedalya at gedalya.net (Gedalya) Date: Thu, 3 Mar 2016 08:09:29 -0500 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <56D82E57.3000305@rename-it.nl> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82E57.3000305@rename-it.nl> Message-ID: <56D83789.7020108@gedalya.net> On 03/03/2016 07:30 AM, Stephan Bosch wrote: > BTW, I can imagine that Thunderbird can already do that, as it shares much of the Firefox code base. Thunderbird definitely does validate certificates via OCSP, enabled by default and I've run into that the hard way a couple of times wrt StartSSL having issues with their responder. This isn't hypothetical, guys.... From dovecot at flut.demon.nl Thu Mar 3 13:17:06 2016 From: dovecot at flut.demon.nl (dovecot at flut.demon.nl) Date: Thu, 3 Mar 2016 14:17:06 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <56D83789.7020108@gedalya.net> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82E57.3000305@rename-it.nl> <56D83789.7020108@gedalya.net> Message-ID: <56D83952.2090509@flut.demon.nl> On 03-03-16 14:09, Gedalya wrote: > On 03/03/2016 07:30 AM, Stephan Bosch wrote: >> BTW, I can imagine that Thunderbird can already do that, as it shares much of the Firefox code base. > Thunderbird definitely does validate certificates via OCSP, enabled by default and I've run into that the hard way a couple of times wrt StartSSL having issues with their responder. This isn't hypothetical, guys.... OCSP status querying isn't the same as verifying stapled OCSP responses though. Can't find Thunderbird's support for stapling unfortunately.. From gedalya at gedalya.net Thu Mar 3 13:23:26 2016 From: gedalya at gedalya.net (Gedalya) Date: Thu, 3 Mar 2016 08:23:26 -0500 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <56D83952.2090509@flut.demon.nl> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82E57.3000305@rename-it.nl> <56D83789.7020108@gedalya.net> <56D83952.2090509@flut.demon.nl> Message-ID: <56D83ACE.9040806@gedalya.net> On 03/03/2016 08:17 AM, dovecot at flut.demon.nl wrote: > On 03-03-16 14:09, Gedalya wrote: >> On 03/03/2016 07:30 AM, Stephan Bosch wrote: >>> BTW, I can imagine that Thunderbird can already do that, as it shares much of the Firefox code base. >> Thunderbird definitely does validate certificates via OCSP, enabled by default and I've run into that the hard way a couple of times wrt StartSSL having issues with their responder. This isn't hypothetical, guys.... > OCSP status querying isn't the same as verifying stapled OCSP responses > though. Can't find Thunderbird's support for stapling unfortunately.. No, it's not the same, but the claim was no use of OCSP at all. Either way, this guy claims Thunderbird uses stapling, but with HTTP? http://mobilesociety.typepad.com/mobile_life/2015/03/ocsp-stapling-and-android-that-doesnt-care.html As Stephan pointed out, it's the same code base as Firefox. If someone can name an IMAP server that supports stapling, we could test it. From dovecot at flut.demon.nl Thu Mar 3 13:30:25 2016 From: dovecot at flut.demon.nl (Osiris) Date: Thu, 3 Mar 2016 14:30:25 +0100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <56D83ACE.9040806@gedalya.net> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82E57.3000305@rename-it.nl> <56D83789.7020108@gedalya.net> <56D83952.2090509@flut.demon.nl> <56D83ACE.9040806@gedalya.net> Message-ID: <56D83C71.8000501@flut.demon.nl> On 03-03-16 14:23, Gedalya wrote: > On 03/03/2016 08:17 AM, dovecot at flut.demon.nl wrote: >> On 03-03-16 14:09, Gedalya wrote: >>> On 03/03/2016 07:30 AM, Stephan Bosch wrote: >>>> BTW, I can imagine that Thunderbird can already do that, as it shares much of the Firefox code base. >>> Thunderbird definitely does validate certificates via OCSP, enabled by default and I've run into that the hard way a couple of times wrt StartSSL having issues with their responder. This isn't hypothetical, guys.... >> OCSP status querying isn't the same as verifying stapled OCSP responses >> though. Can't find Thunderbird's support for stapling unfortunately.. > No, it's not the same, but the claim was no use of OCSP at all. > Either way, this guy claims Thunderbird uses stapling, but with HTTP? > http://mobilesociety.typepad.com/mobile_life/2015/03/ocsp-stapling-and-android-that-doesnt-care.html > As Stephan pointed out, it's the same code base as Firefox. If someone can name an IMAP server that supports stapling, we could test it. Hmm, that article does mention the request of OCSP status during the TLS session handshake and I can confirm this on my own Thunderbird: the `ClientHello` handshake part *does* include a "status_request" extension of the type OCSP. So we can assure Andreas there're clients out there who use it :) From axel.luttgens at skynet.be Thu Mar 3 14:08:16 2016 From: axel.luttgens at skynet.be (Axel Luttgens) Date: Thu, 3 Mar 2016 15:08:16 +0100 Subject: Found bug in quota-status + patch In-Reply-To: References: Message-ID: <2A85CF8E-0C4F-49B3-8308-A31A9EB9B637@skynet.be> > Le 2 mars 2016 ? 15:31, Timo Sirainen a ?crit : > > >> On 08 Feb 2016, at 00:26, Thierry Coppey wrote: >> >> Hello, >> >> I?ve found a bug in the quota-status util (Dovecot 2.2.21, and probably below): it always return OK (sufficient quota) because it fails to load the user properly. More specifically, the branch " if (quser == NULL) return 1; " in src/plugins/quota/quota-status.c:59 is always taken. >> (at least with postgresql backend, test your config with the (adapted) command below: >> [?] > > It works fine with me. Maybe you simply didn't enable quota-plugin for quota-status service? (e.g. you enabled inside protocol imap { .. } and elsewhere, but not globally) Hello Timo, To be sure to understand correctly, are you referring to a top level setting such as: mail_plugins = ? quota ? that could be missing? Axel From rblayzor.bulk at inoc.net Thu Mar 3 16:17:53 2016 From: rblayzor.bulk at inoc.net (Robert Blayzor) Date: Thu, 3 Mar 2016 11:17:53 -0500 Subject: Dovecot 2.2.21 - segfault Message-ID: pid 31943 (dovecot), uid 0: exited on signal 11 (core dumped) dovecot --version 2.2.21 (5345f22) uname -a FreeBSD 10.3-BETA2 #0 r295966M: amd64 bt full #0 0x00000008008eb037 in t_push (marker=0x0) at data-stack.c:133 133 data-stack.c: No such file or directory. in data-stack.c (gdb) bt full #0 0x00000008008eb037 in t_push (marker=0x0) at data-stack.c:133 frame_block = (struct stack_frame_block *) 0x7fffffffb4e0 #1 0x000000080086a5ec in master_service_env_clean () at master-service.c:534 _data_stack_cur_id = 32767 value = 0x801471056 "TZ CORE_OUTOFMEM CORE_ERROR" #2 0x000000000040df88 in service_process_setup_environment (service=0x8014b11e0, uid=58537, hostdomain=0x801419960 ?mta3.xxx.net") at service-process.c:234 No locals. #3 0x000000000040dd6d in service_process_create (service=0x8014b11e0) at service-process.c:322 uid_counter = 58537 process = (struct service_process *) 0x8008eb2f3 uid = 58537 hostdomain = 0x801419960 ?mta3.xxx.net" pid = 0 process_forked = true #4 0x000000000040d7ff in service_accept (l=0x8014b1378) at service-monitor.c:299 service = (struct service *) 0x8014b11e0 #5 0x000000080090e57f in io_loop_call_io (io=0x80144e7e0) at ioloop.c:559 ioloop = (struct ioloop *) 0x801421080 t_id = 2 #6 0x0000000800911497 in io_loop_handler_run_internal (ioloop=0x801421080) at ioloop-kqueue.c:151 ctx = (struct ioloop_handler_context *) 0x801419880 events = (struct kevent *) 0x8014b9000 event = (const struct kevent *) 0x8014b9000 tv = {tv_sec = 42682, tv_usec = 705349} ts = {tv_sec = 42682, tv_nsec = 705349000} io = (struct io_file *) 0x80144e7e0 events_count = 67 ret = 1 i = 0 #7 0x000000080090eb0e in io_loop_handler_run (ioloop=0x801421080) at ioloop.c:607 No locals. #8 0x000000080090e92f in io_loop_run (ioloop=0x801421080) at ioloop.c:583 No locals. #9 0x000000080086a8bb in master_service_run (service=0x80141b140, callback=0) at master-service.c:640 No locals. #10 0x0000000000406558 in main (argc=3, argv=0x7fffffffb4c0) at main.c:888 set = (struct master_settings *) 0x801429110 error = 0x800ca9283 "H\203? ]?\017\037\200" doveconf_arg = 0x0 orig_info_callback = (failure_callback_t *) 0x8008ee880 orig_debug_callback = (failure_callback_t *) 0x8008ee880 foreground = false ask_key_pass = false i = 3 c = -1 doubleopts = 0x7fffffffb3a0 Current language: auto; currently minimal From condor at stz-bg.com Thu Mar 3 14:56:11 2016 From: condor at stz-bg.com (Condor) Date: Thu, 03 Mar 2016 16:56:11 +0200 Subject: Dovecot error symbol mysql_options, version libmysqlclient_16 not defined in file libmysqlclient.so.18 Message-ID: Hello, Im using Dovecot version: 2.2.21 (5345f22) Here is my conf file: auth_debug = yes auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-userdb auth_verbose = yes base_dir = /usr/local/var/run/dovecot/ debug_log_path = /var/log/dovecot.log default_login_user = nobody default_process_limit = 200 dict { driver = sql quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } mail_debug = yes mail_location = maildir:/var/mailq/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify envir onment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = /var/mailq/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/mailq/postmail/%d/%n/sieve/ sieve_global_dir = /usr/local/var/lib/dovecot/sieve sieve_global_path = /usr/local/var/lib/dovecot/sieve/default.sieve sieve_max_actions = 32 sieve_max_redirects = 15 sieve_quota_max_scripts = 20 } protocols = pop3 imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = /usr/lib64/libmysqlclient.so.18 (0x00007fad84696000) I use kernel 4.4.3, gcc 5.3.0 $ gcc -v Reading specs from /usr/lib64/gcc/x86_64-slackware-linux/5.3.0/specs COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-slackware-linux/5.3.0/lto-wrapper Target: x86_64-slackware-linux Configured with: ../gcc-5.3.0/configure --prefix=/usr --libdir=/usr/lib64 --mandir=/usr/man --infodir=/usr/info --enable-shared --enable-bootstrap --enable-languages=ada,c,c++,fortran,go,java,lto,objc --enable-threads=posix --enable-checking=release --enable-objc-gc --with-system-zlib --with-python-dir=/lib64/python2.7/site-packages --enable-libstdcxx-dual-abi --with-default-libstdcxx-abi=gcc4-compatible --disable-libunwind-exceptions --enable-__cxa_atexit --enable-libssp --enable-lto --enable-install-libiberty --with-gnu-ld --verbose --enable-java-home --with-java-home=/usr/lib64/jvm/jre --with-jvm-root-dir=/usr/lib64/jvm --with-jvm-jar-dir=/usr/lib64/jvm/jvm-exports --with-arch-directory=amd64 --with-antlr-jar=/tmp/gcc/antlr-runtime-3.4.jar --enable-java-awt=gtk --disable-gtktest --disable-multilib --target=x86_64-slackware-linux --build=x86_64-slackware-linux --host=x86_64-slackware-linux Thread model: posix gcc version 5.3.0 (GCC) Mysql version: mysql Ver 15.1 Distrib 10.0.24-MariaDB, for Linux (x86_64) using readline 5.1 Glibc version 2.23 any one can help me to understand whats happaened ? HS From mysql.jorge at decimal.pt Thu Mar 3 15:03:03 2016 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Thu, 3 Mar 2016 15:03:03 -0000 Subject: Dovecot & Pigeon w/ MySQL Message-ID: Howdy, I'm looking for a good howto to have pigeon saving the sieve scripts on an mysql table. Can some point me to a good one? Dr. google doesn't show me much about it. Thanks in advanced, Jorge, From tss at iki.fi Thu Mar 3 16:33:57 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 3 Mar 2016 18:33:57 +0200 Subject: Dovecot 2.2.21 - segfault In-Reply-To: References: Message-ID: <215D2E1B-895E-4BDA-A774-FE1FD2C7E5C7@iki.fi> > On 03 Mar 2016, at 18:17, Robert Blayzor wrote: > > pid 31943 (dovecot), uid 0: exited on signal 11 (core dumped) > > > dovecot --version > 2.2.21 (5345f22) > > uname -a > FreeBSD 10.3-BETA2 #0 r295966M: amd64 > > > (gdb) bt full > #0 0x00000008008eb037 in t_push (marker=0x0) at data-stack.c:133 > frame_block = (struct stack_frame_block *) 0x7fffffffb4e0 > #1 0x000000080086a5ec in master_service_env_clean () at master-service.c:534 > _data_stack_cur_id = 32767 > value = 0x801471056 "TZ CORE_OUTOFMEM CORE_ERROR" This doesn't make much sense. Is it reproducible? From rblayzor.bulk at inoc.net Thu Mar 3 18:17:05 2016 From: rblayzor.bulk at inoc.net (Robert Blayzor) Date: Thu, 3 Mar 2016 13:17:05 -0500 Subject: Dovecot 2.2.21 - segfault In-Reply-To: <215D2E1B-895E-4BDA-A774-FE1FD2C7E5C7@iki.fi> References: <215D2E1B-895E-4BDA-A774-FE1FD2C7E5C7@iki.fi> Message-ID: <6AF4607F-8C85-4B53-BE88-CB2D061ECB24@inoc.net> > This doesn't make much sense. Is it reproducible? I?m not sure what triggered it exactly, was just completely random. Looking in the logs there was nothing at the time. If it happens again (with similar trace) will follow-up. -- Robert inoc.net!rblayzor XMPP: rblayzor.AT.inoc.net PGP Key: 78BEDCE1 @ pgp.mit.edu From chris2014 at postbox.xyz Thu Mar 3 18:40:17 2016 From: chris2014 at postbox.xyz (Chris) Date: Thu, 3 Mar 2016 19:40:17 +0100 Subject: Deliver to Public Mailbox In-Reply-To: References: Message-ID: <8b5ad44e08323140433b939dbb5b6da5.squirrel@mail2.postbox.xyz> Was my bad. The issue is over. - Chris Chris wrote: > Dear All, > > I'd like dovecot-lda (deliver) to post a message to a public mailbox. > > It doesn't seem to work when I just use the -m parameter with the > IMAP-Mailbox path, e.g. Public/info . > > What parameters are required? Do I have to change the headers with formail > in any way? > > TIA! > > - Chris > From gordon.grubert+lists at uni-greifswald.de Thu Mar 3 18:49:25 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Thu, 3 Mar 2016 19:49:25 +0100 Subject: Timout for LDAP connection In-Reply-To: <56D83509.9080705@chemie.uni-hamburg.de> References: <56D4613D.5050805@uni-greifswald.de> <56D7F143.6050600@chemie.uni-hamburg.de> <56D7FC04.1020206@uni-greifswald.de> <56D82D20.4020706@chemie.uni-hamburg.de> <56D83509.9080705@chemie.uni-hamburg.de> Message-ID: <56D88735.9080901@uni-greifswald.de> On 03/03/2016 01:58 PM, Christian Schmidt wrote: > Hi Steffen, > > On 03.03.2016 13:29, Steffen Kaiser wrote: >> I don't understand, where the downtime shall come from? > > Gordon wrote "this leads to an mailserver interruption when updating > the local ldap daemon" > > What he meant IMHO was updating the local ldap server software - not the > data held in the directory. Correct. ASAP, I'll take a look on all suggestions. Best regards, Gordon From rlaager at wiktel.com Fri Mar 4 05:47:43 2016 From: rlaager at wiktel.com (Richard Laager) Date: Thu, 3 Mar 2016 23:47:43 -0600 Subject: Dsync Header Hashing Message-ID: <56D9217F.20908@wiktel.com> Is there any way to disable the header hashing in dsync? I'm doing a one-time migration to Dovecot using imapc. The FETCHes for Date & Message-ID take a non-trivial amount of time and it's not clear to me if they have a function for a one-time migration. -- Richard From stephan at rename-it.nl Fri Mar 4 11:32:18 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 4 Mar 2016 12:32:18 +0100 Subject: Dovecot & Pigeon w/ MySQL In-Reply-To: References: Message-ID: <56D97242.5090905@rename-it.nl> Op 3/3/2016 om 4:03 PM schreef Jorge Bastos: > Howdy, > > > > I'm looking for a good howto to have pigeon saving the sieve scripts on an > mysql table. Pigeonhole can currently only retrieve Sieve scripts from a database, not store them there; .e.g., from ManageSieve. > Can some point me to a good one? Dr. google doesn't show me much about it. http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration/Dict Regards, Stephan. From tss at iki.fi Fri Mar 4 13:33:55 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 4 Mar 2016 15:33:55 +0200 Subject: v2.2.22 release candidate released Message-ID: http://dovecot.org/releases/2.2/rc/dovecot-2.2.22.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.22.rc1.tar.gz.sig There are some larger changes here, especially to doveadm to make it support HTTP API. There's still time to do smaller tweaks to the API, so let us know if you have some improvement ideas. Note that the API was designed to look mostly like JMAP, which we're planning to implement also for v2.3. The plan is to fork v2.3 development tree soon. + Added doveadm HTTP API: See http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP + virtual plugin: Mailbox filtering can now be done based on the mailbox metadata. See http://wiki2.dovecot.org/Plugins/Virtual + stats: Added doveadm stats reset to reset global stats. + stats: Added authentication statistics if auth_stats=yes. + dsync, imapc, pop3c & pop3-migration: Many optimizations, improvements and error handling fixes. + doveadm: Most commands now stop soon after SIGINT/SIGTERM. - auth: Auth caching was done too aggressively when %variables were used in default_fields, override_fields or LDAP pass/user_attrs. userdb result_* were also ignored when user was found from cache. - imap: Fixed various assert-crashes caused v2.2.20+. Some of them caught actual hangs or otherwise unwanted behavior towards IMAP clients. - Expunges were forgotten in some situations, for example when pipelining multiple IMAP MOVE commands. - quota: Per-namespaces quota were broken for dict and count backends in v2.2.20+ - fts-solr: Search queries were using OR instead of AND as the separator for multi-token search queries in v2.2.20+. From goetz.reinicke at filmakademie.de Fri Mar 4 13:35:06 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Fri, 4 Mar 2016 14:35:06 +0100 Subject: questions regarding zlib plugin Message-ID: <56D98F0A.3070109@filmakademie.de> Hi, faced with a current space problem on our dovecot 2.2.18 server, I thought about using the zlib plugin. My questions: - is it really as simple as adding the options to the conf files as described in the docs :) ? http://wiki2.dovecot.org/Plugins/Zlib - As this just compresses new messages; dose anybody has a sort of simple cron or whatever script or best practice how to compress existing maildir mails? The doc is a bit complicated to me at that point... Thanks a lot and regards . G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From Ron at Cleven.com Fri Mar 4 14:37:55 2016 From: Ron at Cleven.com (Ron Cleven) Date: Fri, 04 Mar 2016 08:37:55 -0600 (CST) Subject: Reappearing emails Message-ID: <56D99DC1.4020106@Cleven.com> We have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. Recently we received a report from an Android IMAP user that emails that he deleted without reading would often reappear in his INBOX. At first I thought it might be some quirky incompatibility with his email client, but I found that I could easily reproduce it in Roundcube by dragging an unread email to Trash. I have been monitoring this forum fairly religiously and don't recall seeing any similar reports. I plan to capture the IMAP wire interactions, but before doing that, I thought I would submit this to the IMAP gods to see if anyone had heard of this and/or if there is some newer version that might resolve the problem. This particular customer contacted his email vendor and asked them to analyze the problem. The actual log data is gigantic, so I just pasted in the vendor's narrative below in case it helps. Otherwise, as I said, I will capture a similar interaction at the wire level and follow up here. Vendor's narrative: You had 8 messages in the Inbox, and moved two to Trash. The server notified the app on the push connection (for Inbox) that there are now 6 messages. By the time the app got around to catch up with that (it did the Trash folder first), the server said "oh wait, there are 8 messages, not 6" (in the Inbox), and so the app synced them in, just as reported. app selecting the Inbox, server saying there are 8 messages there app moving UID 729 and 730 to Trash (push) server saying Trash now has 34 messages (push) server saying two messages gone from Inbox, 6 left (push) 6 messages left in Inbox becoming 8 (push) and here they are (the two new ones) Thanks, Ron From tss at iki.fi Fri Mar 4 14:52:30 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 4 Mar 2016 16:52:30 +0200 Subject: Dsync Header Hashing In-Reply-To: <56D9217F.20908@wiktel.com> References: <56D9217F.20908@wiktel.com> Message-ID: On 04 Mar 2016, at 07:47, Richard Laager wrote: > > Is there any way to disable the header hashing in dsync? > > I'm doing a one-time migration to Dovecot using imapc. The FETCHes for Date & Message-ID take a non-trivial amount of time and it's not clear to me if they have a function for a one-time migration. That would be nice, yes. Does the attached patch happen to work? Compiles, but untested for now. -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync.diff Type: application/octet-stream Size: 2801 bytes Desc: not available URL: -------------- next part -------------- From alessio at skye.it Fri Mar 4 15:38:29 2016 From: alessio at skye.it (Alessio Cecchi) Date: Fri, 4 Mar 2016 16:38:29 +0100 Subject: v2.2.22 release candidate released In-Reply-To: References: Message-ID: <56D9ABF5.5020007@skye.it> Il 04/03/2016 14:33, Timo Sirainen ha scritto: > let us know if you have some improvement ideas I think would be useful to have "doveadm auth cache flush" also per domain, example: doveadm auth cache flush *@domain.com like doveadm quota. -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From miquels at cistron.nl Fri Mar 4 15:40:29 2016 From: miquels at cistron.nl (Miquel van Smoorenburg) Date: Fri, 4 Mar 2016 16:40:29 +0100 Subject: v2.2.22 release candidate released In-Reply-To: References: Message-ID: <56D9AC6D.1080704@cistron.nl> On 04/03/16 14:33, Timo Sirainen wrote: > There are some larger changes here, especially to doveadm to make it > support HTTP API. There's still time to do smaller tweaks to the API, > so let us know if you have some improvement ideas. Note that the API > was designed to look mostly like JMAP, which we're planning to > implement also for v2.3. The plan is to fork v2.3 development tree > soon. Let me say that I think it's really cool that you're adding support for JMAP. This will make it possible for front-end developers to build webmail or mail-aware applications right on top of dovecot, instead of first having to build a server-side middleware layer between IMAP and the application. Question: some time ago you mentioned that you were going to work on caldav/carddav support. What is the status of that, and will the calendar/contacts database be available over JMAP as well? Thanks, Mike. From r.zimmermann at siegnetz.de Fri Mar 4 15:46:00 2016 From: r.zimmermann at siegnetz.de (Ralf Zimmermann) Date: Fri, 4 Mar 2016 16:46:00 +0100 Subject: Dovecort-2.2.22 Message-ID: <23AAD3F9-FEA4-428D-982C-CB622F14589A@siegnetz.de> With Dovecot-2.2.22 and enabled virtual plugin I get following error messages: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x819f0) [0x7f12330bf9f0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x81adc) [0x7f12330bfadc] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f123306833d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_close+0x178) [0x7f12320599f8] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9f94) [0x7f1232059f94] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9fe9) [0x7f1232059fe9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f12333825da] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7f1233382663] -> dovecot/imap() [0x41870f] -> dovecot/imap() [0x423ce4] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xda) [0x7f12330d28aa] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x9c) [0x7f12330d3cbc] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f12330d2a65] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f12330d2c08] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f123306da23] -> dovecot/imap(main+0x2d7) [0x40c3c7] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f1232cb4b45] -> dovecot/imap() [0x40c530] I test it with this configuration on Debian Jessie 64-bit: # dovecot.conf mail_plugins = $mail_plugins acl quota zlib virtual namespace { prefix = virtual/ separator = / location = virtual:~/Maildir/virtual } # ~/Maildir/virtual/unseen/dovecot-virtual INBOX unseen Mit freundlichen Gr??en Ralf Zimmermann Senior Security Engineer State Certified Engineer SIEGNETZ.IT GmbH Einheitsstrasse 2, D-57076 Siegen Telefon: +4927168193130 Fax: +492716819329 Mobil : +491735360015 http://www.siegnetz.de http://rz.siegnetz.de Amtsgericht Siegen HRB4838 Gesch?ftsf?hrer: Oliver Seitz Sitz der Gesellschaft ist Siegen -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From tss at iki.fi Fri Mar 4 15:49:51 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 4 Mar 2016 17:49:51 +0200 Subject: v2.2.22 release candidate released In-Reply-To: <56D9AC6D.1080704@cistron.nl> References: <56D9AC6D.1080704@cistron.nl> Message-ID: On 04 Mar 2016, at 17:40, Miquel van Smoorenburg wrote: > > Question: some time ago you mentioned that you were going to work on caldav/carddav support. What is the status of that, and will the calendar/contacts database be available over JMAP as well? Initially JMAP will be email-only. The CalDAV/CardDAV plans have been postponed for now. From pch at myzel.net Fri Mar 4 18:15:03 2016 From: pch at myzel.net (Peter Chiochetti) Date: Fri, 4 Mar 2016 19:15:03 +0100 Subject: Ubuntu packages Message-ID: <56D9D0A7.3040303@myzel.net> Since dovecot put up packages on their own repo, bigmichi stopped providing his'. I guess this is not Stephan; Would the kind person update ppa.launchpad.net/bigmichi1 ? Thank You -- peter From pch at myzel.net Fri Mar 4 18:20:50 2016 From: pch at myzel.net (Peter Chiochetti) Date: Fri, 4 Mar 2016 19:20:50 +0100 Subject: v2.2.22 release candidate released In-Reply-To: References: Message-ID: <56D9D202.5080309@myzel.net> Am 2016-03-04 um 14:33 schrieb Timo Sirainen: > + Added doveadm HTTP API: See > http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP Hmm, so anybody who has the API key can send any doveadm commands? I guess something like /etc/sudoers for API keys would be good? Did I miss something? -- peter From aki.tuomi at dovecot.fi Fri Mar 4 18:27:32 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 04 Mar 2016 20:27:32 +0200 Subject: VS: Re: v2.2.22 release candidate released Message-ID: In future release we will add master authentication too. Now you can use api key or doveadm password which are essentially same thing. ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: Peter Chiochetti P?iv?m??r?: 4.3.2016 20.20 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: v2.2.22 release candidate released Am 2016-03-04 um 14:33 schrieb Timo Sirainen: >?? + Added doveadm HTTP API: See >???? http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP Hmm, so anybody who has the API key can send any doveadm commands? I guess something like /etc/sudoers for API keys would be good? Did I miss something? -- peter From rs at sys4.de Fri Mar 4 19:51:15 2016 From: rs at sys4.de (Robert Schetterer) Date: Fri, 4 Mar 2016 20:51:15 +0100 Subject: Ubuntu packages In-Reply-To: <56D9D0A7.3040303@myzel.net> References: <56D9D0A7.3040303@myzel.net> Message-ID: <56D9E733.5000509@sys4.de> Am 04.03.2016 um 19:15 schrieb Peter Chiochetti: > Since dovecot put up packages on their own repo, bigmichi stopped > providing his'. I guess this is not Stephan; Would the kind person > update ppa.launchpad.net/bigmichi1 ? > > Thank You > what wrong with http://wiki.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages builds fine on ubuntu 14.04 Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From tss at iki.fi Fri Mar 4 20:02:07 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 4 Mar 2016 22:02:07 +0200 Subject: Dovecort-2.2.22 In-Reply-To: <23AAD3F9-FEA4-428D-982C-CB622F14589A@siegnetz.de> References: <23AAD3F9-FEA4-428D-982C-CB622F14589A@siegnetz.de> Message-ID: <6561C663-2D5F-4019-BEEB-A1007066CA8E@iki.fi> On 04 Mar 2016, at 17:46, Ralf Zimmermann wrote: > > With Dovecot-2.2.22 and enabled virtual plugin I get following error messages: > > Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x819f0) [0x7f12330bf9f0] -> The raw backtrace isn't very helpful unfortunately. What was the panic log message before this? Also it could be helpful to have gdb backtrace: http://dovecot.org/bugreport.html From pch at myzel.net Fri Mar 4 20:02:13 2016 From: pch at myzel.net (Peter Chiochetti) Date: Fri, 4 Mar 2016 21:02:13 +0100 Subject: Ubuntu packages In-Reply-To: <56D9E733.5000509@sys4.de> References: <56D9D0A7.3040303@myzel.net> <56D9E733.5000509@sys4.de> Message-ID: <56D9E9C5.6020004@myzel.net> Am 2016-03-04 um 20:51 schrieb Robert Schetterer: > Am 04.03.2016 um 19:15 schrieb Peter Chiochetti: >> Since dovecot put up packages on their own repo, bigmichi stopped >> providing his'. I guess this is not Stephan; Would the kind person >> update ppa.launchpad.net/bigmichi1 ? >> >> Thank You >> > > what wrong with > > http://wiki.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages > > builds fine on ubuntu 14.04 Dear Robert, I tried a deb-package of those once (Jan 2014), but it badly messed with upstart files in /etc, which is not the same in ubuntu and debian -- peter From stephan at rename-it.nl Fri Mar 4 20:03:40 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 4 Mar 2016 21:03:40 +0100 Subject: Ubuntu packages In-Reply-To: <56D9D0A7.3040303@myzel.net> References: <56D9D0A7.3040303@myzel.net> Message-ID: <56D9EA1C.3020302@rename-it.nl> Op 3/4/2016 om 7:15 PM schreef Peter Chiochetti: > Since dovecot put up packages on their own repo, bigmichi stopped > providing his'. I guess this is not Stephan; Would the kind person > update ppa.launchpad.net/bigmichi1 ? The Xi packages are built for Ubuntu here: https://build.opensuse.org/project/repositories/home:sbosch:dovecot-2.2 Regards, Stephan. From mysql.jorge at decimal.pt Fri Mar 4 17:17:37 2016 From: mysql.jorge at decimal.pt (Jorge Bastos) Date: Fri, 4 Mar 2016 17:17:37 -0000 Subject: Dovecot & Pigeon w/ MySQL In-Reply-To: <56D97242.5090905@rename-it.nl> References: <56D97242.5090905@rename-it.nl> Message-ID: Hi Stephan, Oh I see. Is there this feature request already to support the save on MySQL/database? Jorge, > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Stephan > Bosch > Sent: sexta-feira, 4 de Mar?o de 2016 11:32 > To: Jorge Bastos; 'Dovecot Mailing List' > Subject: Re: Dovecot & Pigeon w/ MySQL > > Op 3/3/2016 om 4:03 PM schreef Jorge Bastos: > > Howdy, > > > > > > > > I'm looking for a good howto to have pigeon saving the sieve scripts > > on an mysql table. > > Pigeonhole can currently only retrieve Sieve scripts from a database, > not store them there; .e.g., from ManageSieve. > > > Can some point me to a good one? Dr. google doesn't show me much > about it. > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration/Dict > > Regards, > > Stephan. From pch at myzel.net Fri Mar 4 20:18:36 2016 From: pch at myzel.net (Peter Chiochetti) Date: Fri, 4 Mar 2016 21:18:36 +0100 Subject: Ubuntu packages In-Reply-To: <56D9EA1C.3020302@rename-it.nl> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> Message-ID: <56D9ED9C.6060104@myzel.net> Am 2016-03-04 um 21:03 schrieb Stephan Bosch: > Op 3/4/2016 om 7:15 PM schreef Peter Chiochetti: >> Since dovecot put up packages on their own repo, bigmichi stopped >> providing his'. I guess this is not Stephan; Would the kind person >> update ppa.launchpad.net/bigmichi1 ? > > The Xi packages are built for Ubuntu here: > > https://build.opensuse.org/project/repositories/home:sbosch:dovecot-2.2 > Dear Stephan, in Ubuntu (12.04 here) /etc/init.d/dovecot is symlinked to /lib/init/upstart-job - but its in your package too, so installing your package might damage the upstart job. I remember having seen this (in 2014). -- peter From stephan at rename-it.nl Fri Mar 4 20:38:03 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 4 Mar 2016 21:38:03 +0100 Subject: Ubuntu packages In-Reply-To: <56D9ED9C.6060104@myzel.net> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> Message-ID: <56D9F22B.4060005@rename-it.nl> Op 3/4/2016 om 9:18 PM schreef Peter Chiochetti: > Am 2016-03-04 um 21:03 schrieb Stephan Bosch: >> Op 3/4/2016 om 7:15 PM schreef Peter Chiochetti: >>> Since dovecot put up packages on their own repo, bigmichi stopped >>> providing his'. I guess this is not Stephan; Would the kind person >>> update ppa.launchpad.net/bigmichi1 ? >> >> The Xi packages are built for Ubuntu here: >> >> https://build.opensuse.org/project/repositories/home:sbosch:dovecot-2.2 >> > > Dear Stephan, in Ubuntu (12.04 here) /etc/init.d/dovecot is symlinked > to /lib/init/upstart-job - but its in your package too, so installing > your package might damage the upstart job. I remember having seen this > (in 2014). Then why doesn't anyone ever tell me? :) I'll give that a look at the next Xi revision, which will happen quite soon. Regards, Stephan. From michael.slusarz at dovecot.fi Fri Mar 4 22:35:59 2016 From: michael.slusarz at dovecot.fi (Michael M Slusarz) Date: Fri, 4 Mar 2016 15:35:59 -0700 Subject: VS: Re: v2.2.22 release candidate released In-Reply-To: References: Message-ID: <56DA0DCF.6040305@dovecot.fi> And you are normally only exposing doveadm functionality in internal, private networks. On 3/4/2016 11:27 AM, Aki Tuomi wrote: > In future release we will add master authentication too. Now you can use api key or doveadm password which are essentially same thing. > ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: Peter Chiochetti P?iv?m??r?: 4.3.2016 20.20 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: v2.2.22 release candidate released > Am 2016-03-04 um 14:33 schrieb Timo Sirainen: >> + Added doveadm HTTP API: See >> http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP > Hmm, so anybody who has the API key can send any doveadm commands? > > I guess something like /etc/sudoers for API keys would be good? > > Did I miss something? > From webmaster at hotslots132.com Sat Mar 5 02:10:55 2016 From: webmaster at hotslots132.com (HotSlots Webmaster) Date: Fri, 4 Mar 2016 21:10:55 -0500 Subject: Dovecot stops responding when I update SSL certificate Message-ID: <56DA402F.4070703@hotslots132.com> Dovecot 2.2.18 CentOS 6.7 (x86_64) Plesk 12.5.30 I have had Dovecot working fine with SSL for nearly two years now. It's time to renew the SSL certificate, so I did (same CA). The new certificate works fine in Apache and Postfix. But when I update Dovecot to use the same certificate, and restart the server, Dovecot stops responding to connects. I have triple-checked that the ssl_cert and ssl_key files are correct - all I did was change the names in the conf file. There's nothing in the log. I have tried various SSL tests but either they don't work (unspecific error) or they tell me nothing is wrong (and show the correct certificate.) I am running out of time to find a solution to this - what else can I look for? The one difference for the certificates is that I opted for one with a SHA256 root rather than SHA1 root. I have separately used a tool to verify that the certificate and private key match. Here is the end of the dovecot -n file that mentions SSL: ssl = required ssl_cert = Did you change dh parameter size as well? This causes dh generation which can take some time. ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: HotSlots Webmaster P?iv?m??r?: 5.3.2016 4.10 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Dovecot stops responding when I update SSL certificate Dovecot 2.2.18 CentOS 6.7 (x86_64) Plesk 12.5.30 I have had Dovecot working fine with SSL for nearly two years now. It's time to renew the SSL certificate, so I did (same CA). The new certificate works fine in Apache and Postfix. But when I update Dovecot to use the same certificate, and restart the server, Dovecot stops responding to connects. I have triple-checked that the ssl_cert and ssl_key files are correct - all I did was change the names in the conf file. There's nothing in the log. I have tried various SSL tests but either they don't work (unspecific error) or they tell me nothing is wrong (and show the correct certificate.)? I am running out of time to find a solution to this - what else can I look for? The one difference for the certificates is that I opted for one with a SHA256 root rather than SHA1 root. I have separately used a tool to verify that the certificate and private key match. Here is the end of the dovecot -n file that mentions SSL: ssl = required ssl_cert = References: <56CB037D.5060106@kerkhove.net> <058F4338-C3E4-43EC-BE29-068C30152CF7@iki.fi> Message-ID: <56DAB00E.1020000@kerkhove.net> Hi Timo, Thanks for your answer! Sorry for my ignorance. That was exactly the location I read it, but failed to notice that only mbox/maildir is mentioned there. thanks, Alex. Timo Sirainen wrote: > On 22 Feb 2016, at 14:47, alex wrote: >> >> Hi, >> >> I've been testing mdbox with local indexes on our nfs based directors + >> multiple imap/lda/pop3 server setup. The performance is noticeably >> better than maildir with indexes on nfs, so I'd like to make this work. >> >> About the possible direction to other servers the wiki says that it will >> create a new index 'on the fly'. That is true, but after the index is >> recreated, Thunderbird (imap) re-downloads all the messages and sees all >> those messages as unread again! > > dbox format requires permanent indexes, so you must store them on NFS also. Only mbox and Maildir formats can recreate indexes on the fly without losing information. Is there still some documentation that talks about indexes being able to be recreated from scratch, without mentioning dbox? I tried quickly finding from wiki, but I only found the NFS page mentioning it and it specifically said mbox/Maildir. I added "(but not dbox!)" as clarification. Anywhere else?.. > From andrew.mcglashan at affinityvision.com.au Sat Mar 5 17:40:58 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Sun, 6 Mar 2016 04:40:58 +1100 Subject: Ubuntu packages In-Reply-To: <56D9D0A7.3040303@myzel.net> References: <56D9D0A7.3040303@myzel.net> Message-ID: <56DB1A2A.2000800@affinityvision.com.au> On 5/03/2016 5:15 AM, Peter Chiochetti wrote: > Since dovecot put up packages on their own repo, bigmichi stopped > providing his'. I guess this is not Stephan; Would the kind person > update ppa.launchpad.net/bigmichi1 ? Trusting ppas .... not for me. Running somebody elses' ppa on your system can be a serious security risk; you really have to trust those giving you the ppa access. Cheers A. From rs at sys4.de Sat Mar 5 18:18:44 2016 From: rs at sys4.de (Robert Schetterer) Date: Sat, 5 Mar 2016 19:18:44 +0100 Subject: Ubuntu packages In-Reply-To: <56DB1A2A.2000800@affinityvision.com.au> References: <56D9D0A7.3040303@myzel.net> <56DB1A2A.2000800@affinityvision.com.au> Message-ID: <56DB2304.7050701@sys4.de> Am 05.03.2016 um 18:40 schrieb Andrew McGlashan: > > On 5/03/2016 5:15 AM, Peter Chiochetti wrote: >> Since dovecot put up packages on their own repo, bigmichi stopped >> providing his'. I guess this is not Stephan; Would the kind person >> update ppa.launchpad.net/bigmichi1 ? > > Trusting ppas .... not for me. > > Running somebody elses' ppa on your system can be a serious security > risk; you really have to trust those giving you the ppa access. > > Cheers > A. > for paranoid people, create you own repo and for info dovecot had nice compiled from scratch to me in the past too Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From noel.butler at ausics.net Sun Mar 6 00:21:06 2016 From: noel.butler at ausics.net (Noel Butler) Date: Sun, 06 Mar 2016 10:21:06 +1000 Subject: Ubuntu packages In-Reply-To: <56DB2304.7050701@sys4.de> References: <56D9D0A7.3040303@myzel.net> <56DB1A2A.2000800@affinityvision.com.au> <56DB2304.7050701@sys4.de> Message-ID: On 06/03/2016 04:18, Robert Schetterer wrote: > for paranoid people, create you own repo > and for info dovecot had nice compiled from scratch to me in the past > too The only way to use dovecot IMHO is by source, you build in what you want and omit the junk (that some repo packagers want to include - because they need cater for many scenarios) that you have no need for, sadly though, dovecot has lapsed a bit in security in this respect since we used to be able to disable all non-wanted password types, but now we have many of them non configurable and get them built in whether we like it or not, its one of two gripes I've had with dovecot 2.x, otherwise, reasonable happy with it now days. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From doctor at doctor.nl2k.ab.ca Sun Mar 6 02:00:34 2016 From: doctor at doctor.nl2k.ab.ca (The Doctor) Date: Sat, 5 Mar 2016 19:00:34 -0700 Subject: v2.2.22 release candidate released In-Reply-To: References: Message-ID: <20160306020034.GA20901@doctor.nl2k.ab.ca> On Fri, Mar 04, 2016 at 03:33:55PM +0200, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.22.rc1.tar.gz > http://dovecot.org/releases/2.2/rc/dovecot-2.2.22.rc1.tar.gz.sig > > There are some larger changes here, especially to doveadm to make it support HTTP API. There's still time to do smaller tweaks to the API, so let us know if you have some improvement ideas. Note that the API was designed to look mostly like JMAP, which we're planning to implement also for v2.3. The plan is to fork v2.3 development tree soon. > > + Added doveadm HTTP API: See > http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP > + virtual plugin: Mailbox filtering can now be done based on the > mailbox metadata. See http://wiki2.dovecot.org/Plugins/Virtual > + stats: Added doveadm stats reset to reset global stats. > + stats: Added authentication statistics if auth_stats=yes. > + dsync, imapc, pop3c & pop3-migration: Many optimizations, > improvements and error handling fixes. > + doveadm: Most commands now stop soon after SIGINT/SIGTERM. > - auth: Auth caching was done too aggressively when %variables were > used in default_fields, override_fields or LDAP pass/user_attrs. > userdb result_* were also ignored when user was found from cache. > - imap: Fixed various assert-crashes caused v2.2.20+. Some of them > caught actual hangs or otherwise unwanted behavior towards IMAP > clients. > - Expunges were forgotten in some situations, for example when > pipelining multiple IMAP MOVE commands. > - quota: Per-namespaces quota were broken for dict and count backends > in v2.2.20+ > - fts-solr: Search queries were using OR instead of AND as the > separator for multi-token search queries in v2.2.20+. Running into a problem. >From the logs: Main log Mar 05 18:53:13 master: Info: Dovecot v2.2.22.rc1 (fe789d2) starting up for ima p, pop3, lmtp (core dumps disabled) Mar 05 18:53:16 pop3-login: Debug: SSL: where=0x10, ret=1: before/accept initia lization [172.219.116.147] Mar 05 18:53:16 pop3-login: Debug: SSL: where=0x2001, ret=1: before/accept init ialization [172.219.116.147] Mar 05 18:53:16 pop3-login: Debug: SSL: where=0x2002, ret=-1: SSLv2/v3 read cli ent hello A [172.219.116.147] Mar 05 18:53:16 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client hello A [172.219.116.147] Mar 05 18:53:16 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server hello A [172.219.116.147] Mar 05 18:53:16 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write certif icate A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write key ex change A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server done A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 flush data [ 172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client certificate A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client key exchange A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read certifi cate verify A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read finishe d A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write sessio n ticket A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write change cipher spec A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write finish ed A [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 flush data [ 172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x20, ret=1: SSL negotiation fini shed successfully [172.219.116.147] Mar 05 18:53:17 pop3-login: Debug: SSL: where=0x2002, ret=1: SSL negotiation fi nished successfully [172.219.116.147] Mar 05 18:53:17 POP3(aboo):Debug: Added userdb setting: plugin/aboo=yes Mar 05 18:53:17 pop3-login: Info: Login: user=, method=PLAIN, rip=172.219 .116.147, lip=204.209.81.1, TLS Mar 05 18:53:17 POP3(aboo):Debug: Effective uid=3094, gid=100, home=/usr/home/a boo Mar 05 18:53:17 POP3(aboo):Debug: fs: root=/usr/home/aboo/mail, index=, indexpv t=, control=, inbox=/var/mail/aboo, alt= Mar 05 18:53:17 POP3(aboo):Info: Disconnected: Logged out top=0/0, retr=0/0, de l=0/8, size=210851 Mar 05 18:53:17 pop3-login: Debug: SSL alert: close notify [172.219.116.147] 2nd log Mar 05 18:53:13 config: Error: Couldn't load plugin /usr/dovecot2221/lib/doveco t/settings/libmanagesieve_login_settings.so: Module is for different ABI versio n 2.2.ABIv13(2.2.13) (we have 2.2.ABIv22(2.2.22.rc1)) Mar 05 18:53:13 config: Error: Couldn't load plugin /usr/dovecot2221/lib/doveco t/settings/libmanagesieve_settings.so: Module is for different ABI version 2.2. ABIv13(2.2.13) (we have 2.2.ABIv22(2.2.22.rc1)) Mar 05 18:53:13 auth: Error: passwd-file /etc/passwd: User root has invalid UID '0' Mar 05 18:53:13 auth: Error: passwd-file /etc/passwd: User doctor has invalid G ID '0' Mar 05 18:53:17 auth: Error: recvmsg() failed: Resource temporarily unavailable Mar 05 18:53:17 auth-worker(20615): Error: passwd-file /etc/passwd: User root h as invalid UID '0' Mar 05 18:53:17 auth-worker(20615): Error: passwd-file /etc/passwd: User doctor has invalid GID '0' l/.imap/INBOX/dovecot.index.log: Operation not supported Lifetime of dovecot 2.22.22.rc1 5 seconds up. Lifetime of 2.2.18 endless unless interrupted. Help. -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca God,Queen and country!Never Satan President Republic!Beware AntiChrist rising! http://www.fullyfollow.me/rootnl2k Look at Psalms 14 and 53 on Atheism Manitoba and Saskatchewan! Save your provinces in April! Vote Liberal!! From jtam.home at gmail.com Sun Mar 6 02:45:58 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Sat, 5 Mar 2016 18:45:58 -0800 (PST) Subject: Dovecot stops responding when I update SSL certificate In-Reply-To: References: Message-ID: HotSlots Webmaster writes: > I have had Dovecot working fine with SSL for nearly two years now. It's > time to renew the SSL certificate, so I did (same CA). The new > certificate works fine in Apache and Postfix. But when I update Dovecot > to use the same certificate, and restart the server, Dovecot stops > responding to connects. > ... > Here is the end of the dovecot -n file that mentions SSL: > ... > ssl_dh_parameters_length = 2048 When you start dovecot, does CPU load of dovecot/ssl-params roof to 100%? It's possible it's generating ephemeral DH keys. In a previous post to this list, I note that the run time to generate these keys can vary wildly, and gets worse with longer keys. Sometimes you get lucky, and you'll generate then quickly, sometimes it takes a long while (minutes). http://dovecot.org/pipermail/dovecot/2015-November/102447.html Try running openssl dhparam -noout 2048 to see how it varies for you. If what I suspect is true, you can try using shorter keys. A followup post suggest a way you can precompute the key Joseph Tam From rs at sys4.de Sun Mar 6 06:28:02 2016 From: rs at sys4.de (Robert Schetterer) Date: Sun, 6 Mar 2016 07:28:02 +0100 Subject: v2.2.22 release candidate released In-Reply-To: <20160306020034.GA20901@doctor.nl2k.ab.ca> References: <20160306020034.GA20901@doctor.nl2k.ab.ca> Message-ID: <56DBCDF2.1010501@sys4.de> Am 06.03.2016 um 03:00 schrieb The Doctor: > Error: Couldn't load plugin /usr/dovecot2221/lib/doveco > t/settings/libmanagesieve_settings.so: Module is for different ABI version 2.2. > ABIv13(2.2.13) (we have 2.2.ABIv22(2.2.22.rc1)) that looks like you didnt really upgraded Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From andrew.mcglashan at affinityvision.com.au Sun Mar 6 08:36:59 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Sun, 6 Mar 2016 19:36:59 +1100 Subject: Implementation of TLS OCSP Stapling In-Reply-To: <22117102.23976.6e161d0f-e69a-4ba2-bc6a-8e29e71b33fc.open-xchange@appsuite.open-xchange.com> References: <20160303130439.Horde.4oS5C8vmvjWGUN7Gid3g2Jr@andreasschulze.de> <56D82AF7.4080107@flut.demon.nl> <22117102.23976.6e161d0f-e69a-4ba2-bc6a-8e29e71b33fc.open-xchange@appsuite.open-xchange.com> Message-ID: <56DBEC2B.5040307@affinityvision.com.au> On 3/03/2016 11:58 PM, aki.tuomi at dovecot.fi wrote: > We will take this feature under consideration and see if it can be implemented > in future release. Thank you for your suggestion! As much as I hate Outlook (Look Out!), there are loads of people using really old versions; 2003 is no longer supported, but loads of people use 2007. Thunderbird can be expected to be far more up to date. Implementing features to work with older clients will always be a problem. Just a simple example, almost unrelated here, but this is either wrong by TB or wrong by Outlook (versions 2007, 2010 and 2013 that I know of). When the IMAP server sends a message, OL will pop up a window that requires the user to acknowledge the message via a popup. TB just pops up the message in the normal 'new mail' notify if that is configured and it might be lost if notify isn't set to show. Either way, the implementation is different b/w the two client products. Is OL right or is TB right... IMAP doco says that the message should be made to be acknowledged by the client; OL's version can't easily be ignored or missed, but TB's can easily be missed. But TB's implementation is more user friendly if the server wants to keep sending messages from time to time. I considered using this for MOTD type stuff and maybe random inspirational or motivational messages; even to remind or inform users to do certain things [one example in the dovecot wiki is to advise that the vacation message is still active]. A TB notification is next to harmless, but an OL one needs to be acknowledged every time, which would be very painful. Anyway, the point is that if a feature is added for OCSP stabling support, you couldn't really expect older versions of Look Out to comply with it (even though M$ could patch it easily, they care less about older versions than getting people to subscribe to Office 365 these days). Cheers A. From aki.tuomi at dovecot.fi Sun Mar 6 09:09:42 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Sun, 06 Mar 2016 11:09:42 +0200 Subject: VS: Re: Implementation of TLS OCSP Stapling Message-ID: <0xhhlbs37p8qn32m1s1c65it.1457255382968@email.android.com> Luckily ocsp stapling is an SSL extension and clients not supporting it won't be asking for it either. ---Aki TuomiDovecot oy -------- Alkuper?inen viesti --------L?hett?j?: Andrew McGlashan P?iv?m??r?: 6.3.2016 10.36 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: Implementation of TLS OCSP Stapling On 3/03/2016 11:58 PM, aki.tuomi at dovecot.fi wrote: > We will take this feature under consideration and see if it can be implemented > in future release. Thank you for your suggestion! As much as I hate Outlook (Look Out!), there are loads of people using really old versions; 2003 is no longer supported, but loads of people use 2007.? Thunderbird can be expected to be far more up to date. Implementing features to work with older clients will always be a problem. Just a simple example, almost unrelated here, but this is either wrong by TB or wrong by Outlook (versions 2007, 2010 and 2013 that I know of). When the IMAP server sends a message, OL will pop up a window that requires the user to acknowledge the message via a popup.? TB just pops up the message in the normal 'new mail' notify if that is configured and it might be lost if notify isn't set to show. Either way, the implementation is different b/w the two client products. Is OL right or is TB right... IMAP doco says that the message should be made to be acknowledged by the client; OL's version can't easily be ignored or missed, but TB's can easily be missed.? But TB's implementation is more user friendly if the server wants to keep sending messages from time to time.? I considered using this for MOTD type stuff and maybe random inspirational or motivational messages; even to remind or inform users to do certain things [one example in the dovecot wiki is to advise that the vacation message is still active].? A TB notification is next to harmless, but an OL one needs to be acknowledged every time, which would be very painful. Anyway, the point is that if a feature is added for OCSP stabling support, you couldn't really expect older versions of Look Out to comply with it (even though M$ could patch it easily, they care less about older versions than getting people to subscribe to Office 365 these days). Cheers A. From aki.tuomi at dovecot.fi Sun Mar 6 09:14:06 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 6 Mar 2016 11:14:06 +0200 (EET) Subject: Dovecot stops responding when I update SSL certificate In-Reply-To: References: Message-ID: <713900508.3256.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> > On March 6, 2016 at 4:45 AM Joseph Tam wrote: > > > HotSlots Webmaster writes: > > > I have had Dovecot working fine with SSL for nearly two years now. It's > > time to renew the SSL certificate, so I did (same CA). The new > > certificate works fine in Apache and Postfix. But when I update Dovecot > > to use the same certificate, and restart the server, Dovecot stops > > responding to connects. > > ... > > Here is the end of the dovecot -n file that mentions SSL: > > ... > > ssl_dh_parameters_length = 2048 > > When you start dovecot, does CPU load of dovecot/ssl-params roof to 100%? > It's possible it's generating ephemeral DH keys. In a previous post > to this list, I note that the run time to generate these keys can vary > wildly, and gets worse with longer keys. Sometimes you get lucky, and > you'll generate then quickly, sometimes it takes a long while (minutes). > > http://dovecot.org/pipermail/dovecot/2015-November/102447.html > > Try running > > openssl dhparam -noout 2048 > > to see how it varies for you. If what I suspect is true, you can try > using shorter keys. A followup post suggest a way you can precompute > the key > > Joseph Tam We are going to provide ssl_dh parameter in v2.3 which replaces the current ssl parameters daemon with simple PEM encoded file that you provide. --- Aki Tuomi Dovecot Oy From aki.tuomi at dovecot.fi Sun Mar 6 09:16:46 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 6 Mar 2016 11:16:46 +0200 (EET) Subject: Ubuntu packages In-Reply-To: <56D9F22B.4060005@rename-it.nl> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> Message-ID: <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> > On March 4, 2016 at 10:38 PM Stephan Bosch wrote: > > > Op 3/4/2016 om 9:18 PM schreef Peter Chiochetti: > > Am 2016-03-04 um 21:03 schrieb Stephan Bosch: > >> Op 3/4/2016 om 7:15 PM schreef Peter Chiochetti: > >>> Since dovecot put up packages on their own repo, bigmichi stopped > >>> providing his'. I guess this is not Stephan; Would the kind person > >>> update ppa.launchpad.net/bigmichi1 ? > >> > >> The Xi packages are built for Ubuntu here: > >> > >> https://build.opensuse.org/project/repositories/home:sbosch:dovecot-2.2 > >> > > > > Dear Stephan, in Ubuntu (12.04 here) /etc/init.d/dovecot is symlinked > > to /lib/init/upstart-job - but its in your package too, so installing > > your package might damage the upstart job. I remember having seen this > > (in 2014). > > Then why doesn't anyone ever tell me? :) > > I'll give that a look at the next Xi revision, which will happen quite soon. > > Regards, > > Stephan. Stephan, for Jessie you should compile with systemd support enabled and leave the init.d link out completely. You can enable the ProtectFull=yes in the systemd file. --- Aki Tuomi Dovecot Oy From sca at andreasschulze.de Sun Mar 6 09:34:52 2016 From: sca at andreasschulze.de (A. Schulze) Date: Sun, 06 Mar 2016 10:34:52 +0100 Subject: Dovecot stops responding when I update SSL certificate In-Reply-To: <713900508.3256.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> References: <713900508.3256.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: <20160306103452.Horde.fT25duPBbRXtiHlqk5hUSId@andreasschulze.de> aki.tuomi: > We are going to provide ssl_dh parameter in v2.3 which replaces the > current ssl parameters daemon with simple PEM encoded file that you > provide. good thing. that simplify the process of dh regeneration to a method admins are more familiar with. > > --- > Aki Tuomi > Dovecot Oy From pch at myzel.net Sun Mar 6 10:48:55 2016 From: pch at myzel.net (Peter Chiochetti) Date: Sun, 6 Mar 2016 11:48:55 +0100 Subject: VS: Re: v2.2.22 release candidate released In-Reply-To: <56DA0DCF.6040305@dovecot.fi> References: <56DA0DCF.6040305@dovecot.fi> Message-ID: <56DC0B17.8010205@myzel.net> Am 2016-03-04 um 23:35 schrieb Michael M Slusarz: > And you are normally only exposing doveadm functionality in internal, > private networks. > > On 3/4/2016 11:27 AM, Aki Tuomi wrote: >> In future release we will add master authentication too. Now you can >> use api key or doveadm password which are essentially same thing. >> ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: >> Peter Chiochetti P?iv?m??r?: 4.3.2016 20.20 >> (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: v2.2.22 release >> candidate released >> Am 2016-03-04 um 14:33 schrieb Timo Sirainen: >>> + Added doveadm HTTP API: See >>> http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP >> Hmm, so anybody who has the API key can send any doveadm commands? >> >> I guess something like /etc/sudoers for API keys would be good? >> >> Did I miss something? >> Some mails later, I got to understand: - API key is not authentication, but it is authorization So, when I plan to enable the HTTP API, I must protect the webpage where the API key lives in by the usual means, eg. HTTP Basic Authentication. Aki also told me, that there is a configurable list of allowed commands somewhere. The wiki also links to another (parent) page with more details. The number of commands is limited now, but may grow. -- peter From sven at svenhartge.de Sun Mar 6 17:06:26 2016 From: sven at svenhartge.de (Sven Hartge) Date: Sun, 6 Mar 2016 18:06:26 +0100 Subject: Ubuntu packages References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: aki.tuomi at dovecot.fi wrote: > Stephan, for Jessie you should compile with systemd support enabled and leave > the init.d link out completely. Please don't disable SysV-init-compatibility. It still is a supported Init-System for Jessie and there are people using it. Removing the init script will break the packages for everybody not using systemd. Gr??e, Sven. -- Sigmentation fault. Core dumped. From andrew.mcglashan at affinityvision.com.au Sun Mar 6 17:22:44 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Mon, 7 Mar 2016 04:22:44 +1100 Subject: Ubuntu packages In-Reply-To: <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: <56DC6764.1010707@affinityvision.com.au> On 6/03/2016 8:16 PM, aki.tuomi at dovecot.fi wrote: > Stephan, for Jessie you should compile with systemd support enabled and leave > the init.d link out completely. You can enable the ProtectFull=yes in the > systemd file. Many of us Debian users hate the fact that systemd even exists..... for now we can run servers without systemd, but who knows in a few years or a couple of releases. systemd is a cancer, that's been said before and it will be long time, if ever, before it is not said regularly. Cheers A. From aki.tuomi at dovecot.fi Sun Mar 6 17:32:57 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 6 Mar 2016 19:32:57 +0200 (EET) Subject: Ubuntu packages In-Reply-To: <56DC6764.1010707@affinityvision.com.au> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <56DC6764.1010707@affinityvision.com.au> Message-ID: <1675860110.3454.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> > On March 6, 2016 at 7:22 PM Andrew McGlashan > wrote: > > > On 6/03/2016 8:16 PM, aki.tuomi at dovecot.fi wrote: > > Stephan, for Jessie you should compile with systemd support enabled and > > leave > > the init.d link out completely. You can enable the ProtectFull=yes in the > > systemd file. > > Many of us Debian users hate the fact that systemd even exists..... for > now we can run servers without systemd, but who knows in a few years or > a couple of releases. > > systemd is a cancer, that's been said before and it will be long time, > if ever, before it is not said regularly. > > Cheers > A. Yet, it would be good idea to enable systemd support for those who use systemd, despite being considered as cancerous by some people, with the same justification that some want to use systemd. Retaining the init.d script does pose some problems, mainly because it seems to interfere with systemctl enable command which gets confused. Aki From sven at svenhartge.de Sun Mar 6 17:41:56 2016 From: sven at svenhartge.de (Sven Hartge) Date: Sun, 6 Mar 2016 18:41:56 +0100 Subject: Ubuntu packages References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <56DC6764.1010707@affinityvision.com.au> <1675860110.3454.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: aki.tuomi at dovecot.fi wrote: > Yet, it would be good idea to enable systemd support for those who use systemd, > despite being considered as cancerous by some people, with the same > justification that some want to use systemd. Retaining the init.d script does > pose some problems, mainly because it seems to interfere with systemctl enable > command which gets confused. It does? How? If your unit and the init-script are named the same, everything should work as expected. Gr??e, Sven. -- Sigmentation fault. Core dumped. From edgar at pettijohn-web.com Sun Mar 6 17:45:16 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sun, 6 Mar 2016 11:45:16 -0600 Subject: Ubuntu packages In-Reply-To: References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <56DC6764.1010707@affinityvision.com.au> <1675860110.3454.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: <56DC6CAC.3050208@pettijohn-web.com> I believe we have crossed the realm of off topic. I have no desire to hear about the construction of ubuntu packages. On 03/06/16 11:41, Sven Hartge wrote: > aki.tuomi at dovecot.fi wrote: > >> Yet, it would be good idea to enable systemd support for those who use systemd, >> despite being considered as cancerous by some people, with the same >> justification that some want to use systemd. Retaining the init.d script does >> pose some problems, mainly because it seems to interfere with systemctl enable >> command which gets confused. > It does? How? > > If your unit and the init-script are named the same, everything should > work as expected. > > Gr??e, > Sven. > From slitt at troubleshooters.com Sun Mar 6 18:13:26 2016 From: slitt at troubleshooters.com (Steve Litt) Date: Sun, 6 Mar 2016 13:13:26 -0500 Subject: Ubuntu packages In-Reply-To: <56DC6764.1010707@affinityvision.com.au> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <56DC6764.1010707@affinityvision.com.au> Message-ID: <20160306131326.35b3b4a9@mydesk.domain.cxm> On Mon, 7 Mar 2016 04:22:44 +1100 Andrew McGlashan wrote: > On 6/03/2016 8:16 PM, aki.tuomi at dovecot.fi wrote: > > Stephan, for Jessie you should compile with systemd support enabled > > and leave the init.d link out completely. You can enable the > > ProtectFull=yes in the systemd file. > > Many of us Debian users hate the fact that systemd even exists..... > for now we can run servers without systemd, but who knows in a few > years or a couple of releases. > > systemd is a cancer, that's been said before and it will be long time, > if ever, before it is not said regularly. > > Cheers > A. Hi Andrew, See this thread: http://www.dovecot.org/list/dovecot/2016-February/103277.html The systemd dependencies are pretty much just cosmetic: Inclusion of a unit file, and (maybe) that special way of reporting back to systemd when the daemon is listening and fully functional, which AFAIK doesn't affect Dovecot's functionality when used in a sans-systemd environment. Much as I like Dovecot, I'll blow it off my machine in a microsecond if it ever stops functioning in the absence of systemd, and from the thread I mentioned, I doubt that will ever happen. One other thing: Later in this thread it's suggested that a distro (Debian) remove Dovecot's sysvinit init script. Although this sounds like a showstopper, it's really an opportunity. You can simply respawn Runit (or daemontools-encore or S6 or any other daemontools-inspired process supervisor) from /etc/inittab, and start Dovecot from there. The following is my huge, immense Runit run script for Dovecot: =================================================== #!/bin/sh install -d -m 0755 -o root -g root /var/run/dovecot exec dovecot -F =================================================== So even though Debian might eliminate the init script, there's a very nice way forward, and once you get Runit running, you can begin slowly switching all your massive sysvinit init scripts with 5 line Runit run scripts. And of course, you could switch to Devuan. Or do what I do: Run Void Linux, which ships with Runit actually performing PID1 init duties as well as process supervision. SteveT Steve Litt March 2016 featured book: Quit Joblessness: Start Your Own Business http://www.troubleshooters.com/startbiz From doctor at doctor.nl2k.ab.ca Mon Mar 7 01:20:49 2016 From: doctor at doctor.nl2k.ab.ca (The Doctor, 3328-138 Ave Edmonton AB T5Y 1M4, 669-2000, 473-4587) Date: Sun, 6 Mar 2016 18:20:49 -0700 (MST) Subject: v2.2.22 release candidate released In-Reply-To: <56DBCDF2.1010501@sys4.de> References: <20160306020034.GA20901@doctor.nl2k.ab.ca> <56DBCDF2.1010501@sys4.de> Message-ID: [ Charset windows-1252 unsupported, converting... ] > Am 06.03.2016 um 03:00 schrieb The Doctor: > > Error: Couldn't load plugin /usr/dovecot2221/lib/doveco > > t/settings/libmanagesieve_settings.so: Module is for different ABI version 2.2. > > ABIv13(2.2.13) (we have 2.2.ABIv22(2.2.22.rc1)) > > that looks like you didnt really upgraded > Still no dice dovecot-info.log:Mar 06 18:12:05 master: Info: Dovecot v2.2.22.rc1 (fe789d2) starting up for imap, pop3, lmtp (core dumps disabled) dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x10, ret=1: before/accept initialization [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: before/accept initialization [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client hello A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server hello A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write certificate A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write key exchange A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server done A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 flush data [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client certificate A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client key exchange A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read certificate verify A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read finished A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write session ticket A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write change cipher spec A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write finished A [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2001, ret=1: SSLv3 flush data [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x20, ret=1: SSL negotiation finished successfully [172.219.116.147] dovecot-info.log:Mar 06 18:12:29 pop3-login: Debug: SSL: where=0x2002, ret=1: SSL negotiation finished successfully [172.219.116.147] dovecot-info.log:Mar 06 18:12:30 pop3-login: Info: Login: user=, method=PLAIN, rip=172.219.116.147, lip=204.209.81.1, TLS dovecot-info.log:Mar 06 18:12:30 POP3(aboo):Debug: Added userdb setting: plugin/aboo=yes dovecot-info.log:Mar 06 18:12:30 POP3(aboo):Debug: Effective uid=3094, gid=100, home=/usr/home/aboo dovecot-info.log:Mar 06 18:12:30 POP3(aboo):Debug: fs: root=/usr/home/aboo/mail, index=, indexpvt=, control=, inbox=/var/mail/aboo, alt= dovecot-info.log:Mar 06 18:12:30 POP3(aboo):Info: Disconnected: Logged out top=0/0, retr=0/0, del=0/1, size=4862 dovecot.log:Mar 06 18:12:05 auth: Error: passwd-file /etc/passwd: User root has invalid UID '0' dovecot.log:Mar 06 18:12:05 auth: Error: passwd-file /etc/passwd: User doctor has invalid GID '0' dovecot.log:Mar 06 18:12:30 auth: Error: recvmsg() failed: Resource temporarily unavailable dovecot.log:Mar 06 18:12:30 auth-worker(17806): Error: passwd-file /etc/passwd: User root has invalid UID '0' dovecot.log:Mar 06 18:12:30 auth-worker(17806): Error: passwd-file /etc/passwd: User doctor has invalid GID '0' dovecot.log:Mar 06 18:12:30 POP3(aboo):Error: madvise() failed with file /usr/home/aboo/mail/.imap/INBOX/dovecot.index.log: Operation not supported And dies so back to Dovecot 2.2.18 > > Best Regards > MfG Robert Schetterer > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein From jaldhar at debian.org Mon Mar 7 06:22:45 2016 From: jaldhar at debian.org (Jaldhar H. Vyas) Date: Mon, 7 Mar 2016 01:22:45 -0500 (EST) Subject: Ubuntu packages In-Reply-To: <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: On Sun, 6 Mar 2016, aki.tuomi at dovecot.fi wrote: > Stephan, for Jessie you should compile with systemd support enabled and leave > the init.d link out completely. You can enable the ProtectFull=yes in the > systemd file. > For the official Debian packages which are finally up to 2.2.21 in unstable we have improved systemd support but are planning to keep supporting as long as feasible. The same applies for the backport to stable that we'll upload as soon as 2.2.21 hits testing which should be soon. -- Jaldhar H. Vyas From jaldhar at debian.org Mon Mar 7 06:28:45 2016 From: jaldhar at debian.org (Jaldhar H. Vyas) Date: Mon, 7 Mar 2016 01:28:45 -0500 (EST) Subject: Ubuntu packages In-Reply-To: <56DC6764.1010707@affinityvision.com.au> References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <56DC6764.1010707@affinityvision.com.au> Message-ID: On Mon, 7 Mar 2016, Andrew McGlashan wrote: > > Many of us Debian users hate the fact that systemd even exists..... for > now we can run servers without systemd, but who knows in a few years or > a couple of releases. > I can't speak for the project as a whole but you'll take my sysvinit when you pry it from my cold dead hands :-) -- Jaldhar H. Vyas From gedalya at gedalya.net Mon Mar 7 06:39:28 2016 From: gedalya at gedalya.net (Gedalya) Date: Mon, 7 Mar 2016 01:39:28 -0500 Subject: Ubuntu packages In-Reply-To: References: <56D9D0A7.3040303@myzel.net> <56D9EA1C.3020302@rename-it.nl> <56D9ED9C.6060104@myzel.net> <56D9F22B.4060005@rename-it.nl> <1608271105.3258.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <56DC6764.1010707@affinityvision.com.au> Message-ID: <56DD2220.4040307@gedalya.net> On 03/07/2016 01:28 AM, Jaldhar H. Vyas wrote: > On Mon, 7 Mar 2016, Andrew McGlashan wrote: > >> >> Many of us Debian users hate the fact that systemd even exists..... for >> now we can run servers without systemd, but who knows in a few years or >> a couple of releases. >> > > I can't speak for the project as a whole but you'll take my sysvinit > when you pry it from my cold dead hands :-) > Please keep it that way!! I use sysvinit on all machines - desktop, laptop, server, except where broken non-official packages (e.g. graylog) support only systemd. I find systemd a horrendous little toy that sometimes behaves in outright silly ways. A Rube Goldberg machine is, by definition, something that never will go into production. From stanojr at websupport.sk Mon Mar 7 12:50:40 2016 From: stanojr at websupport.sk (Pavel Stano) Date: Mon, 7 Mar 2016 13:50:40 +0100 Subject: sis deduplication broken from 2.2.16 upwards Message-ID: <20160307135040.6923898b@ass> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, sis attachment deduplication is broken in 2.2.16 upwards. It is caused by this commit. https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of inodes of hash files. Because fs_stat() after that commit use fstat() on open fd of temporary file instead of stat on filename. But that temporary file has differnt inode. It not cause any corruption but it will not save any space. Because every duplicate attachment will be in separate file. - -- [ Ohodnotte kvalitu mailu: https://www.nicereply.com/websupport/4afafd34 ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE *** -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJW3XkgAAoJEJDF0QA0DLajmJ0QAIZTFTkN0KMJDT3I/rft5Dpp QYM6kyTVdr/FNeR200LLPjXsHXHF8hhoxkQbpfq1D9ceQO0ERDVaL6knKK7/j5Zj EffO+ercXUkcJbE8iYRNcbdpXltUjgYYzgOha7ULiCk0VxROxcujThNTGCDHY8g/ zHXre2aW7hQ8o1yjjhITIOU5WsENSI8PbFktvvWF6OEMVwv8EnaEckJTRGwEl2fu FEPSV+eQg6jHTs/fgiMxAbd4DSzRa2tkeOrw4l4oprtIuthU5hAi9G42Dk+IFvXk k6imnsI6QMPhlrHCm+8Ym+8FwCv7S75JJ/iRp/sS2zHuEwvfwFcVi8pBSjeV50kZ Z0Xglm35tFrHNLAFFb1CVnEw6ftQpuMEE7o/IYrLMVVdPB0C/1IP0s9ucKK0ccQ0 Ld9RULBo6jLgxsVodEntgtMABkfvxybut/tF3O4mm/iN0rDzlOZHMeQ+lsgcdrZd J7h3ow/J0OYosR7CfRFLA875ue2g4GsF+FFP9/oKx/1TkHXJNXpKAhhjOCnSgxHe h44bDrpJyYKlrCaLcOjQM4iUO0upBPpepOnJu50Fde1hNmyr4NaiHLTo23OGX/v3 kEA6xEgmTsXyr3kjhg51/0tdradqKvih2yIptmhpw8P+RWp+ceMoDX2hF95EGB8q FGklrxdxCIoGPAZTOVyf =imfX -----END PGP SIGNATURE----- From alessio at skye.it Mon Mar 7 13:13:00 2016 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 7 Mar 2016 14:13:00 +0100 Subject: questions regarding zlib plugin In-Reply-To: <56D98F0A.3070109@filmakademie.de> References: <56D98F0A.3070109@filmakademie.de> Message-ID: <56DD7E5C.8030003@skye.it> Il 04/03/2016 14:35, G?tz Reinicke - IT Koordinator ha scritto: > Hi, > > faced with a current space problem on our dovecot 2.2.18 server, I > thought about using the zlib plugin. > > My questions: > > - is it really as simple as adding the options to the conf files as > described in the docs :) ? http://wiki2.dovecot.org/Plugins/Zlib Yes, we had enable it on Maildir/ without problems. > - As this just compresses new messages; dose anybody has a sort of > simple cron or whatever script or best practice how to compress existing > maildir mails? The doc is a bit complicated to me at that point... We had created a custom script but you can find many example on the web: https://gist.github.com/cs278/1490556 I suggest to do not use script that rename email files because they can invalid the uidlist. Simple check if the file is already compress (es. if gzip -t "${MAILFILE}" 2> /dev/null". -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From andrew.mcglashan at affinityvision.com.au Mon Mar 7 15:13:43 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Tue, 8 Mar 2016 02:13:43 +1100 Subject: questions regarding zlib plugin In-Reply-To: <56DD7E5C.8030003@skye.it> References: <56D98F0A.3070109@filmakademie.de> <56DD7E5C.8030003@skye.it> Message-ID: <56DD9AA7.6030809@affinityvision.com.au> Hi, On 8/03/2016 12:13 AM, Alessio Cecchi wrote: > Il 04/03/2016 14:35, G?tz Reinicke - IT Koordinator ha scritto: >> Hi, >> >> faced with a current space problem on our dovecot 2.2.18 server, I >> thought about using the zlib plugin. >> >> My questions: >> >> - is it really as simple as adding the options to the conf files as >> described in the docs :) ? http://wiki2.dovecot.org/Plugins/Zlib > > Yes, we had enable it on Maildir/ without problems. Okay, I like the idea of saving messages in compressed format, My exim4 on Debian with split config doesn't create files with the size tag, ala: maildir_tag = ,S=$message_size Where should I put this to make it active for exim4 on Debian? I've tried a couple of different config locations, but I can't get it to create new files with ,S=$message_size in the file names. AIUI, the message size component of the file name is required to use gzip method on files. I've also adjusted the dovecot config due to this requirement: "If you want to use dsync to convert to a compressed Maildir you may need -o maildir_copy_with_hardlinks=no (this is set to yes by default and will prevent compression). " Would I normally need this setting like that as well? Kind Regards AndrewM From alessio at skye.it Mon Mar 7 15:31:21 2016 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 7 Mar 2016 16:31:21 +0100 Subject: questions regarding zlib plugin In-Reply-To: <56DD9AA7.6030809@affinityvision.com.au> References: <56D98F0A.3070109@filmakademie.de> <56DD7E5C.8030003@skye.it> <56DD9AA7.6030809@affinityvision.com.au> Message-ID: <56DD9EC9.5090900@skye.it> Il 07/03/2016 16:13, Andrew McGlashan ha scritto: > Okay, I like the idea of saving messages in compressed format, > My exim4 on Debian with split config doesn't create files with the size > tag, ala: > > maildir_tag = ,S=$message_size > > Where should I put this to make it active for exim4 on Debian? You should use dovecot-lda (or LMTP) to add "S=$size" to email files. I don't know how to do it with Exim. -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From news at koster.tk Mon Mar 7 15:54:52 2016 From: news at koster.tk (Muffinman) Date: Mon, 7 Mar 2016 16:54:52 +0100 Subject: Compilation fails: SSL_TXT_SSLV2 not defined Message-ID: <56DDA44C.9040306@koster.tk> Hello all, I'm trying to compile dovecot 2.2.21 on OS-X 10.11.3 and I'm running a bit of trouble with OpenSSL. I've cloned OpenSSL (OpenSSL 1.1.0-pre4-dev) from github and in openssl/ssl.h SSL_TXT_SSLV2 is not defined anymore. Compilation fails with: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\"/usr/local/lib/dovecot\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -MT iostream-openssl-common.lo -MD -MP -MF .deps/iostream-openssl-common.Tpo -c iostream-openssl-common.c -fno-common -DPIC -o .libs/iostream-openssl-common.o iostream-openssl-common.c:34:24: error: use of undeclared identifier 'SSL_TXT_SSLV2' if (strcasecmp(name, SSL_TXT_SSLV2) == 0) ^ 1 error generated. make[3]: *** [iostream-openssl-common.lo] Error 1 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 In openssl/ssl.h the following is defined: # define SSL_TXT_SSLV3 "SSLv3" # define SSL_TXT_TLSV1 "TLSv1" # define SSL_TXT_TLSV1_1 "TLSv1.1" # define SSL_TXT_TLSV1_2 "TLSv1.2" # define SSL_TXT_ALL "ALL" Any suggestions on how to fix this? Kind regards, Maarten From aki.tuomi at dovecot.fi Mon Mar 7 16:09:33 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 7 Mar 2016 18:09:33 +0200 (EET) Subject: Compilation fails: SSL_TXT_SSLV2 not defined In-Reply-To: <56DDA44C.9040306@koster.tk> References: <56DDA44C.9040306@koster.tk> Message-ID: <978611001.7695.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> > On March 7, 2016 at 5:54 PM Muffinman wrote: > > > Hello all, > > I'm trying to compile dovecot 2.2.21 on OS-X 10.11.3 and I'm running a > bit of trouble with OpenSSL. I've cloned OpenSSL (OpenSSL > 1.1.0-pre4-dev) from github and in openssl/ssl.h SSL_TXT_SSLV2 is not > defined anymore. Compilation fails with: > > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib > -I../../src/lib-test -DMODULE_DIR=\"/usr/local/lib/dovecot\" -std=gnu99 > -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations > -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast > -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -MT > iostream-openssl-common.lo -MD -MP -MF .deps/iostream-openssl-common.Tpo > -c iostream-openssl-common.c -fno-common -DPIC -o > .libs/iostream-openssl-common.o > iostream-openssl-common.c:34:24: error: use of undeclared identifier > 'SSL_TXT_SSLV2' > if (strcasecmp(name, SSL_TXT_SSLV2) == 0) > ^ > 1 error generated. > make[3]: *** [iostream-openssl-common.lo] Error 1 > make[2]: *** [all-recursive] Error 1 > make[1]: *** [all-recursive] Error 1 > make: *** [all] Error 2 > > In openssl/ssl.h the following is defined: > > # define SSL_TXT_SSLV3 "SSLv3" > # define SSL_TXT_TLSV1 "TLSv1" > # define SSL_TXT_TLSV1_1 "TLSv1.1" > # define SSL_TXT_TLSV1_2 "TLSv1.2" > > # define SSL_TXT_ALL "ALL" > > Any suggestions on how to fix this? > > Kind regards, Maarten Hi! Can you try the attached patch? --- Aki Tuomi Dovecot oy -------------- next part -------------- A non-text attachment was scrubbed... Name: 0001-lib-ssl-iostream-Make-SSLv2-conditional.patch Type: text/x-patch Size: 1031 bytes Desc: not available URL: From aki.tuomi at dovecot.fi Mon Mar 7 16:12:58 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 7 Mar 2016 18:12:58 +0200 (EET) Subject: Compilation fails: SSL_TXT_SSLV2 not defined In-Reply-To: <978611001.7695.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> References: <56DDA44C.9040306@koster.tk> <978611001.7695.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: <1305523245.7717.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> > On March 7, 2016 at 6:09 PM aki.tuomi at dovecot.fi wrote: > > > > > On March 7, 2016 at 5:54 PM Muffinman wrote: > > > > > > Hello all, > > > > I'm trying to compile dovecot 2.2.21 on OS-X 10.11.3 and I'm running a > > bit of trouble with OpenSSL. I've cloned OpenSSL (OpenSSL > > 1.1.0-pre4-dev) from github and in openssl/ssl.h SSL_TXT_SSLV2 is not > > defined anymore. Compilation fails with: > > > > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib > > -I../../src/lib-test -DMODULE_DIR=\"/usr/local/lib/dovecot\" -std=gnu99 > > -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations > > -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast > > -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -MT > > iostream-openssl-common.lo -MD -MP -MF .deps/iostream-openssl-common.Tpo > > -c iostream-openssl-common.c -fno-common -DPIC -o > > .libs/iostream-openssl-common.o > > iostream-openssl-common.c:34:24: error: use of undeclared identifier > > 'SSL_TXT_SSLV2' > > if (strcasecmp(name, SSL_TXT_SSLV2) == 0) > > ^ > > 1 error generated. > > make[3]: *** [iostream-openssl-common.lo] Error 1 > > make[2]: *** [all-recursive] Error 1 > > make[1]: *** [all-recursive] Error 1 > > make: *** [all] Error 2 > > > > In openssl/ssl.h the following is defined: > > > > # define SSL_TXT_SSLV3 "SSLv3" > > # define SSL_TXT_TLSV1 "TLSv1" > > # define SSL_TXT_TLSV1_1 "TLSv1.1" > > # define SSL_TXT_TLSV1_2 "TLSv1.2" > > > > # define SSL_TXT_ALL "ALL" > > > > Any suggestions on how to fix this? > > > > Kind regards, Maarten > > Hi! > > Can you try the attached patch? > > --- > Aki Tuomi > Dovecot oy Apologies, fixed patch attached. Aki -------------- next part -------------- A non-text attachment was scrubbed... Name: 0001-lib-ssl-iostream-Make-SSLv2-conditional.patch Type: text/x-patch Size: 1006 bytes Desc: not available URL: From news at koster.tk Mon Mar 7 17:33:31 2016 From: news at koster.tk (Muffinman) Date: Mon, 7 Mar 2016 18:33:31 +0100 Subject: Compilation fails: SSL_TXT_SSLV2 not defined In-Reply-To: <1305523245.7717.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> References: <56DDA44C.9040306@koster.tk> <978611001.7695.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> <1305523245.7717.3bde40b7-7e55-4454-9ab8-6b04523f3f5b.open-xchange@appsuite.open-xchange.com> Message-ID: <56DDBB6B.2080805@koster.tk> On 07/03/16 17:12, aki.tuomi at dovecot.fi wrote: >> On March 7, 2016 at 6:09 PM aki.tuomi at dovecot.fi wrote: >> >> >> >>> On March 7, 2016 at 5:54 PM Muffinman wrote: >>> >>> >>> Hello all, >>> >>> I'm trying to compile dovecot 2.2.21 on OS-X 10.11.3 and I'm running a >>> bit of trouble with OpenSSL. I've cloned OpenSSL (OpenSSL >>> 1.1.0-pre4-dev) from github and in openssl/ssl.h c is not >>> defined anymore. Compilation fails with: >>> >>> libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib >>> -I../../src/lib-test -DMODULE_DIR=\"/usr/local/lib/dovecot\" -std=gnu99 >>> -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations >>> -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast >>> -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -MT >>> iostream-openssl-common.lo -MD -MP -MF .deps/iostream-openssl-common.Tpo >>> -c iostream-openssl-common.c -fno-common -DPIC -o >>> .libs/iostream-openssl-common.o >>> iostream-openssl-common.c:34:24: error: use of undeclared identifier >>> 'SSL_TXT_SSLV2' >>> if (strcasecmp(name, SSL_TXT_SSLV2) == 0) >>> ^ >>> 1 error generated. >>> make[3]: *** [iostream-openssl-common.lo] Error 1 >>> make[2]: *** [all-recursive] Error 1 >>> make[1]: *** [all-recursive] Error 1 >>> make: *** [all] Error 2 >>> >>> In openssl/ssl.h the following is defined: >>> >>> # define SSL_TXT_SSLV3 "SSLv3" >>> # define SSL_TXT_TLSV1 "TLSv1" >>> # define SSL_TXT_TLSV1_1 "TLSv1.1" >>> # define SSL_TXT_TLSV1_2 "TLSv1.2" >>> >>> # define SSL_TXT_ALL "ALL" >>> >>> Any suggestions on how to fix this? >>> >>> Kind regards, Maarten >> Hi! >> >> Can you try the attached patch? >> >> --- >> Aki Tuomi >> Dovecot oy > Apologies, fixed patch attached. > > Aki Thanks for the fast response and patch. However, there seems to be a lot more missing from the ssl.h header than just the 'SSL_TXT_SSLV2' definition. I figured I might better get the latest stable instead of the github version. Now everything compiles and runs fine (also without the patch). Thanks for the support!! Kind regards, Maarten From joe.beaubien at gmail.com Mon Mar 7 17:58:23 2016 From: joe.beaubien at gmail.com (Joe Beaubien) Date: Mon, 7 Mar 2016 12:58:23 -0500 Subject: segfault in imap and doveadm Message-ID: Hi everyone, Dovecot keeps on segfaulting on me and I am unsure why. This setup has been running for 5 years and has given me very little trouble. I am running Dovecot 2.1.7, setup with mdbox. The imap process keeps on segfaulting for the same account (makes me think maybe an email or folder of that account is problematic). My big issue is that force-resync also causes doveadm to segfault. Here is the mail.err file I am getting: Mar 7 12:34:36 mba kernel: [ 1955.486324] imap[5663]: segfault at 0 ip 00007ff1c1bd0b5e sp 00007fffd8599a40 error 4 in libdovecot-storage.so.0.0.0[7ff1c1b51000+fb000] Mar 7 12:34:36 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Sara/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:36 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Lucie/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:37 mba dovecot: imap(document): Error: mdbox map /mba_data/emails/document/storage/dovecot.map.index corrupted: map_uid=284393 refcount too low Mar 7 12:34:37 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Templates/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:39 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:40 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:40 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:41 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:41 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:41 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:42 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/_EE - a verifier/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:43 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:48 mba kernel: [ 1967.972883] imap[5688]: segfault at 0 ip 00007f058ebc9b5e sp 00007fff9baa7c00 error 4 in libdovecot-storage.so.0.0.0[7f058eb4a000+fb000] Mar 7 12:34:49 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Lucie/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:43:44 mba dovecot: imap(document): Error: indexer disconnected unexpectedly Mar 7 12:43:44 mba dovecot: indexer: Error: Indexer worker disconnected, discarding 119 requests for document Mar 7 12:48:31 mba kernel: [ 2790.363755] doveadm[6586]: segfault at 0 ip 00007f1b2023fb5e sp 00007fff4e8ce200 error 4 in libdovecot-storage.so.0.0.0[7f1b201c0000+fb000] Mar 7 12:49:10 mba kernel: [ 2829.203900] doveadm[6604]: segfault at 0 ip 00007fa0d16e4b5e sp 00007fff1b89f480 error 4 in libdovecot-storage.so.0.0.0[7fa0d1665000+fb000] First line is imap segfaulting. Last lines are doveadm segfaulting when I try to run force-resync. Does anyone have any clue what to do in this situation? Regards, -Joe From joe.beaubien at gmail.com Mon Mar 7 19:45:46 2016 From: joe.beaubien at gmail.com (Joe Beaubien) Date: Mon, 7 Mar 2016 14:45:46 -0500 Subject: segfault in imap and doveadm In-Reply-To: References: Message-ID: In order to provide more information, here is a sample output of mail.err: Mar 7 13:37:30 mba dovecot: imap(document): Error: mdbox map /mba_data/emails/document/storage/dovecot.map.index corrupted: map_uid=284393 refcount too low Mar 7 13:37:30 mba dovecot: imap(document): Fatal: master: service(imap): child 7549 killed with signal 11 (core dumped) Mar 7 13:37:30 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Drafts/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:30 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Templates/_Old/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:30 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Templates/Divers/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/_QSW - a verifier/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Anick/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Anick/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Kristine/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/PO/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Daphne/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:31 dovecot: last message repeated 4 times Mar 7 13:37:31 mba dovecot: imap(document): Error: mdbox map /mba_data/emails/document/storage/dovecot.map.index corrupted: map_uid=284393 refcount too low Mar 7 13:37:32 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:32 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:32 mba dovecot: imap(document): Fatal: master: service(imap): child 7561 killed with signal 11 (core dumped) Mar 7 13:37:33 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:33 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:34 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:34 dovecot: last message repeated 2 times Mar 7 13:37:34 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:37:34 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 13:38:59 dovecot: last message repeated 3 times On Mon, Mar 7, 2016 at 12:58 PM, Joe Beaubien wrote: > Hi everyone, > > Dovecot keeps on segfaulting on me and I am unsure why. This setup has > been running for 5 years and has given me very little trouble. > > I am running Dovecot 2.1.7, setup with mdbox. > > The imap process keeps on segfaulting for the same account (makes me think > maybe an email or folder of that account is problematic). > > My big issue is that force-resync also causes doveadm to segfault. > > Here is the mail.err file I am getting: > > Mar 7 12:34:36 mba kernel: [ 1955.486324] imap[5663]: segfault at 0 ip > 00007ff1c1bd0b5e sp 00007fffd8599a40 error 4 in > libdovecot-storage.so.0.0.0[7ff1c1b51000+fb000] > Mar 7 12:34:36 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/Sara/dbox-Mails/dovecot.index > reset, view is now inconsistent > Mar 7 12:34:36 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/Lucie/dbox-Mails/dovecot.index > reset, view is now inconsistent > Mar 7 12:34:37 mba dovecot: imap(document): Error: mdbox map > /mba_data/emails/document/storage/dovecot.map.index corrupted: > map_uid=284393 refcount too low > Mar 7 12:34:37 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/Templates/dbox-Mails/dovecot.index > reset, view is now inconsistent > Mar 7 12:34:39 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:40 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:40 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:41 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:41 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:41 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:42 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/_EE - a > verifier/dbox-Mails/dovecot.index reset, view is now inconsistent > Mar 7 12:34:43 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, > view is now inconsistent > Mar 7 12:34:48 mba kernel: [ 1967.972883] imap[5688]: segfault at 0 ip > 00007f058ebc9b5e sp 00007fff9baa7c00 error 4 in > libdovecot-storage.so.0.0.0[7f058eb4a000+fb000] > Mar 7 12:34:49 mba dovecot: imap(document): Error: > /mba_data/emails/document/mailboxes/INBOX/Lucie/dbox-Mails/dovecot.index > reset, view is now inconsistent > Mar 7 12:43:44 mba dovecot: imap(document): Error: indexer disconnected > unexpectedly > Mar 7 12:43:44 mba dovecot: indexer: Error: Indexer worker disconnected, > discarding 119 requests for document > Mar 7 12:48:31 mba kernel: [ 2790.363755] doveadm[6586]: segfault at 0 ip > 00007f1b2023fb5e sp 00007fff4e8ce200 error 4 in > libdovecot-storage.so.0.0.0[7f1b201c0000+fb000] > Mar 7 12:49:10 mba kernel: [ 2829.203900] doveadm[6604]: segfault at 0 ip > 00007fa0d16e4b5e sp 00007fff1b89f480 error 4 in > libdovecot-storage.so.0.0.0[7fa0d1665000+fb000] > > > First line is imap segfaulting. Last lines are doveadm segfaulting when I > try to run force-resync. > > Does anyone have any clue what to do in this situation? > > Regards, > > -Joe > > > > > From ron.garret at gmail.com Mon Mar 7 21:01:40 2016 From: ron.garret at gmail.com (Ron Garret) Date: Mon, 7 Mar 2016 13:01:40 -0800 Subject: dovecot: imap-login: Panic: Trying to allocate 0 bytes Message-ID: My ISP had a hard drive crash. After the dust settled, my dovecot installation started failing with the following error every time a client tries to connect: dovecot: imap-login: Panic: Trying to allocate 0 bytes My installation has otherwise been stable and rock-solid for years. Both I and the techs at my ISP are stumped. Any advice on how to debug this would be greatly appreciated. Vital info: [ron at vm1:/etc/dovecot]$ /usr/sbin/dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.10 log_timestamp: %Y-%m-%d %H:%M:%S ssl_ca_file: /etc/ssl/local-certs/startssl.ca.pem ssl_cert_file: /etc/ssl/local-certs/... ssl_key_file: /etc/ssl/local-keys/... login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login first_valid_uid: 100 mail_privileged_group: mail mbox_write_locks: fcntl dotlock auth default: user: postfix passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix I have checked the MySQL configuration and everything seems to be OK there. In fact, I?ve checked everything that I know how to check, and everything seems to be OK. And yet it is not working. Many thanks, rg From rlaager at wiktel.com Tue Mar 8 05:16:43 2016 From: rlaager at wiktel.com (Richard Laager) Date: Mon, 7 Mar 2016 23:16:43 -0600 Subject: Dsync Header Hashing In-Reply-To: References: <56D9217F.20908@wiktel.com> Message-ID: <56DE603B.2050507@wiktel.com> On 03/04/2016 08:52 AM, Timo Sirainen wrote: > On 04 Mar 2016, at 07:47, Richard Laager wrote: >> Is there any way to disable the header hashing in dsync? ... > Does the attached patch happen to work? Compiles, but untested for now. It works with one more change on top of your patch: diff --git a/src/doveadm/dsync/dsync-mailbox-export.c b/src/doveadm/dsync/dsync-mailbox-export.c index 361cc55..0267f86 100644 --- a/src/doveadm/dsync/dsync-mailbox-export.c +++ b/src/doveadm/dsync/dsync-mailbox-export.c @@ -518,7 +518,7 @@ dsync_mailbox_export_init(struct mailbox *box, p_array_init(&exporter->expunged_seqs, pool, 16); p_array_init(&exporter->expunged_guids, pool, 16); - if (!exporter->mails_have_guids) + if (!exporter->mails_have_guids && !exporter->no_hdr_hashes) exporter->wanted_headers = dsync_mail_get_hash_headers(box); /* first scan transaction log and save any expunges and flag changes */ -- Richard From rlaager at wiktel.com Tue Mar 8 05:41:02 2016 From: rlaager at wiktel.com (Richard Laager) Date: Mon, 7 Mar 2016 23:41:02 -0600 Subject: [PATCH] imapc: Accept strings in FLAGS responses Message-ID: <1457415662-19062-1-git-send-email-rlaager@wiktel.com> While non-standard, the IMAP server we are replacing returns non-system flags as strings instead of atoms. Prior to this change, imapc would abort processing on the first message with a string flag. --- src/lib-storage/index/imapc/imapc-mailbox.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/src/lib-storage/index/imapc/imapc-mailbox.c b/src/lib-storage/index/imapc/imapc-mailbox.c index c3e12d1..91333dc 100644 --- a/src/lib-storage/index/imapc/imapc-mailbox.c +++ b/src/lib-storage/index/imapc/imapc-mailbox.c @@ -310,7 +310,8 @@ static void imapc_untagged_fetch(const struct imapc_untagged_reply *reply, t_array_init(&keywords, 8); seen_flags = TRUE; for (j = 0; flags_list[j].type != IMAP_ARG_EOL; j++) { - if (!imap_arg_get_atom(&flags_list[j], &atom)) + if (!imap_arg_get_atom(&flags_list[j], &atom) && + !imap_arg_get_string(&flags_list[j], &atom)) return; if (atom[0] == '\\') flags |= imap_parse_system_flag(atom); -- 2.1.4 From r.zimmermann at siegnetz.de Tue Mar 8 10:29:59 2016 From: r.zimmermann at siegnetz.de (Ralf Zimmermann) Date: Tue, 8 Mar 2016 11:29:59 +0100 Subject: Dovecort-2.2.22 In-Reply-To: <6561C663-2D5F-4019-BEEB-A1007066CA8E@iki.fi> References: <23AAD3F9-FEA4-428D-982C-CB622F14589A@siegnetz.de> <6561C663-2D5F-4019-BEEB-A1007066CA8E@iki.fi> Message-ID: <00D7059C-FBFE-41FA-AC87-800DD1AD3281@siegnetz.de> Here is the backtrace: #0 0x00007f23b5484067 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #1 0x00007f23b5485448 in __GI_abort () at abort.c:89 #2 0x00007f23b587b9e6 in default_fatal_finish (type=, status=status at entry=0) at failures.c:201 #3 0x00007f23b587badc in i_internal_fatal_handler (ctx=0x7ffdc070e470, format=, args=) at failures.c:670 #4 0x00007f23b582433d in i_panic (format=format at entry=0x7f23b481a158 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 #5 0x00007f23b48159f8 in virtual_backend_box_close (mbox=mbox at entry=0x1e068f0, bbox=0x1e5f6a8) at virtual-storage.c:403 #6 0x00007f23b4815f94 in virtual_mailbox_close_internal (mbox=mbox at entry=0x1e068f0) at virtual-storage.c:445 #7 0x00007f23b4815fe9 in virtual_mailbox_close (box=0x1e068f0) at virtual-storage.c:507 #8 0x00007f23b5b3e5da in mailbox_close (box=0x3a5c) at mail-storage.c:1240 #9 0x00007f23b5b3e663 in mailbox_free (_box=_box at entry=0x7ffdc070e5e8) at mail-storage.c:1260 #10 0x000000000042038a in imap_status_get (cmd=cmd at entry=0x1e02d20, ns=ns at entry=0x1df4dc0, mailbox=mailbox at entry=0x1dd02e8 "virtual/last_48_hours", items=items at entry=0x7ffdc070e640, result_r=result_r at entry=0x7ffdc070e660) at imap-status.c:96 #11 0x0000000000414498 in cmd_status (cmd=0x1e02d20) at cmd-status.c:40 #12 0x000000000041947c in command_exec (cmd=cmd at entry=0x1e02d20) at imap-commands.c:180 #13 0x0000000000417ac2 in client_command_input (cmd=cmd at entry=0x1e02d20) at imap-client.c:958 #14 0x0000000000417b50 in client_command_input (cmd=0x1e02d20) at imap-client.c:1018 #15 0x0000000000417ec5 in client_handle_next_command (remove_io_r=, client=0x1e02120) at imap-client.c:1058 #16 client_handle_input (client=0x1e02120) at imap-client.c:1070 #17 0x0000000000418362 in client_input (client=0x1e02120) at imap-client.c:1117 #18 0x00007f23b588e9dc in io_loop_call_io (io=0x1e24780) at ioloop.c:564 #19 0x00007f23b588fd01 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x1dd8730) at ioloop-epoll.c:220 #20 0x00007f23b588ea65 in io_loop_handler_run (ioloop=ioloop at entry=0x1dd8730) at ioloop.c:612 #21 0x00007f23b588ec08 in io_loop_run (ioloop=0x1dd8730) at ioloop.c:588 #22 0x00007f23b5829a23 in master_service_run (service=0x1dd85d0, callback=callback at entry=0x4239b0 ) at master-service.c:640 #23 0x000000000040c3c7 in main (argc=1, argv=0x1dd8390) at main.c:454 Mit freundlichen Gr??en Ralf Zimmermann Senior Security Engineer State Certified Engineer SIEGNETZ.IT GmbH Einheitsstrasse 2, D-57076 Siegen Telefon: +4927168193130 Fax: +492716819329 Mobil : +491735360015 http://www.siegnetz.de http://rz.siegnetz.de Amtsgericht Siegen HRB4838 Gesch?ftsf?hrer: Oliver Seitz Sitz der Gesellschaft ist Siegen > Am 04.03.2016 um 21:02 schrieb Timo Sirainen : > > On 04 Mar 2016, at 17:46, Ralf Zimmermann wrote: >> >> With Dovecot-2.2.22 and enabled virtual plugin I get following error messages: >> >> Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x819f0) [0x7f12330bf9f0] -> > > The raw backtrace isn't very helpful unfortunately. What was the panic log message before this? Also it could be helpful to have gdb backtrace: http://dovecot.org/bugreport.html > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From r.zimmermann at siegnetz.de Tue Mar 8 10:40:03 2016 From: r.zimmermann at siegnetz.de (Ralf Zimmermann) Date: Tue, 8 Mar 2016 11:40:03 +0100 Subject: Dovecort-2.2.22 In-Reply-To: <6561C663-2D5F-4019-BEEB-A1007066CA8E@iki.fi> References: <23AAD3F9-FEA4-428D-982C-CB622F14589A@siegnetz.de> <6561C663-2D5F-4019-BEEB-A1007066CA8E@iki.fi> Message-ID: I have activated the virtual plugin with dovecot-2.2.22 on a Debian Jessie with Linux 3.2.0-4-amd64. In this example I opened the virtual folder Trash. # ~Maildir/virtual/Trash/dovecot-virtual * deleted Here the mail debug log entry: Panic: file virtual-storage.c: line 403 (virtual_backend_box_close): assertion failed: (bbox->open_tracked) Mar 8 11:32:49 lab dovecot: imap(rzimmermann at lab.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x819f0) [0x7f26e3c4c9f0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x81adc) [0x7f26e3c4cadc] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f26e3bf533d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_close+0x178) [0x7f26e2be69f8] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9f94) [0x7f26e2be6f94] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9fe9) [0x7f26e2be6fe9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f26e3f0f5da] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7f26e3f0f663] -> dovecot/imap(imap_status_get+0x9a) [0x42038a] -> dovecot/imap(cmd_status+0x148) [0x414498] -> dovecot/imap(command_exec+0x8c) [0x41947c] -> dovecot/imap() [0x417ac2] -> dovecot/imap() [0x417b50] -> dovecot/imap(client_handle_input+0x155) [0x417ec5] -> dovecot/imap(client_input+0x72) [0x418362] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f26e3c5f9dc] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe1) [0x7f26e3c60d01] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f26e3c5fa65] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f26e3c5fc08] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f26e3bfaa23] -> dovecot/imap(main+0x2d7) [0x40c3c7] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f26e3841b45] -> dovecot/imap() [0x40c530] Mar 8 11:32:49 lab dovecot: imap(rzimmermann at lab.de): Fatal: master: service(imap): child 5737 killed with signal 6 (core dumped) Here the backtrace: Core was generated by `dovecot/imap'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f192af9a067 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 0x00007f192af9a067 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #1 0x00007f192af9b448 in __GI_abort () at abort.c:89 #2 0x00007f192b3919e6 in default_fatal_finish (type=, status=status at entry=0) at failures.c:201 #3 0x00007f192b391adc in i_internal_fatal_handler (ctx=0x7ffccfe2b340, format=, args=) at failures.c:670 #4 0x00007f192b33a33d in i_panic (format=format at entry=0x7f192a330158 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 #5 0x00007f192a32b9f8 in virtual_backend_box_close (mbox=mbox at entry=0x23582f0, bbox=0x2359288) at virtual-storage.c:403 #6 0x00007f192a32bf94 in virtual_mailbox_close_internal (mbox=mbox at entry=0x23582f0) at virtual-storage.c:445 #7 0x00007f192a32bfe9 in virtual_mailbox_close (box=0x23582f0) at virtual-storage.c:507 #8 0x00007f192b6545da in mailbox_close (box=0x3ac5) at mail-storage.c:1240 #9 0x00007f192b654663 in mailbox_free (_box=_box at entry=0x7ffccfe2b4a8) at mail-storage.c:1260 #10 0x0000000000412dae in close_selected_mailbox (client=client at entry=0x234a120) at cmd-select.c:375 #11 0x0000000000412ed3 in close_selected_mailbox (client=0x234a120) at cmd-select.c:368 #12 cmd_select_full (cmd=0x234ad20, readonly=) at cmd-select.c:418 #13 0x000000000041947c in command_exec (cmd=cmd at entry=0x234ad20) at imap-commands.c:180 #14 0x0000000000417ac2 in client_command_input (cmd=cmd at entry=0x234ad20) at imap-client.c:958 #15 0x0000000000417b50 in client_command_input (cmd=0x234ad20) at imap-client.c:1018 #16 0x0000000000417ec5 in client_handle_next_command (remove_io_r=, client=0x234a120) at imap-client.c:1058 #17 client_handle_input (client=0x234a120) at imap-client.c:1070 #18 0x0000000000418362 in client_input (client=0x234a120) at imap-client.c:1117 #19 0x00007f192b3a49dc in io_loop_call_io (io=0x36ef230) at ioloop.c:564 #20 0x00007f192b3a5d01 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x2320730) at ioloop-epoll.c:220 #21 0x00007f192b3a4a65 in io_loop_handler_run (ioloop=ioloop at entry=0x2320730) at ioloop.c:612 #22 0x00007f192b3a4c08 in io_loop_run (ioloop=0x2320730) at ioloop.c:588 #23 0x00007f192b33fa23 in master_service_run (service=0x23205d0, callback=callback at entry=0x4239b0 ) at master-service.c:640 #24 0x000000000040c3c7 in main (argc=1, argv=0x2320390) at main.c:454 Mit freundlichen Gr??en Ralf Zimmermann Senior Security Engineer State Certified Engineer SIEGNETZ.IT GmbH Einheitsstrasse 2, D-57076 Siegen Telefon: +4927168193130 Fax: +492716819329 Mobil : +491735360015 http://www.siegnetz.de http://rz.siegnetz.de Amtsgericht Siegen HRB4838 Gesch?ftsf?hrer: Oliver Seitz Sitz der Gesellschaft ist Siegen > Am 04.03.2016 um 21:02 schrieb Timo Sirainen : > > On 04 Mar 2016, at 17:46, Ralf Zimmermann wrote: >> >> With Dovecot-2.2.22 and enabled virtual plugin I get following error messages: >> >> Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x819f0) [0x7f12330bf9f0] -> > > The raw backtrace isn't very helpful unfortunately. What was the panic log message before this? Also it could be helpful to have gdb backtrace: http://dovecot.org/bugreport.html > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 495 bytes Desc: Message signed with OpenPGP using GPGMail URL: From Ron at Cleven.com Tue Mar 8 16:57:29 2016 From: Ron at Cleven.com (Ron Cleven) Date: Tue, 08 Mar 2016 10:57:29 -0600 (CST) Subject: Reappearing emails - IMAP trace Message-ID: <56DF0478.4060709@Cleven.com> A few days back, I sent an overview of this problem, but received no responses. Since then, I have run dozens of traces to isolate the problem, difficult because there are timing issues involved. I have finally nailed it down. If this is not the proper place to report such bugs or if someone knows that this bug has been fixed, please let me know. As I noted in my earlier post, we have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. Recently we received a report that emails could reappear in the INBOX after being deleted. After running a pile of traces, I determined that the problem was strangely related to replications. For the purposes of this discussion, I will refer to the two symmetric replicating servers as A and B. Further, let us assume that during "normal" operation, all the emails are delivered to A via SMTP and are replicated to B. Under those assumptions, if the IMAP user connects to A (where the messages were originally delivered), there is no problem, at least no problem I was able to find. The problem I am describing only arises if the IMAP user connects to B. Connecting to B has never presented any other problems that I am aware of. The test for which I have provided the trace starts with a test mailbox containing only 3 unread messages in the INBOX. Moving 1 of the unread messages to Trash is all that is needed to reproduce the problem. Remember this is ONLY a problem if the IMAP sessions do not connect to the server to which the messages were originally delivered. Also, I found that there is a timing window. The critical IMAP commands are: UID STORE xxx +FLAGS.SILENT (\Seen) UID MOVE xxx Trash If you introduce a large enough delay (I arbitrarily chose 5 seconds) between those two commands, there is no problem. Presumably this has to do with the two boxes syncing up some critical data structure. It takes a short time for the message that was moved to Trash to reappear in the INBOX. The trace initially shows the number of messages going from 3 to 2 when the message is moved to Trash, but a second or so later, the message count goes back up to 3. Interestingly, the reappearing message shows back up as Unseen in the INBOX but a duplicate copy of it stays in Trash as Seen. Dragging unread messages to Trash may not be polite, but it is technically acceptable. Regarding the trace below , CR's show up as \r, LF's show up as \n, and each line starts with S or C depending upon whether it is from the Server or Client. There is blank line following each connection. Thanks, Ron ============================================================================ S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap at usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 3 UNSEEN 3)\r\n S 10002 OK Status completed.\r\n C 10003 SELECT INBOX\r\n S * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n S * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \* S )] Flags permitted.\r\n S * 3 EXISTS\r\n S * 1 RECENT\r\n S * OK [UNSEEN 1] First unseen.\r\n S * OK [UIDVALIDITY 1457030049] UIDs valid\r\n S * OK [UIDNEXT 129] Predicted next UID\r\n S * OK [HIGHESTMODSEQ 417] Highest\r\n S 10003 OK [READ-WRITE] Select completed (0.000 secs).\r\n C 10004 UID SEARCH 3\r\n S * SEARCH 128\r\n S 10004 OK Search completed (0.000 secs).\r\n C 10005 LIST "" Trash\r\n S * LIST (\HasNoChildren \Trash) "." Trash\r\n S 10005 OK List completed.\r\n C 10006 UID STORE 128 +FLAGS.SILENT (\Seen)\r\n S 10006 OK Store completed.\r\n C 10007 UID MOVE 128 Trash\r\n S * OK [COPYUID 1457030331 128 127] Moved UIDs.\r\n S * 3 EXPUNGE\r\n S * 0 RECENT\r\n S 10007 OK Move completed.\r\n C 10008 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 2 UNSEEN 2)\r\n S 10008 OK [CLIENTBUG] Status on selected mailbox completed.\r\n C 10009 STATUS Trash (MESSAGES UNSEEN)\r\n S * STATUS Trash (MESSAGES 1 UNSEEN 0)\r\n S 10009 OK Status completed.\r\n C 10010 LOGOUT\r\n S * BYE Logging out\r\n S 10010 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap at usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 SELECT INBOX\r\n S * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n S * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \* S )] Flags permitted.\r\n S * 2 EXISTS\r\n S * 0 RECENT\r\n S * OK [UNSEEN 1] First unseen.\r\n S * OK [UIDVALIDITY 1457030049] UIDs valid\r\n S * OK [UIDNEXT 129] Predicted next UID\r\n S * OK [HIGHESTMODSEQ 419] Highest\r\n S 10002 OK [READ-WRITE] Select completed (0.026 secs).\r\n C 10003 UID FETCH 127 (UID RFC822.SIZE FLAGS INTERNALDATE BODYSTRUCTURE B C ODY.PEEK[HEADER.FIELDS (DATE FROM TO SUBJECT CONTENT-TYPE CC REPLY-TO L C IST-POST DISPOSITION-NOTIFICATION-TO X-PRIORITY IN-REPLY-TO BCC SENDER C MESSAGE-ID CONTENT-TRANSFER-ENCODING REFERENCES X-DRAFT-INFO MAIL-FOLLO C WUP-TO MAIL-REPLY-TO RETURN-PATH)])\r\n S * 2 FETCH (UID 127 RFC822.SIZE 771 FLAGS () INTERNALDATE "08-Mar-2016 0 S 8:48:31 -0600" BODYSTRUCTURE ("text" "plain" ("charset" "us-ascii") NIL S NIL "7bit" 7 1 NIL NIL NIL NIL) BODY[HEADER.FIELDS (DATE FROM TO SUBJE S CT CONTENT-TYPE CC REPLY-TO LIST-POST DISPOSITION-NOTIFICATION-TO X-PRI S ORITY IN-REPLY-TO BCC SENDER MESSAGE-ID CONTENT-TRANSFER-ENCODING REFER S ENCES X-DRAFT-INFO MAIL-FOLLOWUP-TO MAIL-REPLY-TO RETURN-PATH)] {108}\r S \n S From: ron at cleven.com\r\n S To: testimap at usgo.net\r\n S Date: Tue, 08 Mar 2016 08:48:24 -0600 (CST)\r\n S Subject: test2\r\n S \r\n S )\r\n S 10003 OK Fetch completed.\r\n C 10004 UID FETCH 127 (BODY.PEEK[TEXT])\r\n S * 2 FETCH (UID 127 BODY[TEXT] {7}\r\n S test2\r\n S )\r\n S 10004 OK Fetch completed.\r\n C 10005 UID STORE 127 +FLAGS.SILENT (\Seen)\r\n S 10005 OK Store completed.\r\n C 10006 LOGOUT\r\n S * BYE Logging out\r\n S 10006 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap at usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 LIST (SUBSCRIBED) "" "*"\r\n S * LIST (\Subscribed) "." Sent\r\n S * LIST (\Subscribed) "." Trash\r\n S * LIST (\Subscribed) "." Drafts\r\n S * LIST (\Subscribed) "." Junk\r\n S * LIST (\Subscribed) "." Blocked\r\n S * LIST (\Subscribed) "." Pending\r\n S * LIST (\Subscribed) "." Archives\r\n S * LIST (\Subscribed) "." Archives.2016\r\n S 10002 OK List completed.\r\n C 10003 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 2 UNSEEN 1)\r\n S 10003 OK Status completed.\r\n C 10004 LOGOUT\r\n S * BYE Logging out\r\n S 10004 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap at usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 LIST (SUBSCRIBED) "" "*"\r\n S * LIST (\Subscribed) "." Sent\r\n S * LIST (\Subscribed) "." Trash\r\n S * LIST (\Subscribed) "." Drafts\r\n S * LIST (\Subscribed) "." Junk\r\n S * LIST (\Subscribed) "." Blocked\r\n S * LIST (\Subscribed) "." Pending\r\n S * LIST (\Subscribed) "." Archives\r\n S * LIST (\Subscribed) "." Archives.2016\r\n S 10002 OK List completed.\r\n C 10003 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 3 UNSEEN 2)\r\n S 10003 OK Status completed.\r\n C 10004 LOGOUT\r\n S * BYE Logging out\r\n S 10004 OK Logout completed.\r\n ============================================================================ From ron.garret at gmail.com Tue Mar 8 20:49:47 2016 From: ron.garret at gmail.com (Ron Garret) Date: Tue, 8 Mar 2016 12:49:47 -0800 Subject: dovecot: imap-login: Panic: Trying to allocate 0 bytes In-Reply-To: References: Message-ID: <7ECB7EEC-CFC1-4D51-BAE8-EEA3DC47FF3D@gmail.com> Figured it out. Turned out to be a corrupted ssl parameter file. On Mar 7, 2016, at 1:01 PM, Ron Garret wrote: > My ISP had a hard drive crash. After the dust settled, my dovecot installation started failing with the following error every time a client tries to connect: > > dovecot: imap-login: Panic: Trying to allocate 0 bytes > > My installation has otherwise been stable and rock-solid for years. Both I and the techs at my ISP are stumped. Any advice on how to debug this would be greatly appreciated. > > Vital info: > > [ron at vm1:/etc/dovecot]$ /usr/sbin/dovecot -n > # 1.2.15: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.10 > log_timestamp: %Y-%m-%d %H:%M:%S > ssl_ca_file: /etc/ssl/local-certs/startssl.ca.pem > ssl_cert_file: /etc/ssl/local-certs/... > ssl_key_file: /etc/ssl/local-keys/... > login_dir: /var/run/dovecot/login > login_executable: /usr/lib/dovecot/imap-login > first_valid_uid: 100 > mail_privileged_group: mail > mbox_write_locks: fcntl dotlock > auth default: > user: postfix > passdb: > driver: sql > args: /etc/dovecot/dovecot-sql.conf > userdb: > driver: prefetch > socket: > type: listen > client: > path: /var/spool/postfix/private/auth > mode: 432 > user: postfix > group: postfix > > I have checked the MySQL configuration and everything seems to be OK there. In fact, I?ve checked everything that I know how to check, and everything seems to be OK. And yet it is not working. > > Many thanks, > rg From stephan at rename-it.nl Wed Mar 9 03:10:09 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 9 Mar 2016 04:10:09 +0100 Subject: Dovecot & Pigeon w/ MySQL In-Reply-To: References: <56D97242.5090905@rename-it.nl> Message-ID: <56DF9411.6020803@rename-it.nl> Op 3/4/2016 om 6:17 PM schreef Jorge Bastos: > Hi Stephan, > > Oh I see. > Is there this feature request already to support the save on MySQL/database? No need. I've this implemented now: https://github.com/stephanbosch/pigeonhole-0.4-patches/blob/master/master/sieve-storage-dict-modifiable.patch This patch still needs to be split up and cleaned up a bit. Also, there is currently no documentation. I will merge this after the next release, which will happen soon. However, once merged, you should still consider this new feature experimental for the time being. Regards, Stephan. > Jorge, > >> -----Original Message----- >> From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Stephan >> Bosch >> Sent: sexta-feira, 4 de Mar?o de 2016 11:32 >> To: Jorge Bastos; 'Dovecot Mailing List' >> Subject: Re: Dovecot & Pigeon w/ MySQL >> >> Op 3/3/2016 om 4:03 PM schreef Jorge Bastos: >>> Howdy, >>> >>> >>> >>> I'm looking for a good howto to have pigeon saving the sieve scripts >>> on an mysql table. >> Pigeonhole can currently only retrieve Sieve scripts from a database, >> not store them there; .e.g., from ManageSieve. >> >>> Can some point me to a good one? Dr. google doesn't show me much >> about it. >> >> http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration >> http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration/Dict >> >> Regards, >> >> Stephan. From djk at tobit.co.uk Wed Mar 9 12:14:47 2016 From: djk at tobit.co.uk (djk) Date: Wed, 9 Mar 2016 12:14:47 +0000 Subject: Client-initiated secure renegotiation In-Reply-To: <56DFFE71.4040001@coppint.com> References: <56DFFE71.4040001@coppint.com> Message-ID: <56E013B7.4020405@tobit.co.uk> On 09/03/16 10:44, Florent B wrote: > Hi, > > I don't see any SSL configuration option in Dovecot to disable > "Client-initiated secure renegotiation". > > It is advised to disable it as it can cause DDoS (CVE-2011-1473). > > Is it possible to have this possibility through an SSL option or other ? > > Thank you. > > Florent ssl_protocols = !SSLv3 !SSLv2 Is that enough? From marti1234 at gmail.com Wed Mar 9 19:02:02 2016 From: marti1234 at gmail.com (Marti Markov) Date: Wed, 9 Mar 2016 19:02:02 +0000 Subject: Setting up public mailboxes - user not found Message-ID: Hi all, This is the first time I use the dovecot mail list so I?m sorry if I forget something. My problem is that for some reason I can get public mailboxes to work. I have setup the directory Public, the folders and the cur,tmp and new folder in them: Public | |- .office3 | |- cur |- tmp |- new |- dovecot-acl Here is my dovecot conf: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.14.32-xxxx-grs-ipv6-64 x86_64 auth_default_realm = xxx.com auth_mechanisms = plain login mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = acl mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = yes location = maildir:/home/vmail/xxx.com/Public:INDEXPVT=~/Maildir/Public prefix = Public/ separator = / subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at xxx.com protocols = " imap lmtp sieve" service auth { unix_listener auth-client { group = Debian-exim mode = 0660 user = Debian-exim } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = required ssl_cert = for Debian-exim:107 Mar 9 19:50:44 mail spamd[21021]: spamd: clean message (-1.1/5.0) for Debian-exim:107 in 0.5 seconds, 1611 bytes. Mar 9 19:50:44 mail spamd[21021]: spamd: result: . -1 - BAYES_00,HTML_MESSAGE,RDNS_NONE,TVD_SPACE_RATIO scantime=0.5,size=1611,user=Debian-exim,uid=107,required_score=5.0,rhost=localhost.localdomain,raddr=127.0.0.1,rport=56531,mid=,bayes=0.000000,autolearn=no autolearn_force=no Mar 9 19:50:44 mail spamd[9510]: prefork: child states: II Mar 9 19:50:44 mail dovecot: lmtp(14554): Connect from local Mar 9 19:50:44 mail dovecot: auth: Debug: master in: USER#0111#011office3 at xxx.com#011service=lmtp Mar 9 19:50:44 mail dovecot: auth: Debug: ldap(office3 at xxx.com): user search: base=ou=people,dc=xxx,dc=com scope=subtree filter=(&(objectClass=person)(uid=office3)) fields=(all) Mar 9 19:50:44 mail dovecot: auth: Debug: ldap(office3 at xxx.com): no fields returned by the server Mar 9 19:50:44 mail dovecot: auth: ldap(office3 at xxx.com): unknown user Mar 9 19:50:44 mail dovecot: auth: Debug: userdb out: NOTFOUND#0111 Mar 9 19:50:44 mail dovecot: lmtp(14554): Disconnect from local: Successful quit So as I see it LMTP tries to see if the user exists and fails because there is no such user (which is true, the LDAP object office3 has a different base). I?m not sure but should Dovecot skip this and check the Public folder first before checking LDAP? Another part of my setup is Exim4. Here is the transport part: dovecot_lmtp: driver = lmtp socket = /var/run/dovecot/lmtp return_path_add #maximum number of deliveries per batch, default 1 batch_max = 200 And here is the auth part: dovecot_login: driver = dovecot public_name = LOGIN server_socket = /var/run/dovecot/auth-client # setting server_set_id might break several headers in mails sent by authenticated smtp. So be careful. server_set_id = $auth1 .ifndef AUTH_SERVER_ALLOW_NOTLS_PASSWORDS server_advertise_condition = ${if eq{$tls_in_cipher}{}{}{*}} .endif dovecot_plain: driver = dovecot public_name = PLAIN server_socket = /var/run/dovecot/auth-client server_set_id = $auth1 .ifndef AUTH_SERVER_ALLOW_NOTLS_PASSWORDS server_advertise_condition = ${if eq{$tls_in_cipher}{}{}{*}} .endif So any tips on how to fix this would be great. From petros.fraser at gmail.com Mon Mar 7 19:09:25 2016 From: petros.fraser at gmail.com (Peter Fraser) Date: Mon, 7 Mar 2016 14:09:25 -0500 Subject: Dovecot 2 Issue Message-ID: Hi All I have had a Dovecot-1.x Server running without issue for about 5 years now. I decided to set up a new Server and configure version 2 from scratch. I am having a little issue though. Set up on FreeBSD 10.2 Using dovecot2-2.2.21_1 Dovecot starts up but isn't listening on pop3 and imap ports. Not sure what I have missed. My dovecot -a readout is below. Thanks for any help. root at SMTP1:/home/frank # doveconf -a # 2.2.21 (5345f22): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.12 (c1c0a23) # OS: FreeBSD 10.2-RELEASE-p9 amd64 # NOTE: Send doveconf -n output instead when asking for help. auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = yes auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_gssapi_hostname = auth_krb5_keytab = auth_master_user_separator = auth_mechanisms = plain auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Ln auth_username_translation = auth_verbose = yes auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 1 mins default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_consistent_hashing = no director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins director_user_kick_delay = 2 secs director_username_hash = %u disable_plaintext_auth = yes dotlock_use_excl = yes doveadm_allowed_commands = doveadm_password = doveadm_port = 0 doveadm_socket_path = doveadm-server doveadm_username = doveadm doveadm_worker_count = 0 dsync_alt_char = _ dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -U first_valid_gid = 1000 first_valid_uid = 1000 haproxy_timeout = 3 secs haproxy_trusted_networks = hostname = example.com imap_capability = imap_client_workarounds = delay-newmail tb-extra-mailbox-sep imap_hibernate_timeout = 0 imap_id_log = imap_id_send = name * imap_idle_notify_interval = 2 mins imap_logout_format = in=%i out=%o imap_max_line_length = 64 k imap_metadata = no imap_urlauth_host = imap_urlauth_logout_format = in=%i out=%o imap_urlauth_port = 143 imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_sasl_mechanisms = imapc_ssl = no imapc_ssl_verify = yes imapc_user = import_environment = TZ CORE_OUTOFMEM CORE_ERROR info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/local/libexec/dovecot listen = * lmtp_address_translate = lmtp_hdr_delivery_address = final lmtp_proxy = no lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lmtp_user_concurrency_limit = 0 lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Mail Server ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> login_proxy_max_disconnect_delay = 0 login_source_ips = login_trusted_networks = mail_access_groups = mail_always_cache_fields = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_attribute_dict = mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/tmp/index mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = mail_prefetch_count = 0 mail_privileged_group = mail mail_save_crlf = no mail_server_admin = mail_server_comment = mail_shared_explicit_inbox = no mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = mailbox_idle_check_interval = 30 secs mailbox_list_index = no mailbox_list_index_very_dirty_syncs = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_empty_new = no maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_purge_preserve_alt = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = maildir:/home/public/public mailbox Drafts { auto = no autoexpunge = 0 comment = driver = special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 0 comment = driver = special_use = \Junk } mailbox Sent { auto = no autoexpunge = 0 comment = driver = special_use = \Sent } mailbox "Sent Messages" { auto = no autoexpunge = 0 comment = driver = special_use = \Sent } mailbox Trash { auto = no autoexpunge = 0 comment = driver = special_use = \Trash } order = 0 prefix = public/ separator = / subscriptions = yes type = public } passdb { args = default_fields = deny = no driver = pam master = no name = override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_delete_type = default pop3_deleted_flag = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = yes pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_host = pop3c_master_user = pop3c_password = pop3c_port = 110 pop3c_quick_received_date = no pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = it at example.com protocols = sieve quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_dsync_parameters = -d -N -l 30 -U replication_full_sync_interval = 1 days replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = $default_internal_user } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict-async { chroot = client_limit = 0 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict-async { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = haproxy = no port = 0 reuse_port = no ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-hibernate { chroot = client_limit = 0 drop_priv_before_exec = no executable = imap-hibernate extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 0 type = unix_listener imap-hibernate { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = haproxy = no port = 143 reuse_port = no ssl = no } inet_listener imaps { address = haproxy = no port = 993 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-master { group = mode = 0600 user = } unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = haproxy = no port = 4190 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = haproxy = no port = 110 reuse_port = no ssl = no } inet_listener pop3s { address = haproxy = no port = 995 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = mode = 00 user = $default_internal_user } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } unix_listener ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = References: Message-ID: Peter Fraser writes: > Dovecot starts up but isn't listening on pop3 and imap ports. Not sure what > I have missed. My dovecot -a readout is below. Thanks for any help. "doveconf -n" would be better as it will only show non-default settings. > ... > protocols = sieve > ... I'm thinking this ought to be protocols = imap pop3 sieve Joseph Tam From stephan at rename-it.nl Wed Mar 9 22:51:15 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 9 Mar 2016 23:51:15 +0100 Subject: Released Pigeonhole v0.4.13.rc1 for Dovecot v2.2.22.rc1. Message-ID: <56E0A8E3.70705@rename-it.nl> Hello Dovecot users, Pigeonhole v0.4.12 still compiles against Dovecot v2.2.22.rc1, but only with warnings. That is the primary reason for this new release. However, there are also a few significant changes as listed below. When no significant problems are reported, a definitive release will follow closely after Dovecot v2.2.22 is released. Changelog v0.4.13: * redirect action: Added the list-id header to the duplicate ID for mail loop prevention. This means that the message sent directly to the user and the message coming through the mailing list itself are treated as different messages by the loop detection of the redirect command, even though their Message-ID may be identical. * Changed the Sieve number type to uint64_t, which means that Sieve numbers can now technically range up to 2^64. Some other Sieve implementation allowed this, making this change necessary for successful migration. + Implemented the sieve_implicit_extensions setting. The extensions listed in this setting do not need to be enabled explicitly using the Sieve "require" command. This behavior directkly violates the standard, but can be necessary for compatibility with some existing implementations of Sieve. Do not use this setting unless you really need to! - redirect action: Made mail loop detection more robust by forcibly adding a Message-ID header if it is missing. - Prevent logging a useless "script not found" error message for LDAP scripts for which the entry exists but no attribute containing a script. This is not necessarily an error. - extprograms plugin: Changed the communication channel between parent and child process for a directly forked program from a socketpair to a double pipe. Linux does not support /dev/stdin, /dev/stdout and friends for sockets. For some shell program authors this may be confusing, so that is why it is changed. When using the script service, these device nodes are still not usable though. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.13.rc1.tar.gz http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.13.rc1.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From simonpie at cs.mcgill.ca Thu Mar 10 01:36:56 2016 From: simonpie at cs.mcgill.ca (Simon Pierre Desrosiers) Date: Wed, 9 Mar 2016 20:36:56 -0500 Subject: Replication not working Message-ID: <0A595823-B433-492B-88F1-40873BAE6E6A@cs.mcgill.ca> Hello, I am trying to setup replication between two Mac OS X El Capitan Server. I have added the field as I could understand from the replication page of dovecot and from a few poste in the mailing list. The mac uses the system user _dovecot as main system account. I have setup ssh keys between the two systems for the two _dovecot servers. SSh works fine from the terminal. But yet, I get these messages in the log file : Mar 09 20:18:44 auth: Error: od[getpwnam_ext](submit): No record for user Mar 09 20:18:44 doveadm: Error: Host key verification failed. Mar 09 20:18:44 dsync-local(submit): Error: read(_dovecot at laposte.mycompagny.com) failed: EOF Mar 09 20:18:44 dsync-local(submit): Error: Remote command returned error 255 Mar 09 20:23:44 auth: Error: od[getpwnam_ext](submit): No record for user Mar 09 20:23:44 doveadm: Error: Host key verification failed. Mar 09 20:23:44 dsync-local(submit): Error: read(_dovecot at laposte.mycompagny.com) failed: EOF Mar 09 20:23:44 dsync-local(submit): Error: Remote command returned error 255 and so on every few minutes. I have a few things about which I am not sure. We configure port 12345, but nothing listen on that port. The doveadm_password, what is it exactly ? Should I use a distinct account than _dovecot for synchronisation (all the fields that need to be added for replication) ? Here is my configuration, any help would be appreciated : # 2.2.5: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 15.3.0 x86_64 hfs auth_mechanisms = cram-md5 digest-md5 gssapi auth_realms = labanque.mycompagny.com auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n debug_log_path = /Library/Logs/Mail/mail-debug.log default_internal_user = _dovecot default_login_user = _dovenull doveadm_password = MyOwnSecret doveadm_port = 12345 dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u first_valid_gid = 6 first_valid_uid = 6 imap_id_log = * imap_id_send = "name" * "version" * imap_urlauth_submit_user = submit info_log_path = /Library/Logs/Mail/mail-info.log log_path = /Library/Logs/Mail/mail-err.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mail mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict mail_location = maildir:/Library/Server/Mail/Data/mail/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib acl fts fts_sk notify replication managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M namespace acl-mailboxes { list = children location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace list-archives { list = children location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/messages/archive/shared/%%u prefix = archives.%%u. separator = . subscriptions = no type = shared } passdb { driver = od } passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } plugin { acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes fts = sk mail_replica = remote:_dovecot at laposte.mycompagny.com quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u quota_warning2 = storage=80%% quota-warning %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster at labanque.mycompagny.com protocols = imap lmtp sieve pop3 quota_full_tempfail = yes service aggregator { fifo_listener replication-notify-fifo { user = _dovecot } unix_listener replication-notify { user = _dovecot } } service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service doveadm { user = _dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 } service indexer-worker { user = _dovecot } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } service stats { fifo_listener stats-mail { mode = 0600 user = _dovecot } } ssl = required ssl_ca = References: <0vqiee69eum0t94xtxj8iv37.1457283559901@email.android.com> Message-ID: <56E0D0E3.3010900@hotslots132.com> Time to put an end to this saga... I had an issue that Dovecot refused to serve an updated SSL certificate - one that Postfix had no issue with. Though I quadruple-checked that the cert file and private key file were correct, in the end I simply directed both cert and key files to the file I was using for Postfix (which had both the cert and private key). That worked. Darned if I know what it didn't like about the other files, but I'm back in business with the new cert. Thanks for the responsiveness from Aki. Steve L From marti1234 at gmail.com Thu Mar 10 01:43:56 2016 From: marti1234 at gmail.com (Marti Markov) Date: Thu, 10 Mar 2016 01:43:56 +0000 Subject: Dovecot stops responding when I update SSL certificate In-Reply-To: <56E0D0E3.3010900@hotslots132.com> References: <0vqiee69eum0t94xtxj8iv37.1457283559901@email.android.com> <56E0D0E3.3010900@hotslots132.com> Message-ID: <03185BFC-C101-49CE-BD3D-D53C5169F657@gmail.com> Try diff-ing the two files (postfix vs dovecot) to see if any problem can be found there. (If you are still interested :D) > On 10 Mar 2016, at 01:41, HotSlots Webmaster wrote: > > Time to put an end to this saga... > > I had an issue that Dovecot refused to serve an updated SSL certificate - one that Postfix had no issue with. Though I quadruple-checked that the cert file and private key file were correct, in the end I simply directed both cert and key files to the file I was using for Postfix (which had both the cert and private key). That worked. Darned if I know what it didn't like about the other files, but I'm back in business with the new cert. Thanks for the responsiveness from Aki. > > Steve L From tss at iki.fi Thu Mar 10 02:02:05 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 10 Mar 2016 15:02:05 +1300 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <20160307135040.6923898b@ass> References: <20160307135040.6923898b@ass> Message-ID: <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> On 08 Mar 2016, at 01:50, Pavel Stano wrote: > > > sis attachment deduplication is broken in 2.2.16 upwards. > It is caused by this commit. > https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 > > in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of > inodes of hash files. > Because fs_stat() after that commit use fstat() on open fd of temporary > file instead of stat on filename. But that temporary file has differnt > inode. > > It not cause any corruption but it will not save any space. > Because every duplicate attachment will be in separate file. Thanks, fixed: https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c841584ea1 From dato at net.com.org.es Thu Mar 10 06:36:10 2016 From: dato at net.com.org.es (Dato =?utf-8?Q?Sim=C3=B3?=) Date: Thu, 10 Mar 2016 03:36:10 -0300 Subject: Using dsync to synchronize laptop against remote server Message-ID: Hello! I?m thinking of changing the way I sync mail to my laptop, and I have a couple questions about my intended setup. In brief, my plan is: instead of running offlineimap against various IMAP accounts (my personal one included), I will run fetchmail on my private server, and classify mail with Sieve there. Then I?ll run a local Dovecot on my laptop, and do a master/master replication from my personal server/account with dsync. I have two quick questions about this (I have never used dsync before): 1. Reading the manual page, it seems that I probably want stateful synchronization (-s flag). Not having used it before, I?m curious about what lag I can expect. Does it compare to an IMAP IDLE/IMAP NOTIFY connection? Or is it asynchronous / with a timer? 2. I assume modifying my local Maildirs with e.g. Mutt is... a big no-no? Instead, should I always force Mutt to go through the local IMAP server? Many thanks in advance, -d From skdovecot at smail.inf.fh-brs.de Thu Mar 10 07:28:13 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 10 Mar 2016 08:28:13 +0100 (CET) Subject: Setting up public mailboxes - user not found In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 9 Mar 2016, Marti Markov wrote: > My problem is that for some reason I can get public mailboxes to work. I have setup the directory Public, the folders and the cur,tmp and new folder in them: > > Public > | > |- .office3 > | > |- cur > |- tmp > |- new > |- dovecot-acl > > Mar 9 19:50:44 mail dovecot: auth: Debug: ldap(office3 at xxx.com): user search: base=ou=people,dc=xxx,dc=com scope=subtree filter=(&(objectClass=person)(uid=office3)) fields=(all) > Mar 9 19:50:44 mail dovecot: auth: Debug: ldap(office3 at xxx.com): no fields returned by the server > Mar 9 19:50:44 mail dovecot: auth: ldap(office3 at xxx.com): unknown user > Mar 9 19:50:44 mail dovecot: auth: Debug: userdb out: NOTFOUND#0111 > Mar 9 19:50:44 mail dovecot: lmtp(14554): Disconnect from local: Successful quit > > > So as I see it LMTP tries to see if the user exists and fails because there is no such user (which is true, the LDAP object office3 has a different base). > > I?m not sure but should Dovecot skip this and check the Public folder first before checking LDAP? Dovecot LDA delivers to users. So, IMHO, in this situation I would add another userdb{} of type passwd-file, which adds a fake user office3 and uses the Maildir .../Public/.office3 as INBOX. If that fails or turns out to be problematic, setup another complete new user home directory like all others and symlink cur and new to Public/.office3 (and tmp, if they reside on different mount points). - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVuEiDXz1H7kL/d9rAQLNpgf/f2h7xSzQmB/ywV8NkkTxc9sL7w70EPJK 2fUOcFo4vmW41iJKV38UKflq/SOSn9H1+44pi8kJUFu00g/x8DgV1SJVFF1J0teh r/wnC6Nhdoxhm3owcJ1nbxgQyAj8zCR1rBnkCqglYqZb+1+FbZMGUzAz1Yghfh5M c8dPJg8J8FtSh62OEkS6FXoHQ0LbLvZfluQfV8/0D8lv4ZkcmItnc+Hkd7VjefjX zmf5J5gg97c+NNf3WzIJoutg7ceLcBvIYO+MKow8RXjnlFTvSThKB/dJxaJVx294 Mpuq/rJ0mP60OBtGm59C2DHIqriOuiOjvg9L3a3Mh7sCv7OrbqxYmw== =zRdL -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Mar 10 07:31:40 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 10 Mar 2016 08:31:40 +0100 (CET) Subject: Dovecot 2 Issue In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 7 Mar 2016, Peter Fraser wrote: > Dovecot starts up but isn't listening on pop3 and imap ports. Not sure what your protocols just contain sieve. doveconf -n is sufficient BTW: see http://wiki2.dovecot.org/Tools/Doveconf "doveconf can be also used to convert v1.x configuration files into v2.x format." you should use its output as start. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVuEi3Hz1H7kL/d9rAQLF5Af7BOCqPoK3Eyl91OZyhzQanJ+71vC8uwcn uvN6JzEiK+4PwHLp/Bb8lp6oMmni4G3V+7329uXphJ9jTw3/olGVq30aFPcteMvc r2RNjfS8iSQ1nVP8O0lkbn5WRgZTB/emfsXN8iRUA9mvUA48QZOCTD2RJHs3Mz+D vGciUICW95GruCmC9l/C6t9/sb+fu87mDglm0j8tFYeRcjo1vlbaT3QtX9st5PRG y0NdSNM5wVnhaxpJHKusIrQ3gmdF8iFfXMumaPQBLqr92SaCX1WXKKQ/dA/f5N0D WFiGGRqItSZg1Kc1ekYmIvycZzTDoITppg7LRiEADwbwxUO+lxVwQA== =SRds -----END PGP SIGNATURE----- From bschmidt at cms.hu-berlin.de Thu Mar 10 08:50:47 2016 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Thu, 10 Mar 2016 09:50:47 +0100 Subject: Setting up public mailboxes - user not found In-Reply-To: References: Message-ID: <56E13567.3020201@cms.hu-berlin.de> Am 09.03.2016 um 20:02 schrieb Marti Markov: > Hi all, > > This is the first time I use the dovecot mail list so I?m sorry if I forget something. > > My problem is that for some reason I can get public mailboxes to work. I have setup the directory Public, the folders and the cur,tmp and new folder in them: > > Public > | > |- .office3 > | > |- cur > |- tmp > |- new > |- dovecot-acl > > > Here is my dovecot conf: > > namespace { > list = yes > location = maildir:/home/vmail/xxx.com/Public:INDEXPVT=~/Maildir/Public > prefix = Public/ > separator = / > subscriptions = yes > type = public > } You can use a "normal" user who has a sieve script: require ... any filter if necessary fileinto "Public"; discard; ... "Public" is your prefix I have several subfolder so I use: fileinto "Public/subfolder1"; You would have /home/vmail/xxx.com/Public/subfolder1 with cur new tmp and a file "dovecot-acl" containing anyone lrs -- Burckhard Schmidt From dovecot at flut.demon.nl Thu Mar 10 09:30:52 2016 From: dovecot at flut.demon.nl (Osiris) Date: Thu, 10 Mar 2016 10:30:52 +0100 Subject: Client-initiated secure renegotiation In-Reply-To: <56E013B7.4020405@tobit.co.uk> References: <56DFFE71.4040001@coppint.com> <56E013B7.4020405@tobit.co.uk> Message-ID: <56E13ECC.1000808@flut.demon.nl> On 09-03-16 13:14, djk wrote: > On 09/03/16 10:44, Florent B wrote: >> Hi, >> >> I don't see any SSL configuration option in Dovecot to disable >> "Client-initiated secure renegotiation". >> >> It is advised to disable it as it can cause DDoS (CVE-2011-1473). >> >> Is it possible to have this possibility through an SSL option or other ? >> >> Thank you. >> >> Florent > ssl_protocols = !SSLv3 !SSLv2 > > Is that enough? I'm afraid not. I've got SSLv2 and SSLv3 disabled and with `openssl s_client -connect $host:993` I still can successfully renegotiate by passing a single 'R'. From mail at tomsommer.dk Thu Mar 10 09:38:15 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 10 Mar 2016 10:38:15 +0100 Subject: zlib plugin doesn't add "Z" flag to Maildir filename Message-ID: <453454c0a2d37a941145a238b8bc6b75@tomsommer.dk> I enabled zlib compression, so new mails are saved compressed. Now I want to convert the old mails to gzip with the find and gzip command, but now I don't know which files are already gzip compressed by dovecot. Shouldn't zlib_save itself add Z to the Maildir flags? As suggested in the compress guide on http://wiki2.dovecot.org/Plugins/Zlib ? -- Tom From f0andrey at gmail.com Thu Mar 10 10:21:30 2016 From: f0andrey at gmail.com (Andrey Fesenko) Date: Thu, 10 Mar 2016 13:21:30 +0300 Subject: Client-initiated secure renegotiation In-Reply-To: <56E13ECC.1000808@flut.demon.nl> References: <56DFFE71.4040001@coppint.com> <56E013B7.4020405@tobit.co.uk> <56E13ECC.1000808@flut.demon.nl> Message-ID: On Thu, Mar 10, 2016 at 12:30 PM, Osiris wrote: > On 09-03-16 13:14, djk wrote: >> On 09/03/16 10:44, Florent B wrote: >>> Hi, >>> >>> I don't see any SSL configuration option in Dovecot to disable >>> "Client-initiated secure renegotiation". >>> >>> It is advised to disable it as it can cause DDoS (CVE-2011-1473). >>> >>> Is it possible to have this possibility through an SSL option or other ? >>> >>> Thank you. >>> >>> Florent >> ssl_protocols = !SSLv3 !SSLv2 >> >> Is that enough? > > I'm afraid not. I've got SSLv2 and SSLv3 disabled and with `openssl > s_client -connect $host:993` I still can successfully renegotiate by > passing a single 'R'. Are you use good ssl_cipher_list (https://wiki.mozilla.org/Security/Server_Side_TLS)? My config ## Service options # 10-ssl ssl = yes ssl_cert = References: <56DFFE71.4040001@coppint.com> <56E013B7.4020405@tobit.co.uk> <56E13ECC.1000808@flut.demon.nl> Message-ID: <56E14F35.6090907@flut.demon.nl> On 10-03-16 11:21, Andrey Fesenko wrote: > On Thu, Mar 10, 2016 at 12:30 PM, Osiris wrote: >> On 09-03-16 13:14, djk wrote: >>> On 09/03/16 10:44, Florent B wrote: >>>> Hi, >>>> >>>> I don't see any SSL configuration option in Dovecot to disable >>>> "Client-initiated secure renegotiation". >>>> >>>> It is advised to disable it as it can cause DDoS (CVE-2011-1473). >>>> >>>> Is it possible to have this possibility through an SSL option or other ? >>>> >>>> Thank you. >>>> >>>> Florent >>> ssl_protocols = !SSLv3 !SSLv2 >>> >>> Is that enough? >> I'm afraid not. I've got SSLv2 and SSLv3 disabled and with `openssl >> s_client -connect $host:993` I still can successfully renegotiate by >> passing a single 'R'. > Are you use good ssl_cipher_list > (https://wiki.mozilla.org/Security/Server_Side_TLS)? > > My config > ## Service options > # 10-ssl > ssl = yes > ssl_cert = ssl_key = ssl_require_crl = no > ssl_ca = ssl_cipher_list = > ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:ECDHE-RSA-DES-CBC3-SHA:ECDHE-ECDSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA > ssl_parameters_regenerate = 72h > # The !TLSv1 are OK, without TLS not work imtest (cyrus test suit) > ssl_protocols = !SSLv2 !SSLv3 > # Prefer the server's order of ciphers over client's > # Only available on dovecot 2.2.6 and later:: > ssl_prefer_server_ciphers = yes > # Only available on dovecot 2.2.7 and later:: > ssl_dh_parameters_length = 2048 > > Work fine, but only testssl.sh scanner generate small warning "Secure > Client-Initiated Renegotiation VULNERABLE (NOT ok), DoS threat" > > openssl s_client -connect $host:993 -ssl2(3) and openssl s_client > -connect $host:143 -starttls imap -showcerts -state -crlf -ssl2(3) > break connection > That's just the question of Florent: how to disable Secure Client-Initiated Renegotiation. From aki.tuomi at dovecot.fi Thu Mar 10 11:23:24 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 10 Mar 2016 13:23:24 +0200 Subject: Client-initiated secure renegotiation In-Reply-To: <56E14F35.6090907@flut.demon.nl> References: <56DFFE71.4040001@coppint.com> <56E013B7.4020405@tobit.co.uk> <56E13ECC.1000808@flut.demon.nl> <56E14F35.6090907@flut.demon.nl> Message-ID: <56E1592C.4050401@dovecot.fi> On 10.03.2016 12:40, Osiris wrote: > That's just the question of Florent: how to disable Secure > Client-Initiated Renegotiation. Hi! There is no way to disable this in OpenSSL, and the CVE you refer to has been disputed. Please see http://cve.mitre.org/cgi-bin/cvename.cgi?name=cve-2011-1473 and https://www.openssl.org/docs/manmaster/ssl/SSL_CTX_set_options.html. Without altering OpenSSL sources, secure renegotiations will take place. --- Aki Tuomi Dovecot Oy From CMarcus at Media-Brokers.com Thu Mar 10 13:37:15 2016 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 10 Mar 2016 08:37:15 -0500 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> References: <20160307135040.6923898b@ass> <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> Message-ID: <56E1788B.30209@Media-Brokers.com> On 3/9/2016 9:02 PM, Timo Sirainen wrote: > On 08 Mar 2016, at 01:50, Pavel Stano wrote: >> >> sis attachment deduplication is broken in 2.2.16 upwards. >> It is caused by this commit. >> https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 >> >> in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of >> inodes of hash files. >> Because fs_stat() after that commit use fstat() on open fd of temporary >> file instead of stat on filename. But that temporary file has differnt >> inode. >> >> It not cause any corruption but it will not save any space. >> Because every duplicate attachment will be in separate file. > Thanks, fixed: https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c841584ea1 So, after the fix is applied, does dovecot silently delete the duplicated files, or is there a command that needs to be run manually? From alessio at skye.it Thu Mar 10 14:00:05 2016 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 10 Mar 2016 15:00:05 +0100 Subject: zlib plugin doesn't add "Z" flag to Maildir filename In-Reply-To: <453454c0a2d37a941145a238b8bc6b75@tomsommer.dk> References: <453454c0a2d37a941145a238b8bc6b75@tomsommer.dk> Message-ID: <56E17DE5.4070307@skye.it> Il 10/03/2016 10:38, Tom Sommer ha scritto: > I enabled zlib compression, so new mails are saved compressed. > > Now I want to convert the old mails to gzip with the find and gzip > command, but now I don't know which files are already gzip compressed by > dovecot. Simple check if the file is already compress (es. if gzip -t "${MAILFILE}" 2> /dev/null". > Shouldn't zlib_save itself add Z to the Maildir flags? As suggested in > the compress guide on http://wiki2.dovecot.org/Plugins/Zlib ? > No, zlib plugins only compress email without chaning the name. I suggest to do not use script that rename email files because they can invalid the uidlist. -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From mail at tomsommer.dk Thu Mar 10 14:33:11 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 10 Mar 2016 15:33:11 +0100 Subject: zlib plugin doesn't add "Z" flag to Maildir filename In-Reply-To: <56E17DE5.4070307@skye.it> References: <453454c0a2d37a941145a238b8bc6b75@tomsommer.dk> <56E17DE5.4070307@skye.it> Message-ID: <728b0cbe77b13b24c1de61eea988b2c7@tomsommer.dk> On 2016-03-10 15:00, Alessio Cecchi wrote: > Il 10/03/2016 10:38, Tom Sommer ha scritto: >> I enabled zlib compression, so new mails are saved compressed. >> >> Now I want to convert the old mails to gzip with the find and gzip >> command, but now I don't know which files are already gzip compressed >> by >> dovecot. > > Simple check if the file is already compress (es. if gzip -t > "${MAILFILE}" 2> /dev/null". Thanks. I worked around it with `file`. >> Shouldn't zlib_save itself add Z to the Maildir flags? As suggested in >> the compress guide on http://wiki2.dovecot.org/Plugins/Zlib ? >> > > No, zlib plugins only compress email without chaning the name. I know, I'm suggesting it _should_ change the Maildir flag. > I suggest to do not use script that rename email files because they > can invalid the uidlist. I don't think adding a Maildir flag does that. If it does, then the wiki should be changed. // Tom From mail at tomsommer.dk Thu Mar 10 14:37:56 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 10 Mar 2016 15:37:56 +0100 Subject: v2.2.22 release candidate released In-Reply-To: References: <56D9AC6D.1080704@cistron.nl> Message-ID: <7d6dcb9624449b62174479039d157a7b@tomsommer.dk> On 2016-03-04 16:49, Timo Sirainen wrote: > On 04 Mar 2016, at 17:40, Miquel van Smoorenburg > wrote: >> >> Question: some time ago you mentioned that you were going to work on >> caldav/carddav support. What is the status of that, and will the >> calendar/contacts database be available over JMAP as well? > > Initially JMAP will be email-only. The CalDAV/CardDAV plans have been > postponed for now. Damn. I'd kill for a Dovecot-integrated/quality CalDAV-server. From alessio at skye.it Thu Mar 10 15:06:42 2016 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 10 Mar 2016 16:06:42 +0100 Subject: zlib plugin doesn't add "Z" flag to Maildir filename In-Reply-To: <728b0cbe77b13b24c1de61eea988b2c7@tomsommer.dk> References: <453454c0a2d37a941145a238b8bc6b75@tomsommer.dk> <56E17DE5.4070307@skye.it> <728b0cbe77b13b24c1de61eea988b2c7@tomsommer.dk> Message-ID: <56E18D82.1050101@skye.it> Il 10/03/2016 15:33, Tom Sommer ha scritto: > On 2016-03-10 15:00, Alessio Cecchi wrote: >> Il 10/03/2016 10:38, Tom Sommer ha scritto: >>> I enabled zlib compression, so new mails are saved compressed. >>> >>> Now I want to convert the old mails to gzip with the find and gzip >>> command, but now I don't know which files are already gzip compressed by >>> dovecot. >> >> Simple check if the file is already compress (es. if gzip -t >> "${MAILFILE}" 2> /dev/null". > > Thanks. I worked around it with `file`. I suggest to use "gzip -t" for test if an email is already compress, with file I found some unrecognized compress email, a real example: # file 1424615175.M471013P18835.pop04.domain.com\,S\=3982\,W\=4097\:2\,S 1424615175.M471013P18835.pop04.domain.com,S=3982,W=4097:2,S: Minix filesystem, V3, 6762 zones # gzip -t 1424615175.M471013P18835.pop04.domain.com\,S\=3982\,W\=4097\:2\,S # echo $? 0 -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From mail at tomsommer.dk Thu Mar 10 15:12:50 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 10 Mar 2016 16:12:50 +0100 Subject: zlib plugin doesn't add "Z" flag to Maildir filename In-Reply-To: <56E18D82.1050101@skye.it> References: <453454c0a2d37a941145a238b8bc6b75@tomsommer.dk> <56E17DE5.4070307@skye.it> <728b0cbe77b13b24c1de61eea988b2c7@tomsommer.dk> <56E18D82.1050101@skye.it> Message-ID: On 2016-03-10 16:06, Alessio Cecchi wrote: > Il 10/03/2016 15:33, Tom Sommer ha scritto: >> On 2016-03-10 15:00, Alessio Cecchi wrote: >>> Il 10/03/2016 10:38, Tom Sommer ha scritto: >>>> I enabled zlib compression, so new mails are saved compressed. >>>> >>>> Now I want to convert the old mails to gzip with the find and gzip >>>> command, but now I don't know which files are already gzip >>>> compressed by >>>> dovecot. >>> >>> Simple check if the file is already compress (es. if gzip -t >>> "${MAILFILE}" 2> /dev/null". >> >> Thanks. I worked around it with `file`. > > I suggest to use "gzip -t" for test if an email is already compress, > with file I found some unrecognized compress email, a real example: > > # file > 1424615175.M471013P18835.pop04.domain.com\,S\=3982\,W\=4097\:2\,S > 1424615175.M471013P18835.pop04.domain.com,S=3982,W=4097:2,S: Minix > filesystem, V3, 6762 zones > > # gzip -t > 1424615175.M471013P18835.pop04.domain.com\,S\=3982\,W\=4097\:2\,S > # echo $? > 0 Duly noted, thanks :) From gordon.grubert+lists at uni-greifswald.de Thu Mar 10 15:15:00 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Thu, 10 Mar 2016 16:15:00 +0100 Subject: Timout for LDAP connection In-Reply-To: References: <56D4613D.5050805@uni-greifswald.de> Message-ID: <56E18F74.3040601@uni-greifswald.de> Hi Timo, On 01.03.2016 22:51, Timo Sirainen wrote: > On 29 Feb 2016, at 17:18, Gordon Grubert wrote: >> >> Hi, >> >> we are using a round robin dns record for connections to our ldap >> system. This works fine for almost all cases. In particular, for >> dovecot does this mean, when an ldap server is stopped, dovecot >> instantly reconnects to another ldap server. >> >> But when the network connection to the active ldap server is broken, >> dovecot sticks to the failed ldap server. Is there any possibility to >> define a connection timeout? > > What should happen is that as long as new requests keep coming, Dovecot realizes after about 60 seconds that the LDAP server is hanging. It then reconnects and the reconnection should work. But... First of all, 60 seconds is likely a much too long timeout. > > But more importantly it looks like there's something weird now going on with OpenLDAP library. I added this somewhat recently and tested that it works: > > https://github.com/dovecot/core/commit/fb3178a1924dae52151d88c4d4ded879df43dd3f > > But now that I'm testing it, the timeout doesn't seem to be triggering. I don't know what happened to it that it suddenly doesn't work.. This also means that OpenLDAP seems to be internally stuck trying to connect to a server that isn't responding. Dovecot doesn't currently make the decisions on which LDAP server to connect to. It just passes through all the hosts to OpenLDAP library and lets it handle it. And it seems like OpenLDAP library can't right now do this failover. So maybe Dovecot should be responsible for that as well.. > > Anyway, for now you could set up haproxy to localhost and configure Dovecot LDAP to connect to haproxy and haproxy connect to the actual LDAP servers. > today I've upgraded to 2.2.21-1~auto+171 on debian 8 and made a lot of "interruption tests". Your fix not really solved the problem. But I found another interesting fact: The openldap client on debian 8 can handle hard communication interrupts correctly. I've added NETWORK_TIMEOUT 5 TIMEOUT 5 to ldap.conf because man 5 ldap.conf says: NETWORK_TIMEOUT Specifies the timeout (in seconds) after which the poll(2)/select(2) following a connect(2) returns in case of no activity. TIMEOUT Specifies a timeout (in seconds) after which calls to synchronous LDAP APIs will abort if no response is received. Also used for any ldap_result(3) calls where a NULL timeout parameter is supplied. We are using the ISC DHCP server with dynamic ldap connections. This daemon uses - like dovecot - the LDAP API of the openldap client for access to the ldap server. The DHCP opens a persistent ldap connection to handle all dhcp requests (same behavior like dovecot). Here, the timeouts for connection loss are working. Therefore, my question: Why does this not work for dovecot, too, when dovecot uses the same API? Dovecot does not get a response from the LDAP server and has to reconnect, only. IMAP server world domination requires a reconnect in case of connection timeouts ;-) Best regards, Gordon -- Technischer Leiter & stellv. Direktor Universit?tsrechenzentrum (URZ) E.-M.-Arndt-Universit?t Greifswald Felix-Hausdorff-Str. 12 17489 Greifswald Germany Tel. +49 3834 86 1456 Fax. +49 3834 86 1401 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5333 bytes Desc: S/MIME Cryptographic Signature URL: From nick.bright at valnet.net Thu Mar 10 15:55:18 2016 From: nick.bright at valnet.net (Nick Bright) Date: Thu, 10 Mar 2016 09:55:18 -0600 Subject: Troubleshooting mailbox problems Message-ID: <56E198E6.8000104@valnet.net> Greetings, I'm running Dovecot 2.0.9 on my CentOS 6 server, for several thousand mailboxes. Recently, I've had several reports of "my mailbox is suddenly empty, where'd my mail go?" I've enabled debug logging, but I'd like to make sure I have the best level of debug to see things like "delete message" commands? I've configured in logging: auth_debug = yes auth_debug_passwords = no mail_debug = yes plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_group_events = yes mail_log_fields = uid box msgid size } Does this look like a good start? I really think it's a client side problem, but sometimes end users always want to blame the server; and proof must be shown e.g. "Look, here's the log, you're sending delete commands." At which point, we can proceed with dealing with their software problem. Thanks, -- ----------------------------------------------- - Nick Bright - - Vice President of Technology - - Valnet -=- We Connect You -=- - - Tel 888-332-1616 x 315 / Fax 620-331-0789 - - Web http://www.valnet.net/ - ----------------------------------------------- - Are your files safe? - - Valnet Vault - Secure Cloud Backup - - More information & 30 day free trial at - - http://www.valnet.net/services/valnet-vault - ----------------------------------------------- This email message and any attachments are intended solely for the use of the addressees hereof. This message and any attachments may contain information that is confidential, privileged and exempt from disclosure under applicable law. If you are not the intended recipient of this message, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply E-mail and immediately delete this message from your system. From gordon.grubert+lists at uni-greifswald.de Thu Mar 10 18:42:58 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Thu, 10 Mar 2016 19:42:58 +0100 Subject: Troubleshooting mailbox problems In-Reply-To: <56E198E6.8000104@valnet.net> References: <56E198E6.8000104@valnet.net> Message-ID: <56E1C032.8010302@uni-greifswald.de> On 03/10/2016 04:55 PM, Nick Bright wrote: > Greetings, > > I'm running Dovecot 2.0.9 on my CentOS 6 server, for several thousand > mailboxes. > > Recently, I've had several reports of "my mailbox is suddenly empty, > where'd my mail go?" > > I've enabled debug logging, but I'd like to make sure I have the best > level of debug to see things like "delete message" commands? > > I've configured in logging: > > auth_debug = yes > auth_debug_passwords = no > mail_debug = yes mail_plugins= [...] mail_log [..] > plugin { > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename > mail_log_group_events = yes > mail_log_fields = uid box msgid size > } > > Does this look like a good start? I really think it's a client side > problem, but sometimes end users always want to blame the server; and > proof must be shown e.g. "Look, here's the log, you're sending delete > commands." These parameters should be sufficient to reach your goal. Best regards, Gordon From nick.bright at valnet.net Thu Mar 10 18:54:43 2016 From: nick.bright at valnet.net (Nick Bright) Date: Thu, 10 Mar 2016 12:54:43 -0600 Subject: Troubleshooting mailbox problems In-Reply-To: <56E1C032.8010302@uni-greifswald.de> References: <56E198E6.8000104@valnet.net> <56E1C032.8010302@uni-greifswald.de> Message-ID: <56E1C2F3.1070805@valnet.net> Thanks for your reply Gordon, I've added the mail_log to my mail_plugins list in 10-mail.conf I'm seeing quite a bit of activity in the debug log file, but I'm not exactly sure how to interpret it all - specifically what I should look for when a POP3 or IMAP client is sending delete commands. Is there a guide on the wiki that I'm not seeing for how to interpret the logs to see this kind of activity? -- ----------------------------------------------- - Nick Bright - - Vice President of Technology - - Valnet -=- We Connect You -=- - - Tel 888-332-1616 x 315 / Fax 620-331-0789 - - Web http://www.valnet.net/ - ----------------------------------------------- - Are your files safe? - - Valnet Vault - Secure Cloud Backup - - More information & 30 day free trial at - - http://www.valnet.net/services/valnet-vault - ----------------------------------------------- This email message and any attachments are intended solely for the use of the addressees hereof. This message and any attachments may contain information that is confidential, privileged and exempt from disclosure under applicable law. If you are not the intended recipient of this message, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply E-mail and immediately delete this message from your system. From chris2014 at postbox.xyz Thu Mar 10 18:54:43 2016 From: chris2014 at postbox.xyz (Chris) Date: Thu, 10 Mar 2016 19:54:43 +0100 Subject: Setting up public mailboxes - user not found In-Reply-To: References: Message-ID: <190c70f473b5b52e6838b0a677062a0f.squirrel@mail2.postbox.xyz> Marti Markov wrote: > Hi all, > > This is the first time I use the dovecot mail list so I???m sorry if I > forget something. You could also use deliver: /usr/lib/dovecot/dovecot-lda -d mailadmin -m PublicFolder/test From nick.bright at valnet.net Thu Mar 10 18:59:12 2016 From: nick.bright at valnet.net (Nick Bright) Date: Thu, 10 Mar 2016 12:59:12 -0600 Subject: Troubleshooting mailbox problems In-Reply-To: <56E1C2F3.1070805@valnet.net> References: <56E198E6.8000104@valnet.net> <56E1C032.8010302@uni-greifswald.de> <56E1C2F3.1070805@valnet.net> Message-ID: <56E1C400.6040504@valnet.net> On 3/10/2016 12:54 PM, Nick Bright wrote: > Thanks for your reply Gordon, I've added the mail_log to my > mail_plugins list in 10-mail.conf > > I'm seeing quite a bit of activity in the debug log file, but I'm not > exactly sure how to interpret it all - specifically what I should look > for when a POP3 or IMAP client is sending delete commands. > > Is there a guide on the wiki that I'm not seeing for how to interpret > the logs to see this kind of activity? > I must have done something wrong, as adding the mail_log to the mail_plugins list made all authentication timeout. -- ----------------------------------------------- - Nick Bright - - Vice President of Technology - - Valnet -=- We Connect You -=- - - Tel 888-332-1616 x 315 / Fax 620-331-0789 - - Web http://www.valnet.net/ - ----------------------------------------------- - Are your files safe? - - Valnet Vault - Secure Cloud Backup - - More information & 30 day free trial at - - http://www.valnet.net/services/valnet-vault - ----------------------------------------------- This email message and any attachments are intended solely for the use of the addressees hereof. This message and any attachments may contain information that is confidential, privileged and exempt from disclosure under applicable law. If you are not the intended recipient of this message, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply E-mail and immediately delete this message from your system. From andrew.mcglashan at affinityvision.com.au Thu Mar 10 21:50:50 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Fri, 11 Mar 2016 08:50:50 +1100 Subject: Troubleshooting mailbox problems In-Reply-To: <56E198E6.8000104@valnet.net> References: <56E198E6.8000104@valnet.net> Message-ID: <56E1EC3A.6030401@affinityvision.com.au> If they are using POP to download messages from any client, make sure the client does a leave on server for at least long enough for other client devices to download the messages. Cheers A. From nick.bright at valnet.net Fri Mar 11 00:18:58 2016 From: nick.bright at valnet.net (Nick Bright) Date: Thu, 10 Mar 2016 18:18:58 -0600 Subject: Troubleshooting mailbox problems In-Reply-To: <56E1EC3A.6030401@affinityvision.com.au> References: <56E198E6.8000104@valnet.net> <56E1EC3A.6030401@affinityvision.com.au> Message-ID: <56E20EF2.8060501@valnet.net> On 3/10/2016 3:50 PM, Andrew McGlashan wrote: > If they are using POP to download messages from any client, make sure > the client does a leave on server for at least long enough for other > client devices to download the messages. > > Cheers > A. Yes, that's the whole problem. They SAY that it's set for leave on server, but it's not happening that way. Essentially, observed behavior does not match the values of settings in the mail clients. -- ----------------------------------------------- - Nick Bright - - Vice President of Technology - - Valnet -=- We Connect You -=- - - Tel 888-332-1616 x 315 / Fax 620-331-0789 - - Web http://www.valnet.net/ - ----------------------------------------------- - Are your files safe? - - Valnet Vault - Secure Cloud Backup - - More information & 30 day free trial at - - http://www.valnet.net/services/valnet-vault - ----------------------------------------------- This email message and any attachments are intended solely for the use of the addressees hereof. This message and any attachments may contain information that is confidential, privileged and exempt from disclosure under applicable law. If you are not the intended recipient of this message, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply E-mail and immediately delete this message from your system. From forondarena at gmail.com Thu Mar 10 14:48:26 2016 From: forondarena at gmail.com (Luis Ugalde) Date: Thu, 10 Mar 2016 14:48:26 +0000 Subject: ETOOMANYREFS related errors Message-ID: Hi, I'm starting to see, on a pretty standard Debian Jessie installation, some error messages that are apparently related to the ETOOMANYREFS errno. Firstly, the mail log shows this: dovecot: pop3-login: Error: fd_send(pop3, 18) failed: Too many references: cannot splice And then the login process fails: dovecot: pop3-login: Internal login failure (pid=34388 id=1) (internal failure, 1 successful auths): user=, method=PLAIN, rip=rip, lip=lip, session= Is this something that Dovecot should be able to handle, or is it strictly Debian/libc/MySillyMistake related? #uname -a Linux server 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 (2016-01-17) x86_64 GNU/Linux #dovecot --version 2.2.13 #dpkg -l | grep -E 'dovecot-core|libc6|linux-image' ii dovecot-core 1:2.2.13-12~deb8u1 amd64 ii libc6:amd64 2.19-18+deb8u3 amd64 ii libc6-i386 2.19-18+deb8u3 amd64 ii linux-image-3.16.0-4-amd64 3.16.7-ckt20-1+deb8u3 amd64 Best Regards, Luis From tss at iki.fi Fri Mar 11 00:56:00 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 11 Mar 2016 13:56:00 +1300 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <56E1788B.30209@Media-Brokers.com> References: <20160307135040.6923898b@ass> <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> <56E1788B.30209@Media-Brokers.com> Message-ID: <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> > On 11 Mar 2016, at 02:37, Charles Marcus wrote: > > On 3/9/2016 9:02 PM, Timo Sirainen wrote: >> On 08 Mar 2016, at 01:50, Pavel Stano wrote: >>> >>> sis attachment deduplication is broken in 2.2.16 upwards. >>> It is caused by this commit. >>> https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 >>> >>> in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of >>> inodes of hash files. >>> Because fs_stat() after that commit use fstat() on open fd of temporary >>> file instead of stat on filename. But that temporary file has differnt >>> inode. >>> >>> It not cause any corruption but it will not save any space. >>> Because every duplicate attachment will be in separate file. >> Thanks, fixed: https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c841584ea1 > > So, after the fix is applied, does dovecot silently delete the > duplicated files, or is there a command that needs to be run manually? You'd have to do it manually in some way. A script that does something like: Go through all attachment directories and for each file: - Sort files by filename - Identify that files A and B the same (beginning of the filename begins with same hash), but have a different inode - ln A B.tmp && mv B.tmp B From tss at iki.fi Fri Mar 11 01:08:42 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 11 Mar 2016 14:08:42 +1300 Subject: ETOOMANYREFS related errors In-Reply-To: References: Message-ID: <25F66FDB-A06E-495B-A3B5-60B89DA2D133@iki.fi> On 11 Mar 2016, at 03:48, Luis Ugalde wrote: > > Hi, > > I'm starting to see, on a pretty standard Debian Jessie installation, some > error messages that are apparently related to the ETOOMANYREFS errno. > > Firstly, the mail log shows this: > dovecot: pop3-login: Error: fd_send(pop3, 18) failed: Too many references: > cannot splice Apparently because Linux thinks the same fd has been passed around recursively too many times: http://lkml.iu.edu/hypermail/linux/kernel/1101.0/01917.html But Dovecot doesn't pass it recursively. It's only passed once from pop3-login to pop3 process. > Is this something that Dovecot should be able to handle, or is it strictly > Debian/libc/MySillyMistake related? > > #uname -a > Linux server 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 > (2016-01-17) x86_64 GNU/Linux I wonder if there's a new kernel change that started detecting the recursion wrong. From forondarena at gmail.com Fri Mar 11 08:01:41 2016 From: forondarena at gmail.com (Luis Ugalde) Date: Fri, 11 Mar 2016 08:01:41 +0000 Subject: ETOOMANYREFS related errors In-Reply-To: <25F66FDB-A06E-495B-A3B5-60B89DA2D133@iki.fi> References: <25F66FDB-A06E-495B-A3B5-60B89DA2D133@iki.fi> Message-ID: El vie., 11 mar. 2016 a las 2:08, Timo Sirainen () escribi?: > On 11 Mar 2016, at 03:48, Luis Ugalde wrote: > > > > Hi, > > > > I'm starting to see, on a pretty standard Debian Jessie installation, > some > > error messages that are apparently related to the ETOOMANYREFS errno. > > > > Firstly, the mail log shows this: > > dovecot: pop3-login: Error: fd_send(pop3, 18) failed: Too many > references: > > cannot splice > > Apparently because Linux thinks the same fd has been passed around > recursively too many times: > http://lkml.iu.edu/hypermail/linux/kernel/1101.0/01917.html > > But Dovecot doesn't pass it recursively. It's only passed once from > pop3-login to pop3 process. > > > Is this something that Dovecot should be able to handle, or is it > strictly > > Debian/libc/MySillyMistake related? > > > > #uname -a > > Linux server 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 > > (2016-01-17) x86_64 GNU/Linux > > I wonder if there's a new kernel change that started detecting the > recursion wrong. > > Yes, It's started to happen with the latest kernels from the Stable branch. This is the latest I have installed: 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 (2016-01-17) x86_64 Older Debian kernels are not showing up anything. This one, for example: 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u6 (2015-11-09) x86_64 Regards. From gordon.grubert+lists at uni-greifswald.de Fri Mar 11 08:18:54 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Fri, 11 Mar 2016 09:18:54 +0100 Subject: Troubleshooting mailbox problems In-Reply-To: <56E20EF2.8060501@valnet.net> References: <56E198E6.8000104@valnet.net> <56E1EC3A.6030401@affinityvision.com.au> <56E20EF2.8060501@valnet.net> Message-ID: <56E27F6E.8070506@uni-greifswald.de> On 11.03.2016 01:18, Nick Bright wrote: > On 3/10/2016 3:50 PM, Andrew McGlashan wrote: >> If they are using POP to download messages from any client, make sure >> the client does a leave on server for at least long enough for other >> client devices to download the messages. >> >> Cheers >> A. > Yes, that's the whole problem. > > They SAY that it's set for leave on server, but it's not happening that > way. > > Essentially, observed behavior does not match the values of settings in > the mail clients. > But with your logging settings above you can prove the client commands. Best regards, Gordon From lists at merit.unu.edu Fri Mar 11 09:10:58 2016 From: lists at merit.unu.edu (mj) Date: Fri, 11 Mar 2016 10:10:58 +0100 Subject: Timout for LDAP connection In-Reply-To: <56E18F74.3040601@uni-greifswald.de> References: <56D4613D.5050805@uni-greifswald.de> <56E18F74.3040601@uni-greifswald.de> Message-ID: <56E28BA2.1080605@merit.unu.edu> Hi, We're now running with ldap via haproxy, as was suggested in this thread by Timo. So far, so good: it seems to work very well. MJ On 03/10/2016 04:15 PM, Gordon Grubert wrote: > Hi Timo, > > On 01.03.2016 22:51, Timo Sirainen wrote: >> On 29 Feb 2016, at 17:18, Gordon Grubert >> wrote: >>> >>> Hi, >>> >>> we are using a round robin dns record for connections to our ldap >>> system. This works fine for almost all cases. In particular, for >>> dovecot does this mean, when an ldap server is stopped, dovecot >>> instantly reconnects to another ldap server. >>> >>> But when the network connection to the active ldap server is broken, >>> dovecot sticks to the failed ldap server. Is there any possibility to >>> define a connection timeout? >> >> What should happen is that as long as new requests keep coming, >> Dovecot realizes after about 60 seconds that the LDAP server is >> hanging. It then reconnects and the reconnection should work. But... >> First of all, 60 seconds is likely a much too long timeout. >> >> But more importantly it looks like there's something weird now going >> on with OpenLDAP library. I added this somewhat recently and tested >> that it works: >> >> https://github.com/dovecot/core/commit/fb3178a1924dae52151d88c4d4ded879df43dd3f >> >> >> But now that I'm testing it, the timeout doesn't seem to be >> triggering. I don't know what happened to it that it suddenly doesn't >> work.. This also means that OpenLDAP seems to be internally stuck >> trying to connect to a server that isn't responding. Dovecot doesn't >> currently make the decisions on which LDAP server to connect to. It >> just passes through all the hosts to OpenLDAP library and lets it >> handle it. And it seems like OpenLDAP library can't right now do this >> failover. So maybe Dovecot should be responsible for that as well.. >> >> Anyway, for now you could set up haproxy to localhost and configure >> Dovecot LDAP to connect to haproxy and haproxy connect to the actual >> LDAP servers. >> > > today I've upgraded to 2.2.21-1~auto+171 on debian 8 and made a lot of > "interruption tests". Your fix not really solved the problem. > > But I found another interesting fact: The openldap client on debian 8 > can handle hard communication interrupts correctly. I've added > > NETWORK_TIMEOUT 5 > TIMEOUT 5 > > to ldap.conf because man 5 ldap.conf says: > > NETWORK_TIMEOUT > Specifies the timeout (in seconds) after which the poll(2)/select(2) > following a connect(2) returns in case of no activity. > > TIMEOUT > Specifies a timeout (in seconds) after which calls to > synchronous LDAP APIs will abort if no response is received. Also > used for any ldap_result(3) calls where a NULL timeout parameter is > supplied. > > We are using the ISC DHCP server with dynamic ldap connections. This > daemon uses - like dovecot - the LDAP API of the openldap client for > access to the ldap server. The DHCP opens a persistent ldap connection > to handle all dhcp requests (same behavior like dovecot). Here, the > timeouts for connection loss are working. > > Therefore, my question: Why does this not work for dovecot, too, when > dovecot uses the same API? Dovecot does not get a response from the > LDAP server and has to reconnect, only. > > IMAP server world domination requires a reconnect in case of connection > timeouts ;-) > > Best regards, > Gordon From leithner at itronic.at Fri Mar 11 10:17:34 2016 From: leithner at itronic.at (Harald Leithner) Date: Fri, 11 Mar 2016 11:17:34 +0100 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> References: <20160307135040.6923898b@ass> <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> <56E1788B.30209@Media-Brokers.com> <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> Message-ID: <56E29B3E.5010901@itronic.at> Am 11.03.2016 um 01:56 schrieb Timo Sirainen: > >> On 11 Mar 2016, at 02:37, Charles Marcus wrote: >> >> On 3/9/2016 9:02 PM, Timo Sirainen wrote: >>> On 08 Mar 2016, at 01:50, Pavel Stano wrote: >>>> >>>> sis attachment deduplication is broken in 2.2.16 upwards. >>>> It is caused by this commit. >>>> https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 >>>> >>>> in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of >>>> inodes of hash files. >>>> Because fs_stat() after that commit use fstat() on open fd of temporary >>>> file instead of stat on filename. But that temporary file has differnt >>>> inode. >>>> >>>> It not cause any corruption but it will not save any space. >>>> Because every duplicate attachment will be in separate file. >>> Thanks, fixed: https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c841584ea1 >> >> So, after the fix is applied, does dovecot silently delete the >> duplicated files, or is there a command that needs to be run manually? > > You'd have to do it manually in some way. A script that does something like: > > Go through all attachment directories and for each file: > - Sort files by filename > - Identify that files A and B the same (beginning of the filename begins with same hash), but have a different inode > - ln A B.tmp && mv B.tmp B > This functionality is how it works in sis-queue correct? Wouldn't it be nice to adopted doveadm sis deduplicate to handle this? regards -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From skeletor at lissyara.su Fri Mar 11 13:53:50 2016 From: skeletor at lissyara.su (skeletor at lissyara.su) Date: Fri, 11 Mar 2016 15:53:50 +0200 Subject: ldap userdb/passwd connection timeout Message-ID: <56E2CDEE.2050009@lissyara.su> Hello. I want to use second ldap server for failover. So, i add a second section for userdb/passdb. My question is: what connection timeout, after that dovecot will be try to connectd another ldap server? Can i change it? Thanks. From alessio at skye.it Fri Mar 11 14:22:15 2016 From: alessio at skye.it (Alessio Cecchi) Date: Fri, 11 Mar 2016 15:22:15 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir Message-ID: <56E2D497.9030109@skye.it> Hi, I'm evaluating to switch from NetApp to a ZFS appliance (like Qsan). Our setup is Dovecot, Maildir for email storage and NFS to share mailboxes (more than 30k users) across POP/IMAP and MX servers. NetApp NFS works fine also under high load but have some limitation for inode numbers per Volume and is expensive (but recently their prices have dropped). ZFS, I read, suggest to create many small Raid Group to increase IOPS, but this configuration (N Raid instead of one RAID-DP like NetApp) is more complex to manage, or not? Someone has experiences with ZFS and NFS(v3) in high load environments? Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From gordon.grubert+lists at uni-greifswald.de Fri Mar 11 14:30:03 2016 From: gordon.grubert+lists at uni-greifswald.de (Gordon Grubert) Date: Fri, 11 Mar 2016 15:30:03 +0100 Subject: Timout for LDAP connection In-Reply-To: <56E28BA2.1080605@merit.unu.edu> References: <56D4613D.5050805@uni-greifswald.de> <56E18F74.3040601@uni-greifswald.de> <56E28BA2.1080605@merit.unu.edu> Message-ID: <56E2D66B.3020208@uni-greifswald.de> On 11.03.2016 10:10, mj wrote: > Hi, > > We're now running with ldap via haproxy, as was suggested in this thread > by Timo. So far, so good: it seems to work very well. Of course, such a WORKAROUND could be used and I'm sure that this works. But Timo says, dovecot is using the LDAP API. The openldap client can handle network timeouts. Therefore, dovecot has to be able to use these timeouts, too, like described in ldap.conf(5). Best regards, Gordon From juan at inti.gob.ar Fri Mar 11 14:58:00 2016 From: juan at inti.gob.ar (Juan Bernhard) Date: Fri, 11 Mar 2016 11:58:00 -0300 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <56E2D497.9030109@skye.it> References: <56E2D497.9030109@skye.it> Message-ID: <56E2DCF8.1090204@inti.gob.ar> El 11/03/2016 a las 11:22 a.m., Alessio Cecchi escribi?: > Hi, > > I'm evaluating to switch from NetApp to a ZFS appliance (like Qsan). Our > setup is Dovecot, Maildir for email storage and NFS to share mailboxes > (more than 30k users) across POP/IMAP and MX servers. > > NetApp NFS works fine also under high load but have some limitation for > inode numbers per Volume and is expensive (but recently their prices > have dropped). > > ZFS, I read, suggest to create many small Raid Group to increase IOPS, > but this configuration (N Raid instead of one RAID-DP like NetApp) is > more complex to manage, or not? > > Someone has experiences with ZFS and NFS(v3) in high load environments? > > Thanks Be careful to no do any synchronous writes under ZFS. Every sync write can take up to 3 seconds of latency (under freebsd, I didnt test ZFS in linux). Im using it in a 3k user environment and works great with a 4TB raid 10, and dovecot cache files in a SSD disk. Saludos, Juan. From CMarcus at Media-Brokers.com Fri Mar 11 15:04:42 2016 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 11 Mar 2016 10:04:42 -0500 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <56E2DCF8.1090204@inti.gob.ar> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> Message-ID: <56E2DE8A.8040404@Media-Brokers.com> On 3/11/2016 9:58 AM, Juan Bernhard wrote: > Be careful to no do any synchronous writes under ZFS. Every sync write > can take up to 3 seconds of latency (under freebsd, I didnt test ZFS in > linux). Im using it in a 3k user environment and works great with a 4TB > raid 10, and dovecot cache files in a SSD disk. >From what I've heard you should not use hardware based RAID (ie, RAID10) setups with ZFS, you should let ZFS handle it. Maybe that is the source of your latency issues? From juan at inti.gob.ar Fri Mar 11 15:15:35 2016 From: juan at inti.gob.ar (Juan Bernhard) Date: Fri, 11 Mar 2016 12:15:35 -0300 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <56E2DE8A.8040404@Media-Brokers.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <56E2DE8A.8040404@Media-Brokers.com> Message-ID: <56E2E117.1090505@inti.gob.ar> El 11/03/2016 a las 12:04 p.m., Charles Marcus escribi?: > On 3/11/2016 9:58 AM, Juan Bernhard wrote: >> Be careful to no do any synchronous writes under ZFS. Every sync write >> can take up to 3 seconds of latency (under freebsd, I didnt test ZFS in >> linux). Im using it in a 3k user environment and works great with a 4TB >> raid 10, and dovecot cache files in a SSD disk. > >>From what I've heard you should not use hardware based RAID (ie, RAID10) > setups with ZFS, you should let ZFS handle it. > > Maybe that is the source of your latency issues? > There are actually two ZFS raid1 but in the same zpool, and the SSD in local, not in the ZFS dtorage. The latency was because I tried to use a ZFS for datasore of a vmware undres NFS, and NFS under vmware is always synchronous. I improved 10 times the performance under iSCSI From skraw at ithnet.com Fri Mar 11 15:17:50 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Fri, 11 Mar 2016 16:17:50 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <56E2DCF8.1090204@inti.gob.ar> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> Message-ID: <20160311161750.a4750629.skraw@ithnet.com> On Fri, 11 Mar 2016 11:58:00 -0300 Juan Bernhard wrote: > > El 11/03/2016 a las 11:22 a.m., Alessio Cecchi escribi?: > > Hi, > > > > I'm evaluating to switch from NetApp to a ZFS appliance (like Qsan). Our > > setup is Dovecot, Maildir for email storage and NFS to share mailboxes > > (more than 30k users) across POP/IMAP and MX servers. > > > > NetApp NFS works fine also under high load but have some limitation for > > inode numbers per Volume and is expensive (but recently their prices > > have dropped). > > > > ZFS, I read, suggest to create many small Raid Group to increase IOPS, > > but this configuration (N Raid instead of one RAID-DP like NetApp) is > > more complex to manage, or not? > > > > Someone has experiences with ZFS and NFS(v3) in high load environments? > > > > Thanks > > Be careful to no do any synchronous writes under ZFS. Every sync write > can take up to 3 seconds of latency (under freebsd, I didnt test ZFS in > linux). Im using it in a 3k user environment and works great with a 4TB > raid 10, and dovecot cache files in a SSD disk. > > Saludos, Juan. zfs set sync=disabled ? -- Regards, Stephan From richw at richw.org Fri Mar 11 17:29:06 2016 From: richw at richw.org (Rich Wales) Date: Fri, 11 Mar 2016 09:29:06 -0800 Subject: Looking for way to monitor dsync, confirm it is or isn't running Message-ID: <3qMDf45HV4zZ4VJr@pigeon.richw.org> I am syncing two Dovecot sites using the dsync function. I would like to be able to run some sort of periodic health check to confirm that dsync is (or is not) running properly between the two sites, and alert me if dsync is failing or lagging excessively. Does anyone know of a tool to do this? (If possible, something I can set up to run periodically in Nagios?) Thanks for any suggestions. Rich Wales richw at richw.org From trashcan at ellael.org Fri Mar 11 18:09:22 2016 From: trashcan at ellael.org (Michael Grimm) Date: Fri, 11 Mar 2016 19:09:22 +0100 Subject: Looking for way to monitor dsync, confirm it is or isn't running In-Reply-To: <3qMDf45HV4zZ4VJr@pigeon.richw.org> References: <3qMDf45HV4zZ4VJr@pigeon.richw.org> Message-ID: <78164538-D4AA-47EF-93A6-8D406B3AB46B@ellael.org> Rich Wales wrote: > I am syncing two Dovecot sites using the dsync function. If you are referring to replication ... > I would like to be able to run some sort of periodic health check to > confirm that dsync is (or is not) running properly between the two > sites, and alert me if dsync is failing or lagging excessively. > > Does anyone know of a tool to do this? No replication running: | mail> doveadm replicator status | Fatal: net_connect_unix(/var/run/dovecot/replicator-doveadm) failed: No such file or directory Replication running: | mail> doveadm replicator status | Queued 'sync' requests 0 | Queued 'high' requests 0 | Queued 'low' requests 0 | Queued 'failed' requests 0 | Queued 'full resync' requests 0 | Waiting 'failed' requests 0 If those numbers tend to become significantly larger than 0, then replication has issues. I do not use that for health checking by something like ... > (If possible, something I can set up to run periodically in Nagios?) ? but used it once in a while when suspecting issues with replication. HTH, Michael From lists at merit.unu.edu Fri Mar 11 18:32:16 2016 From: lists at merit.unu.edu (mj) Date: Fri, 11 Mar 2016 19:32:16 +0100 Subject: Timout for LDAP connection In-Reply-To: <56E2D66B.3020208@uni-greifswald.de> References: <56D4613D.5050805@uni-greifswald.de> <56E18F74.3040601@uni-greifswald.de> <56E28BA2.1080605@merit.unu.edu> <56E2D66B.3020208@uni-greifswald.de> Message-ID: <56E30F30.4050705@merit.unu.edu> On 03/11/2016 03:30 PM, Gordon Grubert wrote: > Of course, such a WORKAROUND could be used and I'm sure that this > works. But Timo says, dovecot is using the LDAP API. The openldap > client can handle network timeouts. Therefore, dovecot has to be able > to use these timeouts, too, like described in ldap.conf(5). Sure sure, absolutely agreed. From tss at iki.fi Fri Mar 11 19:45:54 2016 From: tss at iki.fi (Timo Sirainen) Date: Sat, 12 Mar 2016 08:45:54 +1300 Subject: Timout for LDAP connection In-Reply-To: <56E18F74.3040601@uni-greifswald.de> References: <56D4613D.5050805@uni-greifswald.de> <56E18F74.3040601@uni-greifswald.de> Message-ID: <3E5D227E-8C7D-4A4D-9368-F2A8DC756E49@iki.fi> On 11 Mar 2016, at 04:15, Gordon Grubert wrote: > > But I found another interesting fact: The openldap client on debian 8 > can handle hard communication interrupts correctly. I've added > > NETWORK_TIMEOUT 5 > TIMEOUT 5 > > to ldap.conf because man 5 ldap.conf says: > > NETWORK_TIMEOUT > Specifies the timeout (in seconds) after which the poll(2)/select(2) > following a connect(2) returns in case of no activity. > > TIMEOUT > Specifies a timeout (in seconds) after which calls to > synchronous LDAP APIs will abort if no response is received. Also > used for any ldap_result(3) calls where a NULL timeout parameter is > supplied. Dovecot doesn't use any synchronous openldap calls, so according to these manual pages the above settings are ignored by openldap library with Dovecot. > We are using the ISC DHCP server with dynamic ldap connections. This > daemon uses - like dovecot - the LDAP API of the openldap client for > access to the ldap server. The DHCP opens a persistent ldap connection > to handle all dhcp requests (same behavior like dovecot). Here, the > timeouts for connection loss are working. > > Therefore, my question: Why does this not work for dovecot, too, when > dovecot uses the same API? Dovecot does not get a response from the > LDAP server and has to reconnect, only. I bet ISC DHCP uses synchronous openldap calls. Dovecot can't also do the timeout handling internally, because it can only abort the entire openldap connect call. Dovecot can't tell openldap to connect to the next server. The only solution I can think of is that Dovecot doesn't let openldap do the multi-server connection handling, but instead have Dovecot create a separate openldap instance for each server and manage the connections + timeouts internally. But that's a lot of work.. Actually, a workaround might be to do synchronous binding. I'd rather not change Dovecot to do this by default, because it hangs the entire auth process while it's binding. But SASL authentication has no async API in openldap, so by enabling it you'll get synchronous authentication which will probably apply openldap's internally configured timeouts. Maybe you can get it working with: sasl_bind = yes sasl_mech = PLAIN From CMarcus at Media-Brokers.com Sat Mar 12 00:27:41 2016 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 11 Mar 2016 19:27:41 -0500 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> References: <20160307135040.6923898b@ass> <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> <56E1788B.30209@Media-Brokers.com> <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> Message-ID: <56E3627D.9040901@Media-Brokers.com> On 3/10/2016 7:56 PM, Timo Sirainen wrote: >> On 11 Mar 2016, at 02:37, Charles Marcus wrote: >> >> On 3/9/2016 9:02 PM, Timo Sirainen wrote: >>> On 08 Mar 2016, at 01:50, Pavel Stano wrote: >>>> sis attachment deduplication is broken in 2.2.16 upwards. >>>> It is caused by this commit. >>>> https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 >>>> >>>> in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of >>>> inodes of hash files. >>>> Because fs_stat() after that commit use fstat() on open fd of temporary >>>> file instead of stat on filename. But that temporary file has differnt >>>> inode. >>>> >>>> It not cause any corruption but it will not save any space. >>>> Because every duplicate attachment will be in separate file. >>> Thanks, fixed: https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c841584ea1 >> So, after the fix is applied, does dovecot silently delete the >> duplicated files, or is there a command that needs to be run manually? > You'd have to do it manually in some way. A script that does something like: > > Go through all attachment directories and for each file: > - Sort files by filename > - Identify that files A and B the same (beginning of the filename begins with same hash), but have a different inode > - ln A B.tmp && mv B.tmp B Ugh... ok thanks, but it seems like that would be much safer as a doveadm command... From lists at luigirosa.com Sat Mar 12 05:20:52 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 12 Mar 2016 06:20:52 +0100 Subject: Logging the TLS cipher suite Message-ID: <56E3A734.30102@luigirosa.com> Hi, could it be possible to log the TLS cipher suite as Postfix does? This is a typical TLS Dovecot log line: imap-login: Login: user=, method=DIGEST-MD5, rip=1.2.3.4, lip=4.3.2.1, mpid=19671, TLS, session= This is the Postfix equivalent postfix/smtp[59723]: Anonymous TLS connection established to mail.acmne.com[1.2.3.4]:25: TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits) -- Ciao, luigi / +--[Luigi Rosa]-- \ We're not surrounded, we're in a target-rich environment! From gedalya at gedalya.net Sat Mar 12 05:30:19 2016 From: gedalya at gedalya.net (Gedalya) Date: Sat, 12 Mar 2016 00:30:19 -0500 Subject: Logging the TLS cipher suite In-Reply-To: <56E3A734.30102@luigirosa.com> References: <56E3A734.30102@luigirosa.com> Message-ID: <56E3A96B.6020900@gedalya.net> Add %k to login_log_format_elements (in conf.d/10-logging.conf) for example login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k session=<%{session}> On 03/12/2016 12:20 AM, Luigi Rosa wrote: > Hi, > could it be possible to log the TLS cipher suite as Postfix does? > > This is a typical TLS Dovecot log line: > > imap-login: Login: user=, method=DIGEST-MD5, > rip=1.2.3.4, lip=4.3.2.1, mpid=19671, TLS, session= > > This is the Postfix equivalent > > postfix/smtp[59723]: Anonymous TLS connection established to > mail.acmne.com[1.2.3.4]:25: TLSv1.2 with cipher AECDH-AES256-SHA > (256/256 bits) > > > From gedalya at gedalya.net Sat Mar 12 05:30:52 2016 From: gedalya at gedalya.net (Gedalya) Date: Sat, 12 Mar 2016 00:30:52 -0500 Subject: Logging the TLS cipher suite In-Reply-To: <56E3A96B.6020900@gedalya.net> References: <56E3A734.30102@luigirosa.com> <56E3A96B.6020900@gedalya.net> Message-ID: <56E3A98C.8090009@gedalya.net> Forgot the important part, sorry http://wiki.dovecot.org/Variables On 03/12/2016 12:30 AM, Gedalya wrote: > Add %k to login_log_format_elements (in conf.d/10-logging.conf) > for example > > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e > %c %k session=<%{session}> > > > On 03/12/2016 12:20 AM, Luigi Rosa wrote: >> Hi, >> could it be possible to log the TLS cipher suite as Postfix does? >> >> This is a typical TLS Dovecot log line: >> >> imap-login: Login: user=, method=DIGEST-MD5, >> rip=1.2.3.4, lip=4.3.2.1, mpid=19671, TLS, session= >> >> This is the Postfix equivalent >> >> postfix/smtp[59723]: Anonymous TLS connection established to >> mail.acmne.com[1.2.3.4]:25: TLSv1.2 with cipher AECDH-AES256-SHA >> (256/256 bits) >> >> >> > From lists at luigirosa.com Sat Mar 12 06:30:18 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 12 Mar 2016 07:30:18 +0100 Subject: Logging the TLS cipher suite In-Reply-To: <56E3A96B.6020900@gedalya.net> References: <56E3A734.30102@luigirosa.com> <56E3A96B.6020900@gedalya.net> Message-ID: <56E3B77A.2000805@luigirosa.com> Thank you very much! Gedalya wrote on 12/03/2016 06:30: > Add %k to login_log_format_elements (in conf.d/10-logging.conf) > for example > > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k > session=<%{session}> > > > On 03/12/2016 12:20 AM, Luigi Rosa wrote: >> Hi, >> could it be possible to log the TLS cipher suite as Postfix does? >> >> This is a typical TLS Dovecot log line: >> >> imap-login: Login: user=, method=DIGEST-MD5, rip=1.2.3.4, >> lip=4.3.2.1, mpid=19671, TLS, session= >> >> This is the Postfix equivalent >> >> postfix/smtp[59723]: Anonymous TLS connection established to >> mail.acmne.com[1.2.3.4]:25: TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits) >> >> >> > -- Ciao, luigi / +--[Luigi Rosa]-- \ Natalya Simonova: You destroy every vehicle you get into? James Bond: Standard operating procedure. Boys with toys. --"007 Goldeneye" From lista at xdrv.co.uk Sun Mar 13 09:44:39 2016 From: lista at xdrv.co.uk (James) Date: Sun, 13 Mar 2016 09:44:39 +0000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <56E2DCF8.1090204@inti.gob.ar> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> Message-ID: <56E53687.1010707@xdrv.co.uk> On 11/03/2016 14:58, Juan Bernhard wrote: >> Someone has experiences with ZFS and NFS(v3) in high load environments? >> >> Thanks > > Be careful to no do any synchronous writes under ZFS. By default all NFS writes are synchronous but I assume dovcot sync writes all data anyway so in this case the NFS sync doesn't matter. > Every sync write can take up to 3 seconds of latency (under freebsd, > I didnt test ZFS in linux). sync writes should take a few ms (they do for me). If you have enough load for them to be a problem you should have enough revenue to afford an SSD as a ZFS write cache / SLOG and then they will no longer be a problem. From lista at xdrv.co.uk Sun Mar 13 09:45:06 2016 From: lista at xdrv.co.uk (James) Date: Sun, 13 Mar 2016 09:45:06 +0000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160311161750.a4750629.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> Message-ID: <56E536A2.7070808@xdrv.co.uk> On 11/03/2016 15:17, Stephan von Krawczynski wrote: > zfs set sync=disabled ? Only if you are happy to loose data on power failure. From skraw at ithnet.com Sun Mar 13 10:47:23 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Sun, 13 Mar 2016 11:47:23 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <56E536A2.7070808@xdrv.co.uk> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> Message-ID: <20160313114723.fae88c6c.skraw@ithnet.com> On Sun, 13 Mar 2016 09:45:06 +0000 James wrote: > On 11/03/2016 15:17, Stephan von Krawczynski wrote: > > > zfs set sync=disabled ? > > Only if you are happy to loose data on power failure. I don't know the actual setup, but if you have no UPC you shouldn't host email services anyway. -- Regards, Stephan From skraw at ithnet.com Sun Mar 13 10:48:41 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Sun, 13 Mar 2016 11:48:41 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160313114723.fae88c6c.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> Message-ID: <20160313114841.19d68cf4.skraw@ithnet.com> On Sun, 13 Mar 2016 11:47:23 +0100 Stephan von Krawczynski wrote: > On Sun, 13 Mar 2016 09:45:06 +0000 > James wrote: > > > On 11/03/2016 15:17, Stephan von Krawczynski wrote: > > > > > zfs set sync=disabled ? > > > > Only if you are happy to loose data on power failure. > > I don't know the actual setup, but if you have no UPC you shouldn't host email > services anyway. That should read "UPS" of course ... > -- > Regards, > Stephan From noel.butler at ausics.net Sun Mar 13 23:32:42 2016 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 14 Mar 2016 09:32:42 +1000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160313114723.fae88c6c.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> Message-ID: On 13/03/2016 20:47, Stephan von Krawczynski wrote: > On Sun, 13 Mar 2016 09:45:06 +0000 > James wrote: > >> On 11/03/2016 15:17, Stephan von Krawczynski wrote: >> >> > zfs set sync=disabled ? >> >> Only if you are happy to loose data on power failure. > > I don't know the actual setup, but if you have no UPC you shouldn't > host email > services anyway. I'm guessing you meant UPS, anyway, a UPS wont protect you from human error. Also, most buildings, at least in this country, have a fire emergency shutoff requirement, meaning mains is isolated from the building, and the back up gennies are also forbidden to be engaged - UPS's dont last forever. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From skraw at ithnet.com Sun Mar 13 23:59:37 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Mon, 14 Mar 2016 00:59:37 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> Message-ID: <20160314005937.989a9f2e.skraw@ithnet.com> On Mon, 14 Mar 2016 09:32:42 +1000 Noel Butler wrote: > On 13/03/2016 20:47, Stephan von Krawczynski wrote: > > On Sun, 13 Mar 2016 09:45:06 +0000 > > James wrote: > > > >> On 11/03/2016 15:17, Stephan von Krawczynski wrote: > >> > >> > zfs set sync=disabled ? > >> > >> Only if you are happy to loose data on power failure. > > > > I don't know the actual setup, but if you have no UPC you shouldn't > > host email > > services anyway. > > I'm guessing you meant UPS, anyway, a UPS wont protect you from human > error. > > Also, most buildings, at least in this country, have a fire emergency > shutoff requirement, meaning mains is isolated from the building, and > the back up gennies are also forbidden to be engaged - UPS's dont last > forever. Guys, please don't argue on kindergarten level. The UPS is for backing a sudden death, but not for running five days. Of course you can do a controlled shutdown if battery level falls below a trigger value. And this is about all you need: control. There is no fs error as long as you perform a regular shutdown. If UPS-backup is forbidden in your country then I suggest moving to civilized regions of the planet ;-) -- Regards, Stephan From richw at richw.org Mon Mar 14 04:55:26 2016 From: richw at richw.org (Rich Wales) Date: Sun, 13 Mar 2016 21:55:26 -0700 Subject: Looking for way to monitor dsync, confirm it is or isn't running In-Reply-To: <78164538-D4AA-47EF-93A6-8D406B3AB46B@ellael.org> References: <3qMDf45HV4zZ4VJr@pigeon.richw.org> <78164538-D4AA-47EF-93A6-8D406B3AB46B@ellael.org> Message-ID: <3qNlmt410DzZ4VQL@pigeon.richw.org> Earlier, I asked: >> I would like to be able to run some sort of periodic health check to >> confirm that dsync is (or is not) running properly between the two >> sites, and alert me if dsync is failing or lagging excessively. Does >> anyone know of a tool to do this? and Michael Grimm replied: > doveadm replicator status > > If those numbers tend to become significantly larger than 0, then > replication has issues. I do not use that for health checking . . . > but used it once in a while when suspecting issues with replication. Thanks. As a followup question: If "doveadm replicator status" shows problems, are there any commands available to pinpoint exactly which request(s) is/are causing the problem(s)? One of the sites I am administering, for example, has been reporting 1 "queued 'full resync' requests" and 9 "waiting 'failed' requests" for the past couple of days. But I have no idea how to resolve the issue. Suggestions welcome. Rich Wales richw at richw.org From noel.butler at ausics.net Mon Mar 14 06:59:28 2016 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 14 Mar 2016 16:59:28 +1000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160314005937.989a9f2e.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> <20160314005937.989a9f2e.skraw@ithnet.com> Message-ID: On 14/03/2016 09:59, Stephan von Krawczynski wrote: > On Mon, 14 Mar 2016 09:32:42 +1000 > Noel Butler wrote: > >> On 13/03/2016 20:47, Stephan von Krawczynski wrote: >> > On Sun, 13 Mar 2016 09:45:06 +0000 >> > James wrote: >> > >> >> On 11/03/2016 15:17, Stephan von Krawczynski wrote: >> >> >> >> > zfs set sync=disabled ? >> >> >> >> Only if you are happy to loose data on power failure. >> > >> > I don't know the actual setup, but if you have no UPC you shouldn't >> > host email >> > services anyway. >> >> I'm guessing you meant UPS, anyway, a UPS wont protect you from human >> error. >> >> Also, most buildings, at least in this country, have a fire emergency >> shutoff requirement, meaning mains is isolated from the building, and >> the back up gennies are also forbidden to be engaged - UPS's dont last >> forever. > > Guys, please don't argue on kindergarten level. The UPS is for backing > a > sudden death, but not for running five days. Of course you can do a > controlled > shutdown if battery level falls below a trigger value. And this is > about all > you need: control. There is no fs error as long as you perform a > regular and you've never seen these cause problems with FS? then you must be a newbie, in over 25 years I've seen it happen several times - yes even after an apparent controlled shutdown. > shutdown. If UPS-backup is forbidden in your country then I suggest > moving to > civilized regions of the planet ;-) Now whos on kindergarten level, do you really want fireman pouring water on fire on a level of a building thats powered up because some lamer has a generator running? really? I'm sure those firemen would gladly hand YOU the hose, the best UPS systems runtime we've seen under average load for a large ISP data centre is 21 mins, usually ample time to allow the generators to start up, come to full power, and switch in taking over the load, but thats not going to help during a building fire, once their depleted, their depleted. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From skraw at ithnet.com Mon Mar 14 08:49:46 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Mon, 14 Mar 2016 09:49:46 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> <20160314005937.989a9f2e.skraw@ithnet.com> Message-ID: <20160314094946.a5d95f0a.skraw@ithnet.com> On Mon, 14 Mar 2016 16:59:28 +1000 Noel Butler wrote: > On 14/03/2016 09:59, Stephan von Krawczynski wrote: > > On Mon, 14 Mar 2016 09:32:42 +1000 > > Noel Butler wrote: > > > >> On 13/03/2016 20:47, Stephan von Krawczynski wrote: > >> > On Sun, 13 Mar 2016 09:45:06 +0000 > >> > James wrote: > >> > > >> >> On 11/03/2016 15:17, Stephan von Krawczynski wrote: > >> >> > >> >> > zfs set sync=disabled ? > >> >> > >> >> Only if you are happy to loose data on power failure. > >> > > >> > I don't know the actual setup, but if you have no UPC you shouldn't > >> > host email > >> > services anyway. > >> > >> I'm guessing you meant UPS, anyway, a UPS wont protect you from human > >> error. > >> > >> Also, most buildings, at least in this country, have a fire emergency > >> shutoff requirement, meaning mains is isolated from the building, and > >> the back up gennies are also forbidden to be engaged - UPS's dont last > >> forever. > > > > Guys, please don't argue on kindergarten level. The UPS is for backing > > a > > sudden death, but not for running five days. Of course you can do a > > controlled > > shutdown if battery level falls below a trigger value. And this is > > about all > > you need: control. There is no fs error as long as you perform a > > regular > > and you've never seen these cause problems with FS? then you must be a > newbie, in over 25 years I've seen it happen several times - yes even > after an apparent controlled shutdown. Maybe you're doing something wrong then. because in my last 21 years working exactly in this business I've not seen a single deadly fs-crash because of a power-outage. Not one. And we had of course several, all backed by UPS. > > shutdown. If UPS-backup is forbidden in your country then I suggest > > moving to > > civilized regions of the planet ;-) > > Now whos on kindergarten level, do you really want fireman pouring water > on fire on a level of a building thats powered up because some lamer has > a generator running? really? I'm sure those firemen would gladly hand > YOU the hose, the best UPS systems runtime we've seen under average load > for a large ISP data centre is 21 mins, usually ample time to allow the > generators to start up, come to full power, and switch in taking over > the load, but thats not going to help during a building fire, once their > depleted, their depleted. If your servers get drowned with water during a fire your fs is probably the least of your worries. You don't really plan to re-enable servers with water- or fire-damage, do you? That's probably why there shouldn't be a fireman pouring water in the first place. Please lets stop this here as it has pretty much nothing to do with dovecot... -- Regards, Stephan From pruimj at gmail.com Tue Mar 15 02:50:14 2016 From: pruimj at gmail.com (Jason Pruim) Date: Mon, 14 Mar 2016 22:50:14 -0400 Subject: New dovecot user needs installation help Message-ID: Hey Everyone, So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? Here is the output of my dovecot -n: [ec2-user at ip-172-31-22-222 log]$ dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } ssl_cert = Can yoi run doveadm log errors too? ---Aki TuomiDovecot oy -------- Alkuper?inen viesti --------L?hett?j?: Jason Pruim P?iv?m??r?: 15.3.2016 4.50 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: New dovecot user needs installation help Hey Everyone, So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? Here is the output of my dovecot -n: [ec2-user at ip-172-31-22-222 log]$ dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64? mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { ? driver = pam } ssl_cert = References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 14 Mar 2016, Jason Pruim wrote: > So I just setup my first dovecot install with postfix running for the > mail server? I can telnet into my dovecot install and login just fine what does "telnet into my dovecot install" mean exacly? Did you've read: http://wiki2.dovecot.org/TestInstallation > with my user locally? But when I try to add the account from my phone, > computer, or telnetting from my local computer, it just hangs and > eventually kicks back a generic error saying it can?t be added? Where > can I start looking? I?m hosted with amazon web services and I?m waiting > on them to approve my request to white list my IP on my instance, but > that should only restrict my ability to send email out on port 25? I > should still be able to operate locally? > > > According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) > > I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? > > Here is the output of my dovecot -n: > > [ec2-user at ip-172-31-22-222 log]$ dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mbox_write_locks = fcntl > passdb { > driver = pam > } > ssl_cert = ssl_key = userdb { > driver = passwd > } > [ec2-user at ip-172-31-22-222 log]$ > > > > > Let me know if there is anything else you need, or where to go from here! > > Thanks in advance! > > Jason Pruim > pruimj at gmail.com > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVue4MHz1H7kL/d9rAQJ/8AgAgyDbtTpEbzm7ZFQNQsIhVm2ofEewc9mt Gplv/Wl46scIfF6tl5NvruoAu3ogQDMoMNnlpZ9cMTWhOrBxXhL3usBRhgB6MnaD nEuTStYXLCgKS90DLZB0xWvzbhAhqLNu9ohbjW7Al4iWwvl2A4tSrgJAWwNLJsAi VpDQ9ha41zzu2ZqjH9J8PepVoQS47ZDauiGtPinTVQ8aMI40uLB1L5gFLfuVm0rM l/f0JsK/SYKPkE1j+yow61zpqOFnCbYOMlck526RGP7nJZIo0MLfCwt68j8C0TPh HxnRsL9jkvuufgB3zTvcdCYgHgODB0oP/AGtQPnXXo10HvsqdoBapA== =N+EP -----END PGP SIGNATURE----- From mail at tomsommer.dk Tue Mar 15 09:53:34 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Tue, 15 Mar 2016 10:53:34 +0100 Subject: lmtp timeout, locks and crashes Message-ID: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> I'm seeing some problems on accounts which get a lot of spam (like, a lot). I get these errors: Mar 15 10:43:49 lmtp(12390): Error: Timeout (29s) while waiting for lock for transaction log file /var/spool/mail/dovecot/xxxx/xxxx/dovecot.list.index.log (WRITE lock held by pid 12193) --- Mar 15 10:43:49 lmtp(12034): Error: Transaction log file /var/spool/mail/dovecot/xxxxx/xxxx/dovecot.list.index.log: marked corrupted --- Mar 15 10:43:49 lmtp(12391): Error: Transaction log /var/spool/mail/dovecot/xxxx/xxxx/dovecot.list.index.log: duplicate transaction log sequence (3) ---- Mar 15 10:43:59 lmtp(xxxx at xxxx.dk): Error: Timeout (29s) while waiting for lock for transaction log file /var/spool/mail/dovecot/xxxx/xxxx/dovecot.list.index.log ---- Mar 15 10:43:51 lmtp(12294): Panic: file mail-transaction-log-file.c: line 104 (mail_transaction_log_file_free): assertion failed: (!file->locked) Mar 15 10:43:51 lmtp(12294): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x30d567e07a] -> /usr/lib/dovecot/libdovecot.so.0 [0x30d567e0e6] -> /usr/lib/dovecot/libdovecot.so.0 [0x30d567d4ac] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x30d5299ca7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_logs_clean+0x28) [0x30d529b698] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_view_close+0x49) [0x30d529a7e9] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x30d5293c03] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh_later+0x92) [0x30d525af62] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x30d52589eb] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x30d5259217] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x54) [0x30d52352c4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0x16) [0x30d5235386] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_autoexpunge+0x1f8) [0x30d522a9b8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_unref+0x2a) [0x30d523a16a] -> dovecot/lmtp [DATA 172.17.165.14] [0x40696b] -> dovecot/lmtp [DATA 172.17.165.14] [0x406bd6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x49) [0x30d5690579] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc) [0x30d5691c3c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa9) [0x30d56906b9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x30d56909e8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x30d562e533] -> dovecot/lmtp [DATA 172.17.165.14](main+0x15c) [0x404c8c] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x36aea1d9f4] -> dovecot/lmtp [DATA 172.17.165.14] [0x404a79] ---- The data is stored on NFS, with single-node access. mmap_disable is set to 'yes' Anyone know how to solve this? or can share some insights. Running dovecot 2.2.21 (5345f22) -- Tom Sommer From aki.tuomi at dovecot.fi Tue Mar 15 09:59:19 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Tue, 15 Mar 2016 11:59:19 +0200 Subject: lmtp timeout, locks and crashes In-Reply-To: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> Message-ID: <56E7DCF7.2030506@dovecot.fi> On 15.03.2016 11:53, Tom Sommer wrote: > I'm seeing some problems on accounts which get a lot of spam (like, a > lot). > > I get these errors: > > Mar 15 10:43:49 lmtp(12390): Error: Timeout (29s) while waiting for > lock for transaction log file > /var/spool/mail/dovecot/xxxx/xxxx/dovecot.list.index.log (WRITE lock > held by pid 12193) > > --- > > Mar 15 10:43:49 lmtp(12034): Error: Transaction log file > /var/spool/mail/dovecot/xxxxx/xxxx/dovecot.list.index.log: marked > corrupted > > --- > > Mar 15 10:43:49 lmtp(12391): Error: Transaction log > /var/spool/mail/dovecot/xxxx/xxxx/dovecot.list.index.log: duplicate > transaction log sequence (3) > > ---- > > Mar 15 10:43:59 lmtp(xxxx at xxxx.dk): Error: Timeout (29s) while waiting > for lock for transaction log file > /var/spool/mail/dovecot/xxxx/xxxx/dovecot.list.index.log > > ---- > > Mar 15 10:43:51 lmtp(12294): Panic: file mail-transaction-log-file.c: > line 104 (mail_transaction_log_file_free): assertion failed: > (!file->locked) > Mar 15 10:43:51 lmtp(12294): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0 [0x30d567e07a] -> > /usr/lib/dovecot/libdovecot.so.0 [0x30d567e0e6] -> > /usr/lib/dovecot/libdovecot.so.0 [0x30d567d4ac] -> > /usr/lib/dovecot/libdovecot-storage.so.0 [0x30d5299ca7] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_logs_clean+0x28) > [0x30d529b698] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_view_close+0x49) > [0x30d529a7e9] -> /usr/lib/dovecot/libdovecot-storage.so.0 > [0x30d5293c03] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh_later+0x92) > [0x30d525af62] -> /usr/lib/dovecot/libdovecot-storage.so.0 > [0x30d52589eb] -> /usr/lib/dovecot/libdovecot-storage.so.0 > [0x30d5259217] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x54) > [0x30d52352c4] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0x16) > [0x30d5235386] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_autoexpunge+0x1f8) > [0x30d522a9b8] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_unref+0x2a) > [0x30d523a16a] -> dovecot/lmtp [DATA 172.17.165.14] [0x40696b] -> > dovecot/lmtp [DATA 172.17.165.14] [0x406bd6] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x49) [0x30d5690579] > -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc) > [0x30d5691c3c] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa9) > [0x30d56906b9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) > [0x30d56909e8] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x30d562e533] -> dovecot/lmtp [DATA 172.17.165.14](main+0x15c) > [0x404c8c] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x36aea1d9f4] > -> dovecot/lmtp [DATA 172.17.165.14] [0x404a79] > > ---- > > The data is stored on NFS, with single-node access. > > mmap_disable is set to 'yes' > > Anyone know how to solve this? or can share some insights. > > Running dovecot 2.2.21 (5345f22) > Hi! Can you please send output of doveconf -n? --- Aki Tuomi Dovecot Oy From giom87 at libero.it Tue Mar 15 10:00:26 2016 From: giom87 at libero.it (Giovanni Mancuso) Date: Tue, 15 Mar 2016 11:00:26 +0100 Subject: dsync and ProxyAUTH Message-ID: <56E7DD3A.9080100@libero.it> Hi, can i use dync to migrate a mailboxes through PROX-AUTH? Could It be an attractive feature for you? Thanks From mail at tomsommer.dk Tue Mar 15 10:28:05 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Tue, 15 Mar 2016 11:28:05 +0100 Subject: lmtp timeout, locks and crashes In-Reply-To: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> Message-ID: On 2016-03-15 10:53, Tom Sommer wrote: > I'm seeing some problems on accounts which get a lot of spam (like, a > lot). > > I get these errors: When I do a process-list I see a lot of stuck lmtp processes on the same account: 16180 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 xxx at xxx] 16181 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 xxx at xxx] x 600 // Tom From aki.tuomi at dovecot.fi Tue Mar 15 10:29:29 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Tue, 15 Mar 2016 12:29:29 +0200 Subject: lmtp timeout, locks and crashes In-Reply-To: References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> Message-ID: <56E7E409.9000707@dovecot.fi> On 15.03.2016 12:28, Tom Sommer wrote: > > On 2016-03-15 10:53, Tom Sommer wrote: >> I'm seeing some problems on accounts which get a lot of spam (like, a >> lot). >> >> I get these errors: > > When I do a process-list I see a lot of stuck lmtp processes on the > same account: > > 16180 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 xxx at xxx] > 16181 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 xxx at xxx] > > x 600 > > // Tom And you are sure this is not related to your NFS? Aki From teemu.huovila at dovecot.fi Tue Mar 15 10:58:09 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Tue, 15 Mar 2016 12:58:09 +0200 Subject: lmtp timeout, locks and crashes In-Reply-To: <56E7E409.9000707@dovecot.fi> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> <56E7E409.9000707@dovecot.fi> Message-ID: <56E7EAC1.8010308@dovecot.fi> On 15.03.2016 12:29, Aki Tuomi wrote: > > > On 15.03.2016 12:28, Tom Sommer wrote: >> >> On 2016-03-15 10:53, Tom Sommer wrote: >>> I'm seeing some problems on accounts which get a lot of spam (like, a lot). >>> >>> I get these errors: >> >> When I do a process-list I see a lot of stuck lmtp processes on the same account: >> >> 16180 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 xxx at xxx] >> 16181 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 xxx at xxx] >> >> x 600 >> >> // Tom > And you are sure this is not related to your NFS? As a workaround, you could also try different low settings for lmtp_user_concurrency_limit and see if it removes the lock contention, but keeps lmtp performance bearable. You do not have any external programs touching the maildir at the same time, right? br, Teemu Huovila From pruimj at gmail.com Tue Mar 15 11:06:43 2016 From: pruimj at gmail.com (Jason Pruim) Date: Tue, 15 Mar 2016 07:06:43 -0400 Subject: New dovecot user needs installation help In-Reply-To: References: Message-ID: Sent from my iPhone > On Mar 15, 2016, at 3:22 AM, Steffen Kaiser wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > >> On Mon, 14 Mar 2016, Jason Pruim wrote: >> >> So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine > > what does "telnet into my dovecot install" mean exacly? I used telnet to connect to port 143 and issued some smtp commands including logging into an account. > > Did you've read: > http://wiki2.dovecot.org/TestInstallation I did yes... But I will go back over it tonight when I get back home. > >> with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? >> >> >> According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) >> >> I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? >> >> Here is the output of my dovecot -n: >> >> [ec2-user at ip-172-31-22-222 log]$ dovecot -n >> # 2.0.9: /etc/dovecot/dovecot.conf >> # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 >> mail_location = mbox:~/mail:INBOX=/var/mail/%u >> mbox_write_locks = fcntl >> passdb { >> driver = pam >> } >> ssl_cert = > ssl_key = > userdb { >> driver = passwd >> } >> [ec2-user at ip-172-31-22-222 log]$ >> >> >> >> >> Let me know if there is anything else you need, or where to go from here! >> >> Thanks in advance! >> >> Jason Pruim >> pruimj at gmail.com > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVue4MHz1H7kL/d9rAQJ/8AgAgyDbtTpEbzm7ZFQNQsIhVm2ofEewc9mt > Gplv/Wl46scIfF6tl5NvruoAu3ogQDMoMNnlpZ9cMTWhOrBxXhL3usBRhgB6MnaD > nEuTStYXLCgKS90DLZB0xWvzbhAhqLNu9ohbjW7Al4iWwvl2A4tSrgJAWwNLJsAi > VpDQ9ha41zzu2ZqjH9J8PepVoQS47ZDauiGtPinTVQ8aMI40uLB1L5gFLfuVm0rM > l/f0JsK/SYKPkE1j+yow61zpqOFnCbYOMlck526RGP7nJZIo0MLfCwt68j8C0TPh > HxnRsL9jkvuufgB3zTvcdCYgHgODB0oP/AGtQPnXXo10HvsqdoBapA== > =N+EP > -----END PGP SIGNATURE----- Thanks for taking the time to look! From mail at tomsommer.dk Tue Mar 15 11:31:00 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Tue, 15 Mar 2016 12:31:00 +0100 Subject: lmtp timeout, locks and crashes In-Reply-To: <56E7E409.9000707@dovecot.fi> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> <56E7E409.9000707@dovecot.fi> Message-ID: <5628ab192eebeb4e1fc79c0574692d04@tomsommer.dk> On 2016-03-15 11:29, Aki Tuomi wrote: > On 15.03.2016 12:28, Tom Sommer wrote: >> >> On 2016-03-15 10:53, Tom Sommer wrote: >>> I'm seeing some problems on accounts which get a lot of spam (like, a >>> lot). >>> >>> I get these errors: >> >> When I do a process-list I see a lot of stuck lmtp processes on the >> same account: >> >> 16180 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 >> xxx at xxx] >> 16181 ? D 0:00 \_ dovecot/lmtp [DATA 172.17.165.14 >> xxx at xxx] >> >> x 600 >> >> // Tom > And you are sure this is not related to your NFS? I think I solved it with lock_method = dotlock Sorry for the noise and thanks for the quick reply. // Tom From skdovecot at smail.inf.fh-brs.de Tue Mar 15 12:21:54 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 15 Mar 2016 13:21:54 +0100 (CET) Subject: New dovecot user needs installation help In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 15 Mar 2016, Jason Pruim wrote: >> On Mar 15, 2016, at 3:22 AM, Steffen Kaiser wrote: >> >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >>> On Mon, 14 Mar 2016, Jason Pruim wrote: >>> >>> So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine >> >> what does "telnet into my dovecot install" mean exacly? > > I used telnet to connect to port 143 and issued some smtp commands including logging into an account. I issued SMTP commands on port 143 ? >> >> Did you've read: >> http://wiki2.dovecot.org/TestInstallation > > I did yes... But I will go back over it tonight when I get back home. >> >>> with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? >>> >>> >>> According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) >>> >>> I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? >>> >>> Here is the output of my dovecot -n: >>> >>> [ec2-user at ip-172-31-22-222 log]$ dovecot -n >>> # 2.0.9: /etc/dovecot/dovecot.conf >>> # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 >>> mail_location = mbox:~/mail:INBOX=/var/mail/%u >>> mbox_write_locks = fcntl >>> passdb { >>> driver = pam >>> } >>> ssl_cert = >> ssl_key = >> userdb { >>> driver = passwd >>> } >>> [ec2-user at ip-172-31-22-222 log]$ - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVuf+Ynz1H7kL/d9rAQLCAQgAy/MZhOYJHjtIYK3L7149W7UiXtn50WBR 4bq9322YfcxtCWeGGsVdz5q/IM7Sz1WnQR5tFGd3LhaMb/g5FjOUzMGZiAaz3Qwu AcrC+VVYT1cDhXj/7IMRnKvWWH1l0caSU54rGiKrp5lWKOqmGDabxwYEKFnV8aRC Y3RXu+ZQSVaDjHxnwG8ydFGdRTjkJ5w4GndJG5xPJm6W+56QjEgXgerTeQkCx3vf mMHqg3BqJ5jWC1cVmnix3kMSpZvlJDRLmc/YIv7Ycvkic+QPisO27b5Wmmgb79GH OtOTiotR7thlO/ktP16OLuj8oGPVislBcXDfliyDYkLEg6koRbuZWg== =fu00 -----END PGP SIGNATURE----- From sergey.schwartz at bgoperator.com Tue Mar 15 12:41:30 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Tue, 15 Mar 2016 15:41:30 +0300 Subject: syncing mailboxes with dsync after switchover Message-ID: <56E802FA.7020707@bgoperator.com> Gents, I'm relocating mailboxes to a new server. Before switching over to a new server I ran syncing a few times without any issues first I sync files with rsync from the old server to have a local copy, then I sync mailboxes with dsync /usr/bin/doveadm -Dv sync -u $MBOX -R "sdbox:/srv/vmail/temp/srv/srv.bgoperator.ru/${MBOX}:DIRNAME=DbOx-mAiLs" After switching over smtp transport and running dsync as above a few mailboxes were deleted dsync(xxx): Warning: Deleting mailbox 'INBOX': UID=1 already exists locally for a different mail: GUIDs don't match (c005a206e1c6e756f02700003a8929e2 vs 0ba1c03796f5dc524c6d0000b4ca29ec) dsync(xxxx): Warning: Deleting mailbox 'INBOX': UID=8855 GUID=80d5841f0fe2e35677630000b4ca29ec is missing locally dsync(xxxxx): Warning: Deleting mailbox 'INBOX': UID=7508 already exists locally for a different mail: GUIDs don't match (1e03d72074d8e756403700003a8929e2 vs 1dc47a3ac5c4e7562a290000b4ca29ec) dsync(xxxxxx): Warning: Deleting mailbox 'INBOX': UID=8238 GUID=2a6a803bd33fe156f85e0000b4ca29ec is missing locally and a few other mailboxes seemed to fail to sync dsync(xxxxxxx): Warning: Mailbox changes caused a desync. You may want to run dsync again. Is it a bug or I am doing something wrong ? -- Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com From andrew.mcglashan at affinityvision.com.au Tue Mar 15 13:05:23 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Wed, 16 Mar 2016 00:05:23 +1100 Subject: dovecot wiki... Message-ID: <56E80893.20401@affinityvision.com.au> Hi, Just want to know if this is a problem at my end (in my browser), or if it is something else. When I copy text from the wiki, the page changes to an edit one; that is very, very annoying. How can I stop this if it is normal dovecot wiki behaviour and what do you think I might look at in my browser if it isn't? I'm never likely to want to edit the wiki any time soon. Thanks AndrewM From lists+dovecot at nospam.webmeneer.net Tue Mar 15 13:09:26 2016 From: lists+dovecot at nospam.webmeneer.net (bOnK) Date: Tue, 15 Mar 2016 14:09:26 +0100 Subject: dovecot wiki... In-Reply-To: <56E80893.20401@affinityvision.com.au> References: <56E80893.20401@affinityvision.com.au> Message-ID: <56E80986.9050901@nospam.webmeneer.net> On 15-3-2016 14:05, Andrew McGlashan wrote: > How can I stop this if it is normal dovecot wiki Turn of JavaScript. -- bOnK From lists at merit.unu.edu Tue Mar 15 13:20:27 2016 From: lists at merit.unu.edu (lists) Date: Tue, 15 Mar 2016 14:20:27 +0100 Subject: dovecot wiki... In-Reply-To: <56E80893.20401@affinityvision.com.au> References: <56E80893.20401@affinityvision.com.au> Message-ID: <56E80C1B.8080605@merit.unu.edu> On 15-3-2016 14:05, Andrew McGlashan wrote: > Hi, > > Just want to know if this is a problem at my end (in my browser), or if > it is something else. > > When I copy text from the wiki, the page changes to an edit one; that is > very, very annoying. How can I stop this if it is normal dovecot wiki > behaviour and what do you think I might look at in my browser if it isn't? > > I'm never likely to want to edit the wiki any time soon. Strange. Tried firefox and chrome on windows, but I can select and copy. It's when I double-click that it changes to edit-mode. MJ From andrew.mcglashan at affinityvision.com.au Tue Mar 15 13:50:52 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Wed, 16 Mar 2016 00:50:52 +1100 Subject: dovecot wiki... In-Reply-To: <56E80986.9050901@nospam.webmeneer.net> References: <56E80893.20401@affinityvision.com.au> <56E80986.9050901@nospam.webmeneer.net> Message-ID: <56E8133C.2000906@affinityvision.com.au> On 16/03/2016 12:09 AM, bOnK wrote: > On 15-3-2016 14:05, Andrew McGlashan wrote: >> How can I stop this if it is normal dovecot wiki > > Turn of JavaScript. Thanks, I use policeman to control what web pages can do, scripts turned off. Gave up on noscript a good while ago, for various reasons. Much prefer policeman controls on my web. Cheers AndrewM From goetz.reinicke at filmakademie.de Tue Mar 15 15:01:32 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Tue, 15 Mar 2016 16:01:32 +0100 Subject: overview zlib efficiency? Message-ID: <56E823CC.8070005@filmakademie.de> Hi, may be someone has already done that: Do you have a script(?) tool which shows the efficiency of the mail compression if zlib is used? Something that shows the uncompressed size vrs. the compressed. Thanks for hints! /G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From sergey.schwartz at bgoperator.com Tue Mar 15 15:04:43 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Tue, 15 Mar 2016 18:04:43 +0300 Subject: syncing mailboxes with dsync after switchover In-Reply-To: <56E802FA.7020707@bgoperator.com> References: <56E802FA.7020707@bgoperator.com> Message-ID: <56E8248B.6010709@bgoperator.com> Gentlemen, I guess my mistake was to use *-R* option, that works similar to *-1* and your messages can get lost. -R Do a reverse sync. Normally, messages would be pushed from the local system to the destination (remote). This option reverses the flow, and will instead pull messages from the remote to the local storage. doesn't say clearly that it works like a backup mode and data can be lost Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com 15.03.2016 15:41, Sergey Schwartz ?????: > Gents, > > I'm relocating mailboxes to a new server. > Before switching over to a new server I ran syncing a few times > without any issues > > first I sync files with rsync from the old server to have a local > copy, then I sync mailboxes with dsync > > /usr/bin/doveadm -Dv sync -u $MBOX -R > "sdbox:/srv/vmail/temp/srv/srv.bgoperator.ru/${MBOX}:DIRNAME=DbOx-mAiLs" > > > After switching over smtp transport and running dsync as above a few > mailboxes were deleted > > dsync(xxx): Warning: Deleting mailbox 'INBOX': UID=1 already exists > locally for a different mail: GUIDs don't match > (c005a206e1c6e756f02700003a8929e2 vs 0ba1c03796f5dc524c6d0000b4ca29ec) > dsync(xxxx): Warning: Deleting mailbox 'INBOX': UID=8855 > GUID=80d5841f0fe2e35677630000b4ca29ec is missing locally > dsync(xxxxx): Warning: Deleting mailbox 'INBOX': UID=7508 already > exists locally for a different mail: GUIDs don't match > (1e03d72074d8e756403700003a8929e2 vs 1dc47a3ac5c4e7562a290000b4ca29ec) > dsync(xxxxxx): Warning: Deleting mailbox 'INBOX': UID=8238 > GUID=2a6a803bd33fe156f85e0000b4ca29ec is missing locally > > and a few other mailboxes seemed to fail to sync > > dsync(xxxxxxx): Warning: Mailbox changes caused a desync. You may want > to run dsync again. > > > Is it a bug or I am doing something wrong ? > From leolistas at solutti.com.br Tue Mar 15 16:51:35 2016 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 15 Mar 2016 13:51:35 -0300 Subject: overview zlib efficiency? In-Reply-To: <56E823CC.8070005@filmakademie.de> References: <56E823CC.8070005@filmakademie.de> Message-ID: <56E83D97.8030306@solutti.com.br> Em 15/03/16 12:01, G?tz Reinicke - IT Koordinator escreveu: > Hi, > > may be someone has already done that: Do you have a script(?) tool which > shows the efficiency of the mail compression if zlib is used? > > Something that shows the uncompressed size vrs. the compressed. > While i dont have the data you're looking for, i do have lots of servers running with zlib enabled and, if someone makes the script, i can run on some servers and provide the results ! -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From sven at svenhartge.de Tue Mar 15 17:13:59 2016 From: sven at svenhartge.de (Sven Hartge) Date: Tue, 15 Mar 2016 18:13:59 +0100 Subject: overview zlib efficiency? References: <56E823CC.8070005@filmakademie.de> Message-ID: <4cdc4mausqv8@mids.svenhartge.de> G?tz Reinicke - IT Koordinator wrote: > may be someone has already done that: Do you have a script(?) tool > which shows the efficiency of the mail compression if zlib is used? > Something that shows the uncompressed size vrs. the compressed. I don't have a script, but I can provide some numbers. I did a test with a server for about 10.000 users and 2TB worth of mail, converting from Maildir++ to mdbox with zlib (level = 6) and had a final size of 1TB, so 2:1 reduction. Gr??e, Sven. -- Sigmentation fault. Core dumped. From andrew.mcglashan at affinityvision.com.au Tue Mar 15 18:13:33 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Wed, 16 Mar 2016 05:13:33 +1100 Subject: overview zlib efficiency? In-Reply-To: <56E823CC.8070005@filmakademie.de> References: <56E823CC.8070005@filmakademie.de> Message-ID: <56E850CD.5070509@affinityvision.com.au> On 16/03/2016 2:01 AM, G?tz Reinicke - IT Koordinator wrote: > Hi, > > may be someone has already done that: Do you have a script(?) tool which > shows the efficiency of the mail compression if zlib is used? > > Something that shows the uncompressed size vrs. the compressed. Remember one thing; emails are stored in plain text, the same text that they are normally transmitted b/w servers. With that in mind, text, particularly with repeating and common things like headers (and other things), then you should get significant reduction in size. The exception of the size benefits (storage), is when you have emails that are less than the file system block size (4k ext4 perhaps). So many emails are smaller than a block size and for those, zipping is not much benefit as it won't make a scrap of difference to storage. However, when you have users that send attachments and sometimes very large attachments, well, it will save loads of storage on those emails. Next, if you have a CPU bottleneck, then the extra overhead of compression may also be an issue; but unless your server is working hard, compression isn't likely to tax the CPU a great deal. Cheers Andrewm -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 195 bytes Desc: OpenPGP digital signature URL: From lists at tigertech.com Tue Mar 15 18:41:29 2016 From: lists at tigertech.com (Robert L Mathews) Date: Tue, 15 Mar 2016 11:41:29 -0700 Subject: overview zlib efficiency? In-Reply-To: <4cdc4mausqv8@mids.svenhartge.de> References: <56E823CC.8070005@filmakademie.de> <4cdc4mausqv8@mids.svenhartge.de> Message-ID: <56E85759.5090600@tigertech.com> On 3/15/16 10:13 AM, Sven Hartge wrote: > I don't have a script, but I can provide some numbers. I did a test with > a server for about 10.000 users and 2TB worth of mail, converting from > Maildir++ to mdbox with zlib (level = 6) and had a final size of 1TB, so > 2:1 reduction. These numbers roughly match my results. About 6 TB of mail compresses down to about 3 TB. The difference in ongoing CPU use for compression "on the fly" of newly arriving mail, and decompression of mail from the disk, is unnoticeable on my servers. Also keep in mind that even if it does increase CPU usage, it reduces disk usage. This is probably an excellent tradeoff for most people, since most servers are limited by disk throughput/latency more than CPU power. -- Robert L Mathews, Tiger Technologies, http://www.tigertech.net/ From rick at havokmon.com Tue Mar 15 18:49:11 2016 From: rick at havokmon.com (Rick Romero) Date: Tue, 15 Mar 2016 13:49:11 -0500 Subject: overview zlib efficiency? In-Reply-To: <56E85759.5090600@tigertech.com> References: <56E823CC.8070005@filmakademie.de> <4cdc4mausqv8@mids.svenhartge.de> <56E85759.5090600@tigertech.com> Message-ID: <20160315134911.Horde.eMzVbToJGwPBm1x1AzBSow5@www.vfemail.net> Quoting Robert L Mathews : > On 3/15/16 10:13 AM, Sven Hartge wrote: > >> I don't have a script, but I can provide some numbers. I did a test with >> a server for about 10.000 users and 2TB worth of mail, converting from >> Maildir++ to mdbox with zlib (level = 6) and had a final size of 1TB, so >> 2:1 reduction. > > These numbers roughly match my results. About 6 TB of mail compresses > down to about 3 TB. > > Also keep in mind that even if it does increase CPU usage, it reduces > disk usage. This is probably an excellent tradeoff for most people, > since most servers are limited by disk throughput/latency more than CPU > power. Just thought I'd add, because it frustrated me and it's an amusing anecdote to this - The new 4k ashift doubled my disk usage of Maildir++ mail. So logically, if you're migrating from maildir++ to mdbox on 4k sector system, you may see a sizable decrease in disk usage without a compression change. Rick From rick at havokmon.com Tue Mar 15 18:55:11 2016 From: rick at havokmon.com (Rick Romero) Date: Tue, 15 Mar 2016 13:55:11 -0500 Subject: overview zlib efficiency? In-Reply-To: <20160315134911.Horde.eMzVbToJGwPBm1x1AzBSow5@www.vfemail.net> References: <56E823CC.8070005@filmakademie.de> <4cdc4mausqv8@mids.svenhartge.de> <56E85759.5090600@tigertech.com> <20160315134911.Horde.eMzVbToJGwPBm1x1AzBSow5@www.vfemail.net> Message-ID: <20160315135511.Horde.QnzjvCO_NUDxVGTw0y_Epw9@www.vfemail.net> Quoting Rick Romero : > Quoting Robert L Mathews : > >> On 3/15/16 10:13 AM, Sven Hartge wrote: >> >>> I don't have a script, but I can provide some numbers. I did a test with >>> a server for about 10.000 users and 2TB worth of mail, converting from >>> Maildir++ to mdbox with zlib (level = 6) and had a final size of 1TB, so >>> 2:1 reduction. >> >> These numbers roughly match my results. About 6 TB of mail compresses >> down to about 3 TB. >> >> Also keep in mind that even if it does increase CPU usage, it reduces >> disk usage. This is probably an excellent tradeoff for most people, >> since most servers are limited by disk throughput/latency more than CPU >> power. > > Just thought I'd add, because it frustrated me and it's an amusing > anecdote > to this - The new 4k ashift doubled my disk usage of Maildir++ mail. > > So logically, if you're migrating from maildir++ to mdbox on 4k sector > system, you may see a sizable decrease in disk usage without a compression > change. > Rick With ZFS - Sorry - I dropped that in my edit. From sven at svenhartge.de Tue Mar 15 19:45:40 2016 From: sven at svenhartge.de (Sven Hartge) Date: Tue, 15 Mar 2016 20:45:40 +0100 Subject: overview zlib efficiency? References: <56E823CC.8070005@filmakademie.de> <4cdc4mausqv8@mids.svenhartge.de> <56E85759.5090600@tigertech.com> Message-ID: <5cdcdg8usqv8@mids.svenhartge.de> Robert L Mathews wrote: > Also keep in mind that even if it does increase CPU usage, it reduces > disk usage. This is probably an excellent tradeoff for most people, > since most servers are limited by disk throughput/latency more than > CPU power. IOPS are harder to scale (meaning: cost more to scale) than CPU power. And gzip (or lz4 of implemented someday) (or even blosc: http://www.blosc.org/. They claim "Designed to transmit data to the processor cache faster than a memcpy() OS call.") is effectively free with todays CPUs. Gr??e, Sven. -- Sigmentation fault. Core dumped. From pruimj at gmail.com Tue Mar 15 20:43:46 2016 From: pruimj at gmail.com (Jason Pruim) Date: Tue, 15 Mar 2016 16:43:46 -0400 Subject: New dovecot user needs installation help In-Reply-To: References: Message-ID: <8977A210-9017-41ED-AC6B-0A466BDA0CA4@gmail.com> This is all it?s showing me in the log: [ec2-user at ip-172-31-22-222 ~]$ sudo tail -f /var/log/maillog Mar 15 20:39:41 ip-172-31-22-222 dovecot: doveadm: Debug: This is Dovecot's debug log (1458074381) Mar 15 20:39:41 ip-172-31-22-222 dovecot: doveadm: This is Dovecot's info log (1458074381) Mar 15 20:39:41 ip-172-31-22-222 dovecot: doveadm: Warning: This is Dovecot's warning log (1458074381) Mar 15 20:39:41 ip-172-31-22-222 dovecot: doveadm: Error: This is Dovecot's error log (1458074381) Mar 15 20:39:41 ip-172-31-22-222 dovecot: doveadm: Fatal: This is Dovecot's fatal log (1458074381) Mar 15 20:39:50 ip-172-31-22-222 dovecot: doveadm: Debug: This is Dovecot's debug log (1458074390) Mar 15 20:39:50 ip-172-31-22-222 dovecot: doveadm: This is Dovecot's info log (1458074390) Mar 15 20:39:50 ip-172-31-22-222 dovecot: doveadm: Warning: This is Dovecot's warning log (1458074390) Mar 15 20:39:50 ip-172-31-22-222 dovecot: doveadm: Error: This is Dovecot's error log (1458074390) Mar 15 20:39:50 ip-172-31-22-222 dovecot: doveadm: Fatal: This is Dovecot's fatal log (1458074390) Mar 15 20:41:53 ip-172-31-22-222 dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=1561, secured I just logged in and ran the commands. you can see my login, but it?s not logging any errors? Although it won?t let me select my inbox on that user? Jason Pruim pruimj at gmail.com 352.234.3175 > On Mar 15, 2016, at 1:06 AM, Aki Tuomi wrote: > > Can yoi run doveadm log errors too? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Alkuper?inen viesti -------- > L?hett?j?: Jason Pruim > P?iv?m??r?: 15.3.2016 4.50 (GMT+02:00) > Saaja: dovecot at dovecot.org > Aihe: New dovecot user needs installation help > > Hey Everyone, > > So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? > > > According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) > > I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? > > Here is the output of my dovecot -n: > > [ec2-user at ip-172-31-22-222 log]$ dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mbox_write_locks = fcntl > passdb { > driver = pam > } > ssl_cert = ssl_key = userdb { > driver = passwd > } > [ec2-user at ip-172-31-22-222 log]$ > > > > > Let me know if there is anything else you need, or where to go from here! > > Thanks in advance! > > Jason Pruim > pruimj at gmail.com From pruimj at gmail.com Tue Mar 15 20:44:42 2016 From: pruimj at gmail.com (Jason Pruim) Date: Tue, 15 Mar 2016 16:44:42 -0400 Subject: New dovecot user needs installation help In-Reply-To: References: Message-ID: <5578845F-7B3F-48F8-A441-908B671FDDF4@gmail.com> Jason Pruim pruimj at gmail.com 352.234.3175 > On Mar 15, 2016, at 8:21 AM, Steffen Kaiser wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 15 Mar 2016, Jason Pruim wrote: >>> On Mar 15, 2016, at 3:22 AM, Steffen Kaiser wrote: >>> >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>>> On Mon, 14 Mar 2016, Jason Pruim wrote: >>>> >>>> So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine >>> >>> what does "telnet into my dovecot install" mean exacly? >> >> I used telnet to connect to port 143 and issued some smtp commands including logging into an account. > > I issued SMTP commands on port 143 ? telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. a login "beth" "beth4338" a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in select inbox select BAD Error in IMAP command INBOX: Unknown command. > >>> >>> Did you've read: >>> http://wiki2.dovecot.org/TestInstallation >> >> I did yes... But I will go back over it tonight when I get back home. >>> >>>> with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? >>>> >>>> >>>> According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) >>>> >>>> I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? >>>> >>>> Here is the output of my dovecot -n: >>>> >>>> [ec2-user at ip-172-31-22-222 log]$ dovecot -n >>>> # 2.0.9: /etc/dovecot/dovecot.conf >>>> # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 >>>> mail_location = mbox:~/mail:INBOX=/var/mail/%u >>>> mbox_write_locks = fcntl >>>> passdb { >>>> driver = pam >>>> } >>>> ssl_cert = >>> ssl_key = >>> userdb { >>>> driver = passwd >>>> } >>>> [ec2-user at ip-172-31-22-222 log]$ > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVuf+Ynz1H7kL/d9rAQLCAQgAy/MZhOYJHjtIYK3L7149W7UiXtn50WBR > 4bq9322YfcxtCWeGGsVdz5q/IM7Sz1WnQR5tFGd3LhaMb/g5FjOUzMGZiAaz3Qwu > AcrC+VVYT1cDhXj/7IMRnKvWWH1l0caSU54rGiKrp5lWKOqmGDabxwYEKFnV8aRC > Y3RXu+ZQSVaDjHxnwG8ydFGdRTjkJ5w4GndJG5xPJm6W+56QjEgXgerTeQkCx3vf > mMHqg3BqJ5jWC1cVmnix3kMSpZvlJDRLmc/YIv7Ycvkic+QPisO27b5Wmmgb79GH > OtOTiotR7thlO/ktP16OLuj8oGPVislBcXDfliyDYkLEg6koRbuZWg== > =fu00 > -----END PGP SIGNATURE----- From micah at riseup.net Tue Mar 15 22:07:19 2016 From: micah at riseup.net (micah) Date: Tue, 15 Mar 2016 18:07:19 -0400 Subject: overview zlib efficiency? In-Reply-To: <56E850CD.5070509@affinityvision.com.au> References: <56E823CC.8070005@filmakademie.de> <56E850CD.5070509@affinityvision.com.au> Message-ID: <8737rrtmy0.fsf@riseup.net> Andrew McGlashan writes: > On 16/03/2016 2:01 AM, G?tz Reinicke - IT Koordinator wrote: >> Hi, >> >> may be someone has already done that: Do you have a script(?) tool which >> shows the efficiency of the mail compression if zlib is used? >> >> Something that shows the uncompressed size vrs. the compressed. > > Remember one thing; emails are stored in plain text, the same text that > they are normally transmitted b/w servers. Emails are not stored in plaintext if you are using dbox/mdbox. From djk at tobit.co.uk Tue Mar 15 22:34:16 2016 From: djk at tobit.co.uk (Dirk Koopman) Date: Tue, 15 Mar 2016 22:34:16 +0000 Subject: overview zlib efficiency? In-Reply-To: <8737rrtmy0.fsf@riseup.net> References: <56E823CC.8070005@filmakademie.de> <56E850CD.5070509@affinityvision.com.au> <8737rrtmy0.fsf@riseup.net> Message-ID: <56E88DE8.8080406@tobit.co.uk> On 15/03/16 22:07, micah wrote: > Andrew McGlashan writes: > >> On 16/03/2016 2:01 AM, G?tz Reinicke - IT Koordinator wrote: >>> Hi, >>> >>> may be someone has already done that: Do you have a script(?) tool which >>> shows the efficiency of the mail compression if zlib is used? >>> >>> Something that shows the uncompressed size vrs. the compressed. >> Remember one thing; emails are stored in plain text, the same text that >> they are normally transmitted b/w servers. > Emails are not stored in plaintext if you are using dbox/mdbox. They are on my machine. The fact that (m)dbox puts some "binary" records around those emails doesn't stop the files being (human) readable and the text extractable. From andrew.mcglashan at affinityvision.com.au Tue Mar 15 23:06:16 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Wed, 16 Mar 2016 10:06:16 +1100 Subject: overview zlib efficiency? In-Reply-To: <8737rrtmy0.fsf@riseup.net> References: <56E823CC.8070005@filmakademie.de> <56E850CD.5070509@affinityvision.com.au> <8737rrtmy0.fsf@riseup.net> Message-ID: <56E89568.5040703@affinityvision.com.au> On 16/03/2016 9:07 AM, micah wrote: > Andrew McGlashan writes: > >> On 16/03/2016 2:01 AM, G?tz Reinicke - IT Koordinator wrote: >>> Hi, >>> >>> may be someone has already done that: Do you have a script(?) tool which >>> shows the efficiency of the mail compression if zlib is used? >>> >>> Something that shows the uncompressed size vrs. the compressed. >> >> Remember one thing; emails are stored in plain text, the same text that >> they are normally transmitted b/w servers. > > Emails are not stored in plaintext if you are using dbox/mdbox. I think it is the best way to store them in pure form. A. From tss at iki.fi Wed Mar 16 05:37:25 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 16 Mar 2016 16:37:25 +1100 Subject: syncing mailboxes with dsync after switchover In-Reply-To: <56E8248B.6010709@bgoperator.com> References: <56E802FA.7020707@bgoperator.com> <56E8248B.6010709@bgoperator.com> Message-ID: <059222AE-FDB3-4806-9D08-56F4420DD521@iki.fi> > On 16 Mar 2016, at 02:04, Sergey Schwartz wrote: > > Gentlemen, > > I guess my mistake was to use *-R* option, that works similar to *-1* and your messages can get lost. > > -R Do a reverse sync. Normally, messages would be pushed from the local system to the destination (remote). This option reverses the flow, and will > instead pull messages from the remote to the local storage. > > doesn't say clearly that it works like a backup mode and data can be lost Oh, that really shouldn't have been even allowed. Fixed: https://github.com/dovecot/core/commit/7a3b52b8f9c6261ea912d9c96b20d815f782be5b From tss at iki.fi Wed Mar 16 05:58:49 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 16 Mar 2016 16:58:49 +1100 Subject: Reappearing emails - IMAP trace In-Reply-To: <56DF0478.4060709@Cleven.com> References: <56DF0478.4060709@Cleven.com> Message-ID: <4C26CC22-7C7D-4D91-A767-4E5B3D1F12BA@iki.fi> On 09 Mar 2016, at 03:57, Ron Cleven wrote: > > A few days back, I sent an overview of this problem, but received no responses. Since then, I have run dozens of traces to isolate the problem, difficult because there are timing issues involved. I have finally nailed it down. If this is not the proper place to report such bugs or if someone knows that this bug has been fixed, please let me know. As I noted in my earlier post, we have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. > > Recently we received a report that emails could reappear in the INBOX after being deleted. After running a pile of traces, I determined that the problem was strangely related to replications. For the purposes of this discussion, I will refer to the two symmetric replicating servers as A and B. Further, let us assume that during "normal" operation, all the emails are delivered to A via SMTP and are replicated to B. Under those assumptions, if the IMAP user connects to A (where the messages were originally delivered), there is no problem, at least no problem I was able to find. The problem I am describing only arises if the IMAP user connects to B. Connecting to B has never presented any other problems that I am aware of. > > The test for which I have provided the trace starts with a test mailbox containing only 3 unread messages in the INBOX. Moving 1 of the unread messages to Trash is all that is needed to reproduce the problem. Remember this is ONLY a problem if the IMAP sessions do not connect to the server to which the messages were originally delivered. Also, I found that there is a timing window. The critical IMAP commands are: > > UID STORE xxx +FLAGS.SILENT (\Seen) > UID MOVE xxx Trash > > If you introduce a large enough delay (I arbitrarily chose 5 seconds) between those two commands, there is no problem. Presumably this has to do with the two boxes syncing up some critical data structure. What mailbox format do you use? Are you able to reproduce this by running doveadm sync commands manually instead of letting replication do it? For example: - doveadm sync -s "" -d -u user at domain > state - Run the UID STORE & UID MOVE - doveadm sync -s "`cat state`" -d -u user at domain There have been some fixes, especially recently https://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 sounds a bit similar although I don't really see how it would apply here. Would be a good idea to try anyway with v2.2.22.rc1 (which seems to be stable enough that I'll make v2.2.22 release soon). Anyway, I attempted a few times to reproduce it with your test but wasn't able to. From tss at iki.fi Wed Mar 16 06:15:55 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 16 Mar 2016 17:15:55 +1100 Subject: dsync and ProxyAUTH In-Reply-To: <56E7DD3A.9080100@libero.it> References: <56E7DD3A.9080100@libero.it> Message-ID: On 15 Mar 2016, at 21:00, Giovanni Mancuso wrote: > > Hi, > > can i use dync to migrate a mailboxes through PROX-AUTH? > > Could It be an attractive feature for you? Do you mean the Sun/Oracle/whatever server's PROXYAUTH command? Already done: https://github.com/dovecot/core/commit/bd06c77a12bb02871b25dceb749fa955f4a272ff From skdovecot at smail.inf.fh-brs.de Wed Mar 16 06:45:32 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 16 Mar 2016 07:45:32 +0100 (CET) Subject: New dovecot user needs installation help In-Reply-To: <5578845F-7B3F-48F8-A441-908B671FDDF4@gmail.com> References: <5578845F-7B3F-48F8-A441-908B671FDDF4@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 15 Mar 2016, Jason Pruim wrote: >> On Mar 15, 2016, at 8:21 AM, Steffen Kaiser wrote: >> >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Tue, 15 Mar 2016, Jason Pruim wrote: >>>> On Mar 15, 2016, at 3:22 AM, Steffen Kaiser wrote: >>>> >>>> -----BEGIN PGP SIGNED MESSAGE----- >>>> Hash: SHA1 >>>> >>>>> On Mon, 14 Mar 2016, Jason Pruim wrote: >>>>> >>>>> So I just setup my first dovecot install with postfix running for the mail server? I can telnet into my dovecot install and login just fine >>>> >>>> what does "telnet into my dovecot install" mean exacly? >>> >>> I used telnet to connect to port 143 and issued some smtp commands including logging into an account. >> >> I issued SMTP commands on port 143 ? > > telnet localhost 143 > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. > a login "beth" "beth4338" > a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in > select inbox > select BAD Error in IMAP command INBOX: Unknown command. add any word before the select, too, e.g.: a select inbox OK, it's working from inside, now: telnet external-IP 143 from the same host, to verify that Dovecot listens on the external interface, then try from outside ... >>>> Did you've read: >>>> http://wiki2.dovecot.org/TestInstallation >>> >>> I did yes... But I will go back over it tonight when I get back home. >>>> >>>>> with my user locally? But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can?t be added? Where can I start looking? I?m hosted with amazon web services and I?m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25? I should still be able to operate locally? >>>>> >>>>> >>>>> According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) >>>>> >>>>> I?m thinking it?s something easy, and I can handle pointers! I don?t necessarily need my hand held the entire way? At least not yet? >>>>> >>>>> Here is the output of my dovecot -n: >>>>> >>>>> [ec2-user at ip-172-31-22-222 log]$ dovecot -n >>>>> # 2.0.9: /etc/dovecot/dovecot.conf >>>>> # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 >>>>> mail_location = mbox:~/mail:INBOX=/var/mail/%u >>>>> mbox_write_locks = fcntl >>>>> passdb { >>>>> driver = pam >>>>> } >>>>> ssl_cert = >>>> ssl_key = >>>> userdb { >>>>> driver = passwd >>>>> } >>>>> [ec2-user at ip-172-31-22-222 log]$ >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1 >> >> iQEVAwUBVuf+Ynz1H7kL/d9rAQLCAQgAy/MZhOYJHjtIYK3L7149W7UiXtn50WBR >> 4bq9322YfcxtCWeGGsVdz5q/IM7Sz1WnQR5tFGd3LhaMb/g5FjOUzMGZiAaz3Qwu >> AcrC+VVYT1cDhXj/7IMRnKvWWH1l0caSU54rGiKrp5lWKOqmGDabxwYEKFnV8aRC >> Y3RXu+ZQSVaDjHxnwG8ydFGdRTjkJ5w4GndJG5xPJm6W+56QjEgXgerTeQkCx3vf >> mMHqg3BqJ5jWC1cVmnix3kMSpZvlJDRLmc/YIv7Ycvkic+QPisO27b5Wmmgb79GH >> OtOTiotR7thlO/ktP16OLuj8oGPVislBcXDfliyDYkLEg6koRbuZWg== >> =fu00 >> -----END PGP SIGNATURE----- > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVukBDXz1H7kL/d9rAQLUngf9EmUTTFxcRUcO73Ugr6h2dnZQghTSzezh WptjOCtMgA1FeOLnQ4bysOh7RYF7poo6Keg8fyDqNkn5rdGz7kHugiZWKx4u9yf7 AnZXQKIX9hSm6fRsTqAO+2RJ14VpDw4h0EP9CwNfDNf/e2EWyInCAf2klGCIGMh+ AktSg7DEjbZtkotflXjeJCBfFTpAAMfLtfVi72cwxn2LrvNUvxjnGO4sQz4Evgmk xLQXVtqqjdOP1HEmJIRB4pNEpl9aglbd385EHOOqXyDAe7A9t9oZ6/9K9IWO/HEY eLtvCpK02yUrDJzYIx5L9B/Nrpn5AOZ7yK4alawyGvdXGyOH88jiBA== =W1+W -----END PGP SIGNATURE----- From goetz.reinicke at filmakademie.de Wed Mar 16 07:50:33 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Wed, 16 Mar 2016 08:50:33 +0100 Subject: overview zlib efficiency? Summary and added note In-Reply-To: <56E823CC.8070005@filmakademie.de> References: <56E823CC.8070005@filmakademie.de> Message-ID: <56E91049.80104@filmakademie.de> Am 15.03.16 um 16:01 schrieb G?tz Reinicke - IT Koordinator: > Hi, > > may be someone has already done that: Do you have a script(?) tool which > shows the efficiency of the mail compression if zlib is used? > > Something that shows the uncompressed size vrs. the compressed. Hi, maybe my question was a bit misleading. But anyway thanks for your feedback regarding your experiences and compression rates. We already thought about the benefit of less IO and more CPU power, which is no concern. The mailboxes I checked also go with 40-60% compression rate. But what I was looking for was a tool or way to see what volume would be used if we where not using compression. e.g. "du -hs --without-zlib" Our management would like to see a graph one day which shows the volume uncompressed and compressed ... Adding zlib with mdbox or maildir - as we do it currently - is from my POV if you have the CPU power a MUST :) happy dovecoting - G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Wed Mar 16 08:27:56 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 16 Mar 2016 19:27:56 +1100 Subject: v2.2.22 released Message-ID: <20206AF5-247D-4DAF-9A41-0234A35DAAEA@iki.fi> http://dovecot.org/releases/2.2/dovecot-2.2.22.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.22.tar.gz.sig + Added doveadm HTTP API: See http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP + virtual plugin: Mailbox filtering can now be done based on the mailbox metadata. See http://wiki2.dovecot.org/Plugins/Virtual + stats: Added doveadm stats reset to reset global stats. + stats: Added authentication statistics if auth_stats=yes. + dsync, imapc, pop3c & pop3-migration: Many optimizations, improvements and error handling fixes. + doveadm: Most commands now stop soon after SIGINT/SIGTERM. - auth: Auth caching was done too aggressively when %variables were used in default_fields, override_fields or LDAP pass/user_attrs. userdb result_* were also ignored when user was found from cache. - imap: Fixed various assert-crashes caused v2.2.20+. Some of them caught actual hangs or otherwise unwanted behavior towards IMAP clients. - Expunges were forgotten in some situations, for example when pipelining multiple IMAP MOVE commands. - quota: Per-namespaces quota were broken for dict and count backends in v2.2.20+ - fts-solr: Search queries were using OR instead of AND as the separator for multi-token search queries in v2.2.20+. - Single instance storage support wasn't really working in v2.2.16+ - dbox: POP3 message ordering wasn't working correctly. - virtual plugin: Fixed crashes related to backend mailbox deletions. From giom87 at libero.it Wed Mar 16 09:04:41 2016 From: giom87 at libero.it (Giovanni Mancuso) Date: Wed, 16 Mar 2016 10:04:41 +0100 Subject: dsync and ProxyAUTH In-Reply-To: References: <56E7DD3A.9080100@libero.it> Message-ID: <56E921A9.40200@libero.it> Il 16/03/2016 07:15, Timo Sirainen ha scritto: > On 15 Mar 2016, at 21:00, Giovanni Mancuso wrote: >> Hi, >> >> can i use dync to migrate a mailboxes through PROX-AUTH? >> >> Could It be an attractive feature for you? > Do you mean the Sun/Oracle/whatever server's PROXYAUTH command? Already done: https://github.com/dovecot/core/commit/bd06c77a12bb02871b25dceb749fa955f4a272ff Good News!!! :-) :-) This feature isn't documented :-) :-) Thank you very much From ac at stacksoft.ru Wed Mar 16 09:09:10 2016 From: ac at stacksoft.ru (Anton Chevychalov) Date: Wed, 16 Mar 2016 12:09:10 +0300 Subject: Index corruption in 2.2.18 Message-ID: <20160316120910.7b3bd32a@tahmasib.office.stacksoft.ru> We are using dbox with lz4 compression and dovecot-lda + sieve for delivery. Mail recieved: Mar 16 06:27:55 mail2 dovecot: lda(svs at example.com): sieve: msgid=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>: stored mail into mailbox 'INBOX' Around 08:14:00 user start his thunderbird with local filters. He found one mail without headers. Around that time user do repair folder in thunderbird: Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139) failed: Cached message size larger than expected (1572 > 980, box=Logs/Backup, UID=9763, cached Message-Id=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>) Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 9763 Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139) failed: Cached message size larger than expected (1572 > 980, box=Logs/Backup, UID=9763, cached Message-Id=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>) (FETCH BODY[] for mailbox Logs/Backup UID 9763) Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH read() failed in=14812 out=1077049 Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139): FETCH BODY[] for mailbox Logs/Backup UID 9763 got too little data: 1008 vs 1613 Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 9763 Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH failed in=837 out=641651 And still in a same state: Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139): FETCH BODY[] for mailbox Logs/Backup UID 9763 got too little data: 1008 vs 1613 Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 9763 Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH failed in=12462 out=984043 In thunderbird we see raw lz4 data. I have today backup (duplicate mail on exim to per day mbox). So I can restore that message, but I found older problems in other mailboxes and I can't restore it due to tapes rotation I see a lot of fixes in 2.2.19? Was it fixed after 2.2.18? -- Anton Chevychalov From leithner at itronic.at Wed Mar 16 09:48:11 2016 From: leithner at itronic.at (Harald Leithner) Date: Wed, 16 Mar 2016 10:48:11 +0100 Subject: overview zlib efficiency? Summary and added note In-Reply-To: <56E91049.80104@filmakademie.de> References: <56E823CC.8070005@filmakademie.de> <56E91049.80104@filmakademie.de> Message-ID: <56E92BDB.4040508@itronic.at> Hi, use "doveadm" to get all real message doveadm -f table fetch -A "size.physical" ALL | awk '{s+=$2}END{printf("%.2fMB\n", s/1024/1024);}' 189247.67MB .. 185G use "du" to get size on disc: In my case with deduplication: /srv/stroage/# du -s -h * 53G vmail 75G vmail_sis without deduplication /srv/stroage/# du -s -h -l * 53G vmail 209G vmail_sis j4i, SIS can't use the zlib plugin so the 75G in my case are not compressed (I haven't a filesystem that I trust and has a compression feature). Anyway it has a 3:1 ratio in my case. Maybe I interpret the SIS wrong and SIS couldn't be counted with du -l (count links). But if someone doesn't have SIS this values should be point you into the right direction. bye Harald Am 16.03.2016 um 08:50 schrieb G?tz Reinicke - IT Koordinator: > Am 15.03.16 um 16:01 schrieb G?tz Reinicke - IT Koordinator: >> Hi, >> >> may be someone has already done that: Do you have a script(?) tool which >> shows the efficiency of the mail compression if zlib is used? >> >> Something that shows the uncompressed size vrs. the compressed. > > Hi, > > maybe my question was a bit misleading. But anyway thanks for your > feedback regarding your experiences and compression rates. > > We already thought about the benefit of less IO and more CPU power, > which is no concern. > > The mailboxes I checked also go with 40-60% compression rate. > > But what I was looking for was a tool or way to see what volume would be > used if we where not using compression. > > e.g. "du -hs --without-zlib" > > Our management would like to see a graph one day which shows the volume > uncompressed and compressed ... > > Adding zlib with mdbox or maildir - as we do it currently - is from my > POV if you have the CPU power a MUST :) > > happy dovecoting - G?tz > > > -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From teemu.huovila at dovecot.fi Wed Mar 16 10:07:18 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Wed, 16 Mar 2016 12:07:18 +0200 Subject: overview zlib efficiency? In-Reply-To: <5cdcdg8usqv8@mids.svenhartge.de> References: <56E823CC.8070005@filmakademie.de> <4cdc4mausqv8@mids.svenhartge.de> <56E85759.5090600@tigertech.com> <5cdcdg8usqv8@mids.svenhartge.de> Message-ID: <56E93056.5090800@dovecot.fi> On 15.03.2016 21:45, Sven Hartge wrote: > Robert L Mathews wrote: > >> Also keep in mind that even if it does increase CPU usage, it reduces >> disk usage. This is probably an excellent tradeoff for most people, >> since most servers are limited by disk throughput/latency more than >> CPU power. > > IOPS are harder to scale (meaning: cost more to scale) than CPU power. > > And gzip (or lz4 of implemented someday) (or even blosc: liblz4 has been supported since 2.2.11+ http://wiki2.dovecot.org/Plugins/Zlib > http://www.blosc.org/. They claim "Designed to transmit data to the > processor cache faster than a memcpy() OS call.") is effectively free > with todays CPUs. > > Gr??e, > Sven. > From tss at iki.fi Wed Mar 16 10:26:02 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 16 Mar 2016 21:26:02 +1100 Subject: Index corruption in 2.2.18 In-Reply-To: <20160316120910.7b3bd32a@tahmasib.office.stacksoft.ru> References: <20160316120910.7b3bd32a@tahmasib.office.stacksoft.ru> Message-ID: <7383E7C5-AE10-427F-9F4F-71BFA04147DF@iki.fi> On 16 Mar 2016, at 20:09, Anton Chevychalov wrote: > > We are using dbox with lz4 compression and dovecot-lda + sieve for delivery. > > Mail recieved: > Mar 16 06:27:55 mail2 dovecot: lda(svs at example.com): sieve: msgid=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>: stored mail into mailbox 'INBOX' > > Around 08:14:00 user start his thunderbird with local filters. He found one mail without headers. > > Around that time user do repair folder in thunderbird: > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139) failed: Cached message size larger than expected (1572 > 980, box=Logs/Backup, UID=9763, cached Message-Id=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>) > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 9763 > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139) failed: Cached message size larger than expected (1572 > 980, box=Logs/Backup, UID=9763, cached Message-Id=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>) (FETCH BODY[] for mailbox Logs/Backup UID 9763) > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH read() failed in=14812 out=1077049 > Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139): FETCH BODY[] for mailbox Logs/Backup UID 9763 got too little data: 1008 vs 1613 > Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 9763 > Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Disconnected: > FETCH failed in=837 out=641651 > > And still in a same state: > Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139): FETCH BODY[] for mailbox Logs/Backup UID 9763 got too little data: 1008 vs 1613 > Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 9763 > Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH failed in=12462 out=984043 > > In thunderbird we see raw lz4 data. > > I have today backup (duplicate mail on exim to per day mbox). So I can restore that message, but I found older problems in other mailboxes and I can't restore it due to tapes rotation > > I see a lot of fixes in 2.2.19? Was it fixed after 2.2.18? Probably this: https://github.com/dovecot/core/commit/879dfd4da1a9a379936b8d51c1e00c3bd77873b4 The mails aren't actually corrupted. Dovecot just didn't detect LZ4 compressed mails correctly always. v2.2.22 should help. From dovecot at haravikk.me Wed Mar 16 10:52:22 2016 From: dovecot at haravikk.me (Haravikk) Date: Wed, 16 Mar 2016 10:52:22 +0000 Subject: overview zlib efficiency? Summary and added note In-Reply-To: <56E92BDB.4040508@itronic.at> References: <56E823CC.8070005@filmakademie.de> <56E91049.80104@filmakademie.de> <56E92BDB.4040508@itronic.at> Message-ID: <1151D3BC-3B70-40A6-9DD2-8457DB33D05A@haravikk.me> Not sure how you?re seeing such a high ratio; I tried the same commands on my system (thanks for these btw) and my savings from compression are around 5% =D That said I?m dealing with a much smaller volume (3gb) and I?ve only identified a half dozen or so attachments that don?t have some kind of compression already; most modern mail programs will compress common types like images by default, and many modern file-formats have compression built in, and can give better results than zlib anyway. My biggest savings are on mailing list messages (I filter these into their own mailbox) since they tend to be longer than typical messages, especially with auto-quoting, they also tend to be very busy mailboxes, but I also don?t keep them forever. As an experiment I also tried moving my (uncompressed) messages to a compressing file-system (ZFS using lz4) but the savings were similarly small; I assume they were probably a bit better, but the extra overhead of the file-system eroded it since the savings are so small in my case. I think if you?re serious about compression then a compressing file-system is the way to go though, but in my case I?m on virtual hosting so there?s not much point in layering a ZFS volume on top of shared storage (since it?s ZFS based already for integrity/redundancy). I just thought I?d mention my experience since people are quoting big savings that I haven?t seen; I wouldn?t consider my usage all that unusual, maybe some of you are receiving a lot more newsletter type traffic (these messages can be quite large), uncompressed document type files, or are less selective in which messages are retained forever? Just a caution that people looking at compression may not see the same savings depending upon their actual content. Spam is another bad category for compression I?ve found; at least in my case the messages are usually very short, and/or contain randomised junk to try to confound filters, though I?m pretty aggressive about clearing them (I discard messages outright above a certain threshold, and use a script to expunge spam messages so that I can expunge messages with higher spam ratings faster (so possible false positives stick around longer so they can be caught). > On 16 Mar 2016, at 09:48, Harald Leithner wrote: > > Hi, > > use "doveadm" to get all real message > > doveadm -f table fetch -A "size.physical" ALL | awk '{s+=$2}END{printf("%.2fMB\n", s/1024/1024);}' > > 189247.67MB .. 185G > > use "du" to get size on disc: > > In my case > with deduplication: > > /srv/stroage/# du -s -h * > 53G vmail > 75G vmail_sis > > without deduplication > > /srv/stroage/# du -s -h -l * > 53G vmail > 209G vmail_sis > > j4i, SIS can't use the zlib plugin so the 75G in my case are not compressed (I haven't a filesystem that I trust and has a compression feature). Anyway it has a 3:1 ratio in my case. > > Maybe I interpret the SIS wrong and SIS couldn't be counted with du -l (count links). > > But if someone doesn't have SIS this values should be point you into the right direction. > > bye > > Harald > > Am 16.03.2016 um 08:50 schrieb G?tz Reinicke - IT Koordinator: >> Am 15.03.16 um 16:01 schrieb G?tz Reinicke - IT Koordinator: >>> Hi, >>> >>> may be someone has already done that: Do you have a script(?) tool which >>> shows the efficiency of the mail compression if zlib is used? >>> >>> Something that shows the uncompressed size vrs. the compressed. >> >> Hi, >> >> maybe my question was a bit misleading. But anyway thanks for your >> feedback regarding your experiences and compression rates. >> >> We already thought about the benefit of less IO and more CPU power, >> which is no concern. >> >> The mailboxes I checked also go with 40-60% compression rate. >> >> But what I was looking for was a tool or way to see what volume would be >> used if we where not using compression. >> >> e.g. "du -hs --without-zlib" >> >> Our management would like to see a graph one day which shows the volume >> uncompressed and compressed ... >> >> Adding zlib with mdbox or maildir - as we do it currently - is from my >> POV if you have the CPU power a MUST :) >> >> happy dovecoting - G?tz >> >> >> > > -- > Harald Leithner > > ITronic > Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria > Tel: +43-1-545 0 604 > Mobil: +43-699-123 78 4 78 > Mail: leithner at itronic.at | itronic.at From BHueck at kevag-telekom.de Wed Mar 16 11:14:41 2016 From: BHueck at kevag-telekom.de (=?iso-8859-1?Q?Benjamin_H=FCck?=) Date: Wed, 16 Mar 2016 11:14:41 +0000 Subject: Plugin "last-login" - Log SMTP-AUTH information Message-ID: <1458126881792.49106@kevag-telekom.de> Hello all, we are using the Plugin "last-login" [1] to update user's last-login timestamp or the timestamp of the last incoming message in a MySQL backend. Would it be possible to expand the plugin to also log the timestamp of the last smtp-auth attempt/successful process? Currently in our settings, a smtp-auth request (port 587) is forwarded by postfix to a dovecot backend server for authentication. I couldn`t find out the developer of the plugin otherwise I had contact them immediatly. Thanks and best regards, Benjamin H?ck [1] http://wiki2.dovecot.org/Plugins/LastLogin -- ________________________________ KEVAG Telekom GmbH Cusanusstr. 7 D 56073 Koblenz Fon: +49 261 20162-0 Fax: +49 261 20162-25100 http://www.kevag-telekom.de/ Gesch?ftsf?hrer: Bernd Gowitzke, Gerd Thewalt Sitz der Gesellschaft: Koblenz, Amtsgericht Koblenz, HRB Nr. 5343 USt.IdNr. DE 18 77 67 843 St-Nr. 22/650/0182/7 From sven at svenhartge.de Wed Mar 16 11:38:59 2016 From: sven at svenhartge.de (Sven Hartge) Date: Wed, 16 Mar 2016 12:38:59 +0100 Subject: overview zlib efficiency? References: <56E823CC.8070005@filmakademie.de> <4cdc4mausqv8@mids.svenhartge.de> <56E85759.5090600@tigertech.com> <5cdcdg8usqv8@mids.svenhartge.de> <56E93056.5090800@dovecot.fi> Message-ID: <8cde5g5usqv8@mids.svenhartge.de> Teemu Huovila wrote: > On 15.03.2016 21:45, Sven Hartge wrote: >> And gzip (or lz4 of implemented someday) (or even blosc: > liblz4 has been supported since 2.2.11+ http://wiki2.dovecot.org/Plugins/Zlib Hmm, yes. I don't know how I missed this when I looked at that page last night. Must have been a coffein underflow error. S? -- Sigmentation fault. Core dumped. From yodaslack at stacksoft.ru Wed Mar 16 11:42:27 2016 From: yodaslack at stacksoft.ru (Anton Chevychalov) Date: Wed, 16 Mar 2016 14:42:27 +0300 Subject: overview zlib efficiency? In-Reply-To: <56E823CC.8070005@filmakademie.de> References: <56E823CC.8070005@filmakademie.de> Message-ID: <264dee043ac4a6115410e6971eef24a0@stacksoft.ru> During migration from 1.x with maildir to 2.x with dbox a did the following trick: time dsync -R -u test at example.com backup maildir:/var/spool/imap/tmp/Maildir And got the following results: |orig |366|28s | |gz.6 |260|5min| |bz2.6|202|5min| |xz.1 |211|1min| |xz.2 |213|1min50sec| |xz.3 |201|3min| |xz.6 |198|5min| |xz.9 |198|10min| |lz4 |281|18s | 1-9 - is compression level. I choose lz4 finally. -- Anton Chevychalov G?tz Reinicke - IT Koordinator ????? 2016-03-15 18:01: > Hi, > > may be someone has already done that: Do you have a script(?) tool > which > shows the efficiency of the mail compression if zlib is used? > > Something that shows the uncompressed size vrs. the compressed. > > Thanks for hints! /G?tz From leithner at itronic.at Wed Mar 16 12:01:22 2016 From: leithner at itronic.at (Harald Leithner) Date: Wed, 16 Mar 2016 13:01:22 +0100 Subject: overview zlib efficiency? Summary and added note In-Reply-To: <1151D3BC-3B70-40A6-9DD2-8457DB33D05A@haravikk.me> References: <56E823CC.8070005@filmakademie.de> <56E91049.80104@filmakademie.de> <56E92BDB.4040508@itronic.at> <1151D3BC-3B70-40A6-9DD2-8457DB33D05A@haravikk.me> Message-ID: <56E94B12.3050308@itronic.at> In the vmail directory are only attachment stored which are smaller then 64k every attachment that is bigger get into the SIS store. The SIS store has no compression but it seams that attachments are stored in raw and not base64 encoded so its saves 30%? on binary data. Also I wrote that 'du -l' maybe not the correct way to count de-duplication. It seams that every attachment has minimum 2 hardlinks in the SIS, I missed that before I wrote the other mail. That also explains why storage uses so much more space then the counted mail size ;-) I think ignoring the hashes folder in the sis would give better results: find vmail_sis -type f -printf '%s %p\n' | grep -v hashes | awk '{s+=$1}END{printf("%.2fMB\n", s/1024/1024);}' In my case this is: 142922.29MB (So forget 209G from my previous mail.) doveadm -f table fetch -A "size.physical" ALL | awk '{s+=$2}END{printf("%.2fMB\n", s/1024/1024);}' 195861.12MB du -sh vmail 56G (it also seams that mdbox tricked me with spare file size) Mails in mdbox storage compressed without index/logs find vmail -type f -printf '%s %p\n' | grep "/storage/m." | awk '{s+=$1}END{printf("%.2fMB\n", s/1024/1024);}' 4776.51MB index/logs find vmail -type f -printf '%s %p\n' | grep -v "/storage/m." | awk '{s+=$1}END{printf("%.2fMB\n", s/1024/1024);}' 224.40MB So in the end I use 146,7 Storage + 224,4 index/logs/metadata/overhead with 191,27 GB Plain E-Mails I still can't tell you how much compression begins in because SIS is not compressed ;-) So some without SIS and mdbox have to do this test. bye Am 16.03.2016 um 11:52 schrieb Haravikk: > Not sure how you?re seeing such a high ratio; I tried the same commands on my system (thanks for these btw) and my savings from compression are around 5% =D > > That said I?m dealing with a much smaller volume (3gb) and I?ve only identified a half dozen or so attachments that don?t have some kind of compression already; most modern mail programs will compress common types like images by default, and many modern file-formats have compression built in, and can give better results than zlib anyway. > > My biggest savings are on mailing list messages (I filter these into their own mailbox) since they tend to be longer than typical messages, especially with auto-quoting, they also tend to be very busy mailboxes, but I also don?t keep them forever. > > As an experiment I also tried moving my (uncompressed) messages to a compressing file-system (ZFS using lz4) but the savings were similarly small; I assume they were probably a bit better, but the extra overhead of the file-system eroded it since the savings are so small in my case. I think if you?re serious about compression then a compressing file-system is the way to go though, but in my case I?m on virtual hosting so there?s not much point in layering a ZFS volume on top of shared storage (since it?s ZFS based already for integrity/redundancy). > > I just thought I?d mention my experience since people are quoting big savings that I haven?t seen; I wouldn?t consider my usage all that unusual, maybe some of you are receiving a lot more newsletter type traffic (these messages can be quite large), uncompressed document type files, or are less selective in which messages are retained forever? Just a caution that people looking at compression may not see the same savings depending upon their actual content. > > Spam is another bad category for compression I?ve found; at least in my case the messages are usually very short, and/or contain randomised junk to try to confound filters, though I?m pretty aggressive about clearing them (I discard messages outright above a certain threshold, and use a script to expunge spam messages so that I can expunge messages with higher spam ratings faster (so possible false positives stick around longer so they can be caught). > >> On 16 Mar 2016, at 09:48, Harald Leithner wrote: >> >> Hi, >> >> use "doveadm" to get all real message >> >> doveadm -f table fetch -A "size.physical" ALL | awk '{s+=$2}END{printf("%.2fMB\n", s/1024/1024);}' >> >> 189247.67MB .. 185G >> >> use "du" to get size on disc: >> >> In my case >> with deduplication: >> >> /srv/stroage/# du -s -h * >> 53G vmail >> 75G vmail_sis >> >> without deduplication >> >> /srv/stroage/# du -s -h -l * >> 53G vmail >> 209G vmail_sis >> >> j4i, SIS can't use the zlib plugin so the 75G in my case are not compressed (I haven't a filesystem that I trust and has a compression feature). Anyway it has a 3:1 ratio in my case. >> >> Maybe I interpret the SIS wrong and SIS couldn't be counted with du -l (count links). >> >> But if someone doesn't have SIS this values should be point you into the right direction. >> >> bye >> >> Harald >> >> Am 16.03.2016 um 08:50 schrieb G?tz Reinicke - IT Koordinator: >>> Am 15.03.16 um 16:01 schrieb G?tz Reinicke - IT Koordinator: >>>> Hi, >>>> >>>> may be someone has already done that: Do you have a script(?) tool which >>>> shows the efficiency of the mail compression if zlib is used? >>>> >>>> Something that shows the uncompressed size vrs. the compressed. >>> >>> Hi, >>> >>> maybe my question was a bit misleading. But anyway thanks for your >>> feedback regarding your experiences and compression rates. >>> >>> We already thought about the benefit of less IO and more CPU power, >>> which is no concern. >>> >>> The mailboxes I checked also go with 40-60% compression rate. >>> >>> But what I was looking for was a tool or way to see what volume would be >>> used if we where not using compression. >>> >>> e.g. "du -hs --without-zlib" >>> >>> Our management would like to see a graph one day which shows the volume >>> uncompressed and compressed ... >>> >>> Adding zlib with mdbox or maildir - as we do it currently - is from my >>> POV if you have the CPU power a MUST :) >>> >>> happy dovecoting - G?tz >>> >>> >>> >> >> -- >> Harald Leithner >> >> ITronic >> Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria >> Tel: +43-1-545 0 604 >> Mobil: +43-699-123 78 4 78 >> Mail: leithner at itronic.at | itronic.at -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From tss at iki.fi Wed Mar 16 12:18:04 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 16 Mar 2016 23:18:04 +1100 Subject: dsync and ProxyAUTH In-Reply-To: <56E921A9.40200@libero.it> References: <56E7DD3A.9080100@libero.it> <56E921A9.40200@libero.it> Message-ID: <9E3058AC-998F-4964-9C6D-7B66E5A4EEE2@iki.fi> > On 16 Mar 2016, at 20:04, Giovanni Mancuso wrote: > > Il 16/03/2016 07:15, Timo Sirainen ha scritto: >> On 15 Mar 2016, at 21:00, Giovanni Mancuso wrote: >>> Hi, >>> >>> can i use dync to migrate a mailboxes through PROX-AUTH? >>> >>> Could It be an attractive feature for you? >> Do you mean the Sun/Oracle/whatever server's PROXYAUTH command? Already done: https://github.com/dovecot/core/commit/bd06c77a12bb02871b25dceb749fa955f4a272ff > Good News!!! :-) :-) > > This feature isn't documented :-) :-) > > Thank you very much Added: http://wiki2.dovecot.org/MailboxFormat/imapc From zhb at iredmail.org Wed Mar 16 14:23:49 2016 From: zhb at iredmail.org (Zhang Huangbin) Date: Wed, 16 Mar 2016 22:23:49 +0800 Subject: Question: encrypt/decrypt with plugin mail_filter Message-ID: <3DE3DF7E-90E6-46BE-9B56-D2A2CA198A26@iredmail.org> Dear all, I'm trying to encrypt/decrypt mail body with Dovecot plugin 'mail_filter': http://wiki2.dovecot.org/Plugins/MailFilter I wrote a Python script to read mail body and encrypt it, the encryption/decryption part is working as expected, but Dovecot always fail to write modified email on disk: Error: Cached message size smaller than expected (1575 < 1644) Error: Maildir filename has wrong S value, renamed the file from /var/vmail/domain.com/user/cur/1458165453.M632521P17600.c7.iredmail.org,S=1575:2, to /var/vmail/domain.com/user/cur/1458165453.M632521P17600.c7.iredmail.org,S=1575:2, Error: Corrupted index cache file /var/vmail/domain.com/user/dovecot.index.cache: Broken physical size for mail UID 4 Error: read() failed: Invalid argument (uid=4) I know this behave is clearly explained in Dovecot wiki page, the question is, is there any way to overcome this and let Dovecot correctly handle the encrypted/decrypted mail? Thanks. :) From matthias.lay at securepoint.de Wed Mar 16 14:24:13 2016 From: matthias.lay at securepoint.de (Matthias Lay) Date: Wed, 16 Mar 2016 15:24:13 +0100 Subject: subscribe users mailbox with non-valid mutf7 chars In-Reply-To: <20160209123131.41d1723b@eugen.spdev.local> References: <20160209123131.41d1723b@eugen.spdev.local> Message-ID: <20160316152413.0470c20a@loomy-TERRA-MOBILE-1548Q> did some more testing on this and encoutnered its even not working when using filesystem links AND encoding the username in mutf7. it ends up in the same error than doveadm subscribe. what i tried: * renamed public folder on FS to mutf7: "a & p products group" => "a &- p products group" * created link in the users Maildir: private/franzf/Maildir# ll public/a\ \&-\ p\ products\ group/ total 8K drwxr-xr-x 2 vmail vmail 4096 Mar 16 15:09 . drwxr-xr-x 5 vmail vmail 4096 Mar 16 15:06 .. lrwxrwxrwx 1 vmail vmail 56 Mar 16 15:09 LTA -> /var/data/vmail/public/a &- p products group/Maildir/LTA * trying to select the folder in imap: 4 select "public/a &- p products group/LTA/forever" imap(franzf): Debug: fs: root=/var/data/vmail/public/a &- p products group/Maildir, index=, indexpvt=, control=, inbox=/var/data/vmail/public/a &- p products group/Maildir/INBOX, alt= imap(franzf): Debug: acl: initializing backend with data: vfile:/etc/dovecot/acls/acl-defaults imap(franzf): Debug: acl: acl username = a &- p products group imap(franzf): Debug: acl: owner = 1 imap(franzf): Debug: acl vfile: Global ACL file: /etc/dovecot/acls/acl-defaults imap(franzf): Debug: fs: root=/var/data/vmail/public/a &- p products group/Maildir, index=, indexpvt=, control=, inbox=/var/data/vmail/public/a &- p products group/Maildir/INBOX, alt= imap(franzf): Debug: acl: initializing backend with data: vfile:/etc/dovecot/acls/acl-defaults imap(franzf): Debug: acl: acl username = franzf imap(franzf): Debug: acl: owner = 0 imap(franzf): Debug: acl vfile: Global ACL file: /etc/dovecot/acls/acl-defaults 4 NO [CANNOT] Invalid mailbox name 'public/a & p products group/LTA/forever': Missing namespace prefix 'public/a &- p products group/' (0.000 secs). the same procedure works great with every Ascii Username. On Tue, 9 Feb 2016 12:31:31 +0100 Matthias Lay wrote: > > Hi all, > > I got a question if its possible to subscribe a mailbox from another > user, who contains non mutf7 valid chars in his mailbox path. > > > I have a private namespace which can subscribe to mailboxes of a > shared namespace with public/ prefix > > in this example > username in private namespace is johnd > public username is "a & p products group" > > > when I try the subscription I get this one: > > ******************************************** > # doveadm mailbox subscribe -u johnd "public/a & p products > group/INBOX" doveadm(johnd): Error: Can't public/a & p products > group/INBOX mailbox subscribe to: Invalid mailbox name 'public/a & p > products group/INBOX': Missing namespace prefix 'public/a &- p > products group/' ******************************************** > > > is there a way to work around this? (except for not to use usernames > like this) > > > > greetz matze From gsue-dvctnews at gameduell.de Wed Mar 16 15:18:52 2016 From: gsue-dvctnews at gameduell.de (Georg Schuetze) Date: Wed, 16 Mar 2016 16:18:52 +0100 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <52DA80D4.3000900@gekmihesg.de> References: <52DA80D4.3000900@gekmihesg.de> Message-ID: <56E9795C.2040003@gameduell.de> Hi, i have the same problem with the current dovecot version 2.2.22. I wonder that nobody else seems to have run into this, since this thread is quite old. Did i miss something and does one need a special configuration for syncing public namespaces? Markus, do you still use your patch or did you encounter some problems with it? I just tested it and it still seems to work: the logs have many "Error: Couldn't create lock /[..]/dovecot-sync.lock: Permission denied" entries now, which is always better than thousands of duplicate mails ... Best, Georg. From jlandwehr at icloud.com Wed Mar 16 20:38:36 2016 From: jlandwehr at icloud.com (J Landwehr) Date: Wed, 16 Mar 2016 16:38:36 -0400 Subject: talloc access after free error ntlmssp_server.c:457 Message-ID: Our new/fresh dovecot imap installation on CentOS (latest from yum repository, which is 2.2.10) is locking up with a panic on a consistent basis and denying service to subsequent clients. The behavior is repeatable. Have spent weeks debugging and trying different configurations with no success. Specific /var/log/maillog error messages are: 12:06:54 dovecot: auth: Error: talloc: access after free error - first free may be at ../auth/ntlmssp/ntlmssp_server.c:457 12:06:54 dovecot: auth: Error: Bad talloc magic value - access after free 12:06:54 dovecot: auth: Error: PANIC (pid 2570): Bad talloc magic value - access after free Our configuration is based on the instructions for NTLM authentication with our Windows 2012R2 AD/Domain server: http://wiki2.dovecot.org/HowTo/ActiveDirectoryNtlm Here are the steps to reproduce: 1. Fresh boot of CentOS server, only configured for postfix/dovecot 2. Connect with Outlook 2016 12.0.4312.1000 32bit on Win7 via IMAP to this dovecot server 3. Any existing and new mail loads in OK to inbox - so authentication is working OK to AD domain server 4. Send an email to someone from Outlook 5. SMTP process completes, message is delivered - 6. dovecot immediately panics on servers, Authentication to dovecot no longer works 7. will hang until a on the ?dovecot/auth? PID is performed The issue is with steps 6/7 immediately after 4/5- and is intermittent. Steps 1-3 always work OK, as do 4-5. Further, inbound emails received on this server when no IMAP client is running are always received just fine and dovecot doesn?t hang. Sometimes I have to send a few email messages with steps 4/5 before the issue with 6/7 happens. If I tail -f /var/log/maillog on the server, I can usually determine when 6/7 will fail because there is a line or two with: "dovecot: map: Disconnected: logged out message? being shown, even though the Outlook client is still open. After I see that Outlook closed an IMAP session, even though outlook is still running, I can send a message from Outlook and after it appears in my inbox, dovecot panics/hangs immediately Authentication is otherwise working, e.g. test with: /usr/bin/ntlm_auth ?username=alice occasionally takes several seconds to respond, but is usually immediate response is always NT_STATUS_OK: Success (0x0) (I welcome tips to make ntlm_auth always respond more quickly!) I have tried adding lines to smb.conf like: win bind cache time = 300 win bind offline login = true No success I have also looked further into the detailed debugging logs and there is: dovecot: auth: Error: Go user=[alice] domain=[OFFICE] workstation=[pc1] len1=24 len2=290 dovecot: auth: error: login for user [OFFICE]\[alice]@[pc1] failed due to [Wrong Password] dovecot: auth: Error: GENSEC login failed: NT_STATUS_LOGON_FAILURE dovecot: auth: winbind(?,x.x.x.x,): user not authetnicated: NT_STATUS_LOGON_FAILURE But I am not sure why there would be that error, since earlier IMAP sessions are working just fine with the same exact domain/username and password. It seems to be something about Outlook quickly opening up new simultaneous IMAP sessions with a CONT command, and NTLM authentication somehow fails with one of them, and panics. It always seems to be when sending an email. Like the process of either receiving a new msg in the inbox and/or also posting the just sent message into the Sent Items folder via IMAP (perhaps when it happens simultaneously, as in a message you cc yourself on) is somehow triggering this. Here is more detailed information that can hopefully help track this down. Thank you! dovecot -n # 2.2.10: /etc/dovecot/dovecot.conf CentOS 7.2.1511 auth_mechanisms = ntlm auth_use_winbind = yes auth_username_format = %n mbox_write_locks = fcntl passdb { drive = pam } protocols = imap service auth { user = root } userdb { driver = passwd } /etc/samba/smb.conf workgroup = OFFICE realm = OFFICE.LOCAL security = ADS local master = no preferred master = no dns proxy = no idmap uid = 10000-20000 idmap gid = 10000-20000 password server = win2012r2 encrypt passwords = no kerberos method = system keytab winbind use_default_domain = yes winbind offline login = true winbind separator = + ERROR MESSAGE 12:00:10 dovecot: imap(alice): Disconnected: logged out in=398 out=4368 12:05:52 postfix/smtpd: connect from pc1 12:05:52 postfix/smtpd: client=pc1 12:05:52 postfix/cleanu: message-id= 12:05:52 postfix/qmgr: from=alice, size=5925, nrcpt=1 (queue active) 12:05:53 postfix/smtp: to=bob, relay=mailserver, delay=0.93, dsn=2.0.0, status=send (250 ok: Message accepted) 12:06:53 postfix/qmgr: removed 12:06:54 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth 12:06:54 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so 12:06:54 dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat 12:06:54 dovecot: auth: Debug: auth client connected (pid=2565) 12:06:54 dovecot: auth: Debug: auth client connected (pid=2568) 12:06:54 dovecot: auth: Debug: auth client connected (pid=2569) 12:06:54 dovecot: auth: Debug: client in: AUTH#0111#011NTLM#011service=imap#011session=XXXip=X.X.X.X#011rip=X.X.X.X#011lport=143#011rport=61072 12:06:54 dovecot: auth: Debug: client in: AUTH#0111#011NTLM#011service=imap#011session=XXXip=X.X.X.X#011rip=X.X.X.X#011lport=143#011rport_61061 12:06:54 dovecot: auth: Debug: client in: AUTH#0111#011NTLM#011service=imap#011sessoin=XXXip=x.x.x.x#011lip=X.X.X.X#011lport=143#011rport=61073 12:06:54 dovecot: auth: Debug: client passdb out: CONT#0111 12:06:54 dovecot: auth: Debug: client passdb out: CONT#0111 12:06:54 dovecot: auth: Debug: client passdb out: CONT#0111 12:06:54 dovecot: auth: Debug: client in: CONT 12:06:54 dovecot: auth: Debug: client passdb out: CONT#0111#011XXX 12:06:54 dovecot: auth: Debug: client in: CONT 12:06:54 dovecot: auth: Debug: client passdb out; CONT#0111#011XXX 12:06:54 dovecot: auth: Debug: client passdb out: CONT#0111#011XXX 12:06:54 dovecot: auth: Debug: client in CONT 12:06:54 dovecot: auth: winbind(?X.X.X.X,): user not authenticated: NT_STATUS_LOGON_FAILURE 12:06:54 dovecot: auth: Debug: client in: CONT 12:06:54 dovecot: auth: Error: talloc: access after free error - first free may be at ../auth/ntlmssp/ntlmssp_server.c:457 12:06:54 dovecot: auth: Error: Bad talloc magic value - access after free 12:06:54 dovecot: auth: Error: PANIC (pid 2570): Bad talloc magic value - access after free 12:06:54 dovecot: auth: Error: BACKTRACE: 15 stack frames: 12:06:54 dovecot: auth: Error: #0 /lib64/libsmbconf.so.0(log_stack_trace+0x1a) 12:06:54 dovecot: auth: Error: #1 /lib64/libsmbconf.so.0(smb_panic_s3+0x20) 12:06:54 dovecot: auth: error: #2 /lib53/libsamba-util.so.0(smb_panic+0x2f) 12:06:54 dovecot: auth: Error: #3 /lib64/libtalloc.so.2(+0x20af) 12:06:54 dovecot: auth: Error: #4 /lib64/libtalloc.so.2(_talloc_free+0x545) 12:06:54 dovecot: auth: Error: #5 /lib64/libsamba-util.so.0(data_blob_free+0x18) 12:06:54 dovecot: auth: Error: #6 /lib64/libgensec.so.0(gensec_ntlmssp_server_auth+0xdf) 12:06:54 dovecot: auth: Error: #7 /lib64/libgensec.so.0(gensec_ntlmssp_update+0x253) 12:06:54 dovecot: auth: Error: #8 /lib64/libgensec.so.0(gensec_update_ev+0x232) 12:06:54 dovecot: auth: Error: #9 /lib64/libgensec.so.0(gensec_update+0x17) 12:06:54 dovecot: auth: Error: #10 /usr/bin/ntlm_auth(+0x92df) 12:06:54 dovecot: auth: Error: #11 /usr/bin/ntlm_auth(+0x587f) 12:06:54 dovecot: auth: Error: #12 /usr/bin/ntlm_auth(main+0xc3b) 12:06:54 dovecot: auth: Error: #13 /lib64/libc.so.6(__libc_start_main+0xf5) 12:06:54 dovecot: auth: Error: #14 /usr/bin/ntlm_auth(+0x535d) 12:06:54 dovecot: auth: Error: Can not dump core: corepath not set up 12:06:55 postfix/smtp[2560]: disconnect from pc1 12:09:54 dovecot: imap-login: Disconnected: Inactivity during authentication (disconnected while authenticating, waited 180 secs): user =<>, method=NTLM, rip=x.x.x.x, lip=x.x.x.x, session= The last line ends up repeating as clients continue to try to connect. From gsue-dvctnews at gameduell.de Thu Mar 17 05:48:35 2016 From: gsue-dvctnews at gameduell.de (Georg Schuetze) Date: Thu, 17 Mar 2016 06:48:35 +0100 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <56E9795C.2040003@gameduell.de> References: <52DA80D4.3000900@gekmihesg.de> <56E9795C.2040003@gameduell.de> Message-ID: <56EA4533.1080505@gameduell.de> Hi, since the maillist threading works only within the current month, i'll attach the original message from 2014 from Markus Weippert. In my setup i can reproduce this issue with only one message in a shared folder: Everytime when the (new) replication client is started for the first time, the initial replication takes place and there the message in the shared folder gets duplicated thousands of times. Best, Georg. > On 13.01.2014 12:48, Markus Weippert wrote: > >/Hi, />//>/I'm having some issues with replicating public namespaces. Everything />/seems to work fine for private namespaces, but while importing some huge />/mailboxes (many small mails) into a public namespace via imapsync, />/something goes wrong. />//>/The expected mail flow is: />/old-server (imapsync)> new-server1 (replication)> new-server2 />//>/But then, dovecot seems to run into race conditions when the />/replications process tries to sync the same public mailbox under two or />/more different users at the same time. As a result, messages get />/duplicated, new-server2 sends those back to new-server1 which then />/starts to produce duplicates too. If I don't kill the processes in time />/and delete the faulty mailbox, they start to produce thousands of mails. />/In fact, server2 should not export messages at all, since it's not />/productive yet and does not get any mail except from the replication. />//>/The only thing getting logged (only few compared to the huge amount of />/duplicates produced): />/"dsync-server(user at example.com > ): Warning: > Maildir /...: Expunged message />/reappeared, giving a new UID" />//>/Is there any way to fix this? />//>/Regards, />/Markus / > I looked into this a bit more. The problem seems to be, replication > locking is only done at user level. For public namespaces, this allows > two replication processes to sync the same mailbox in parallel. So I did > a (poor) implementation for mailbox level locking. It locks the mailbox > with a lock file in the control directory on both sides (not sure if > that's necessary) and skips locked mailboxes instantly, because they are > currently being synced anyway. > It actually works in my setup. The duplicate messages are gone. It logs > some warnings when two replication processes try to access the same > mailbox at once, which seems to happen quite frequently in public > namespaces. > > Maybe someone more experienced can clean this up and adopt it to > upstream? I really like the replication idea and it would be nice if it > were as stable for shared/public namespaces as it is for private ones... > > Regards, > Markus > > > P.S.: > >/replication_dsync_parameters = -d -l 60 -N -x virtual -x ns_public -U /Typo, actually looks like this: > replication_dsync_parameters = -d -l 60 -N -x virtual -x legacy -U > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: dsync-lock.patch > Type: text/x-patch > Size: 5672 bytes > Desc: not available > URL: From bra at fsn.hu Thu Mar 17 08:55:14 2016 From: bra at fsn.hu (Nagy, Attila) Date: Thu, 17 Mar 2016 09:55:14 +0100 Subject: v2.2.22 released In-Reply-To: <20206AF5-247D-4DAF-9A41-0234A35DAAEA@iki.fi> References: <20206AF5-247D-4DAF-9A41-0234A35DAAEA@iki.fi> Message-ID: <56EA70F2.8010206@fsn.hu> On 03/16/16 09:27, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.22.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.22.tar.gz.sig > > + Added doveadm HTTP API: See > http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP > + virtual plugin: Mailbox filtering can now be done based on the > mailbox metadata. See http://wiki2.dovecot.org/Plugins/Virtual > + stats: Added doveadm stats reset to reset global stats. > + stats: Added authentication statistics if auth_stats=yes. > + dsync, imapc, pop3c & pop3-migration: Many optimizations, > improvements and error handling fixes. Any chances of this fixed in this release? http://dovecot.org/list/dovecot/2016-February/103251.html From madduck at madduck.net Thu Mar 17 10:17:08 2016 From: madduck at madduck.net (madduck at madduck.net) Date: Thu, 17 Mar 2016 11:17:08 +0100 Subject: spamc during dovecot-smtp delivery? In-Reply-To: References: Message-ID: <20160317101708.GE30377@albatross.lehel.madduck.net> [cc'ing the list for posterity] also sprach Tolbert, Joshua P [2016-03-16 21:46 +0100]: > I?ve been working on a Postfix/Dovecot/sieve mail server migration > (from Sendmail/Dovecot/procmail) and ran in to a similar problem > to one you talked about a while ago on the dovecot mailing lists. > Did you ever find a good solution for running spamc as the > destination user in sieve? If you did, mind sharing? Thanks! I've never had a problem again since upgrading to Debian jessie, but I also think that the problem's solution was installing a NSS cache, because the deadlocks seemed to take place between Spamassassin and libnss-pgsql2. Transport from Postfix to Dovecot is lmtp:unix:private/dovecot-lmtp (no idea how to do that with Sendmail or why you'd want to use Sendmail) and then Dovecot's sieve is configured to run a filter using /etc/dovecot/sieve.before.d: require [ "vnd.dovecot.filter"]; filter "spamc" [ "--no-safe-fallback" ]; which is enabled in conf.d/90-sieve.conf with sieve_before = /etc/dovecot/sieve.before.d sieve_global_extensions = +vnd.dovecot.filter sieve_plugins = sieve_extprograms and in conf.d/90-sieve-extprograms.conf sieve_filter_bin_dir = /etc/dovecot/sieve-filter and then I made a simple symlink from /etc/dovecot/sieve-filter ? /usr/bin/spamc Spamassassin starts with --create-prefs --helper-home-dir --allow-tell and the final step is to integrate the mail user database (vmm in my case) with libnss to provide spamassassin with a way to identify home directories. I use libnss-pgsql2. The /etc/nss-pgsql.conf file I use is available here: http://bugs.debian.org/818465 A successful delivery then looks like this: postfix/smtpd[29778]: connect from mail1.smtp.mailserver4.de[62.216.179.241] postfix/smtpd[29778]: 6D2F74024E: client=mail1.smtp.mailserver4.de[62.216.179.241] postfix/cleanup[32593]: 6D2F74024E: message-id= postfix/smtpd[29778]: disconnect from mail1.smtp.mailserver4.de[62.216.179.241] dovecot: lmtp(3570): Connect from local spamd[2140]: spamd: connection from localhost [::1]:57032 to port 783, fd 6 spamd[2140]: spamd: setuid to xxxxxxx%yyyyyyyyyy.zz succeeded spamd[2140]: spamd: processing message for xxxxxxx%yyyyyyyy.zz:70032 spamd[2140]: spamd: clean message (-1.9/5.0) for xxxxxxx%yyyyyyyy.zz:70032 in 3.0 seconds, 10222 bytes. spamd[2140]: spamd: result: . -1 - BAYES_00,DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,HTML_MESSAGE,RCVD_IN_DNSWL_NONE scantime=3.0,size=10222,user=xxxxxxx%yyyyyyyy.zz,uid=70032,required_score=5.0,rhost=localhost,raddr=::1,rport=57032,mid=,bayes=0.000000,autolearn=ham autolearn_force=no dovecot: lmtp(3570, xxxxxxx at yyyyyyyy.zz): copy from (file): box=INBOX, uid=30613, msgid=, size=10945 dovecot: lmtp(3570, xxxxxxx at yyyyyyyy.zz): QLZ6IoJ/6lbyDQAARsnb6w: sieve: msgid=: stored mail into mailbox 'INBOX' postfix/lmtp[3569]: 6D2F74024E: to=, orig_to=, relay=ambassador.madduck.net[private/dovecot-lmtp], delay=5, delays=2/0.02/0.01/3, dsn=2.0.0, status=sent (250 2.0.0 QLZ6IoJ/6lbyDQAARsnb6w Saved) dovecot: lmtp(3570): Disconnect from local: Successful quit Hope this helps? -- @martinkrafft | http://madduck.net/ | http://two.sentenc.es/ "the public is wonderfully tolerant. it forgives everything except genius." -- oscar wilde spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1107 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From mail at tomsommer.dk Thu Mar 17 12:41:11 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 17 Mar 2016 13:41:11 +0100 Subject: lmtp timeout, locks and crashes In-Reply-To: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> Message-ID: <50aa6f75cac931e0d15a6be80b3840b6@tomsommer.dk> On 2016-03-15 10:53, Tom Sommer wrote: > I'm seeing some problems on accounts which get a lot of spam (like, a > lot). I did an "strace" on one of the hundreds of lmtp processes. It's doing stat() on all files in the new folder for the receiver: stat("/var/mail/dovecot/xxxx/xxxx/new/xx.xxx.xxxx.xxxx.com", {st_mode=S_IFREG|0600, st_size=15505, ...}) = 0 etc. The "new" folder contains hundreds of thousands of files. Is there any way to prevent all these stat() calls? It seems like something there would be an index or cache for? Thanks // Tom From mail at tomsommer.dk Thu Mar 17 13:21:48 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 17 Mar 2016 14:21:48 +0100 Subject: lmtp timeout, locks and crashes In-Reply-To: <50aa6f75cac931e0d15a6be80b3840b6@tomsommer.dk> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> <50aa6f75cac931e0d15a6be80b3840b6@tomsommer.dk> Message-ID: <07bf8ef0ab5d81ce691fef7e724c937a@tomsommer.dk> On 2016-03-17 13:41, Tom Sommer wrote: > On 2016-03-15 10:53, Tom Sommer wrote: >> I'm seeing some problems on accounts which get a lot of spam (like, a >> lot). > > I did an "strace" on one of the hundreds of lmtp processes. > > It's doing stat() on all files in the new folder for the receiver: > > stat("/var/mail/dovecot/xxxx/xxxx/new/xx.xxx.xxxx.xxxx.com", > {st_mode=S_IFREG|0600, st_size=15505, ...}) = 0 > > etc. > > The "new" folder contains hundreds of thousands of files. > > Is there any way to prevent all these stat() calls? It seems like > something there would be an index or cache for? Seems like it might be due to maildir quota-recalculation? From stephan at rename-it.nl Thu Mar 17 13:38:29 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 17 Mar 2016 14:38:29 +0100 Subject: Xi has a new home Message-ID: <56EAB355.5070801@rename-it.nl> Hi, The automatic package builder Xi has moved to system within the Dovecot infrastructure. This also means that the repositories are available at a new host name: xi.dovecot.fi. The old host name still works and is a CNAME pointing to the new venue. I expect the old domain to be active for years to come. So, there is no need to update your /etc/apt/sources.list right away. Still, it is a good idea to do so. I've updated the wiki accordingly. Regards, Stephan. From erickom at metropolitancollege.co.za Thu Mar 17 14:09:29 2016 From: erickom at metropolitancollege.co.za (Eric Kom) Date: Thu, 17 Mar 2016 16:09:29 +0200 Subject: [Dovecot-news] Xi has a new home In-Reply-To: <56EAB355.5070801@rename-it.nl> References: <56EAB355.5070801@rename-it.nl> Message-ID: <56EABA99.3000003@metropolitancollege.co.za> On 2016/03/17 3:38 PM, Stephan Bosch wrote: > Hi, Good day dear, Thanks for the UPDATE. The xi.dovecot.fi host name route to www.dovecot.nl They is no direct access to it via HTTP/FTP? > > The automatic package builder Xi has moved to system within the > Dovecot infrastructure. This also means that the repositories are > available at a new host name: xi.dovecot.fi. The old host name still > works and is a CNAME pointing to the new venue. I expect the old > domain to be active for years to come. So, there is no need to update > your /etc/apt/sources.list right away. Still, it is a good idea to do > so. I've updated the wiki accordingly. > > Regards, > > Stephan. > _______________________________________________ > Dovecot-news mailing list > Dovecot-news at dovecot.org > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot-news From stephan at rename-it.nl Thu Mar 17 14:39:39 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 17 Mar 2016 15:39:39 +0100 Subject: [Dovecot-news] Xi has a new home In-Reply-To: <56EABA99.3000003@metropolitancollege.co.za> References: <56EAB355.5070801@rename-it.nl> <56EABA99.3000003@metropolitancollege.co.za> Message-ID: <56EAC1AB.3040503@rename-it.nl> Op 17-3-2016 om 15:09 schreef Eric Kom: > > On 2016/03/17 3:38 PM, Stephan Bosch wrote: >> Hi, > Good day dear, > Thanks for the UPDATE. > The xi.dovecot.fi host name route to www.dovecot.nl > They is no direct access to it via HTTP/FTP? Xi has no main page, so it redirects to the dovecot community website. The repositories are - as always - available under http://xi.dovecot.fi/debian. There is no FTP access. The wiki has all the information you need. Regards, Stephan. >> The automatic package builder Xi has moved to system within the >> Dovecot infrastructure. This also means that the repositories are >> available at a new host name: xi.dovecot.fi. The old host name still >> works and is a CNAME pointing to the new venue. I expect the old >> domain to be active for years to come. So, there is no need to update >> your /etc/apt/sources.list right away. Still, it is a good idea to do >> so. I've updated the wiki accordingly. >> >> Regards, >> >> Stephan. >> _______________________________________________ >> Dovecot-news mailing list >> Dovecot-news at dovecot.org >> http://dovecot.org/cgi-bin/mailman/listinfo/dovecot-news From pch at myzel.net Thu Mar 17 14:41:26 2016 From: pch at myzel.net (Peter Chiochetti) Date: Thu, 17 Mar 2016 15:41:26 +0100 Subject: [Dovecot-news] Xi has a new home In-Reply-To: <56EABA99.3000003@metropolitancollege.co.za> References: <56EAB355.5070801@rename-it.nl> <56EABA99.3000003@metropolitancollege.co.za> Message-ID: <56EAC216.5000109@myzel.net> Am 2016-03-17 um 15:09 schrieb Eric Kom: > On 2016/03/17 3:38 PM, Stephan Bosch wrote: >> Hi, > Good day dear, > Thanks for the UPDATE. > The xi.dovecot.fi host name route to www.dovecot.nl > They is no direct access to it via HTTP/FTP? Something is there http://xi.dovecot.fi/debian/ Sadly, no http://xi.dovecot.fi/ubuntu/ - I guess that will be on opensuse -- peter From sergey.schwartz at bgoperator.com Thu Mar 17 14:57:57 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Thu, 17 Mar 2016 17:57:57 +0300 Subject: [Dovecot-news] Xi has a new home In-Reply-To: <56EAC216.5000109@myzel.net> References: <56EAB355.5070801@rename-it.nl> <56EABA99.3000003@metropolitancollege.co.za> <56EAC216.5000109@myzel.net> Message-ID: <56EAC5F5.6090504@bgoperator.com> Peter, I use the same repo for both debian jessie and ubuntu trusty without any issues. Though I migrate my servers from ubuntu to debian because it feels rock solid :) Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com 17.03.2016 17:41, Peter Chiochetti ?????: > Am 2016-03-17 um 15:09 schrieb Eric Kom: >> On 2016/03/17 3:38 PM, Stephan Bosch wrote: >>> Hi, >> Good day dear, >> Thanks for the UPDATE. >> The xi.dovecot.fi host name route to www.dovecot.nl >> They is no direct access to it via HTTP/FTP? > > Something is there http://xi.dovecot.fi/debian/ > > Sadly, no http://xi.dovecot.fi/ubuntu/ - I guess that will be on opensuse > From erickom at metropolitancollege.co.za Thu Mar 17 16:12:02 2016 From: erickom at metropolitancollege.co.za (Eric Kom) Date: Thu, 17 Mar 2016 18:12:02 +0200 Subject: [Dovecot-news] Xi has a new home In-Reply-To: <56EAC1AB.3040503@rename-it.nl> References: <56EAB355.5070801@rename-it.nl> <56EABA99.3000003@metropolitancollege.co.za> <56EAC1AB.3040503@rename-it.nl> Message-ID: <56EAD752.4040604@metropolitancollege.co.za> On 17/03/2016 16:39, Stephan Bosch wrote: > > > Op 17-3-2016 om 15:09 schreef Eric Kom: >> >> On 2016/03/17 3:38 PM, Stephan Bosch wrote: >>> Hi, >> Good day dear, >> Thanks for the UPDATE. >> The xi.dovecot.fi host name route to www.dovecot.nl >> They is no direct access to it via HTTP/FTP? > > Xi has no main page, so it redirects to the dovecot community website. > The repositories are - as always - available under > http://xi.dovecot.fi/debian. There is no FTP access. > Thanks for the update > The wiki has all the information you need. > > Regards, > > Stephan. > >>> The automatic package builder Xi has moved to system within the >>> Dovecot infrastructure. This also means that the repositories are >>> available at a new host name: xi.dovecot.fi. The old host name still >>> works and is a CNAME pointing to the new venue. I expect the old >>> domain to be active for years to come. So, there is no need to update >>> your /etc/apt/sources.list right away. Still, it is a good idea to do >>> so. I've updated the wiki accordingly. >>> >>> Regards, >>> >>> Stephan. >>> _______________________________________________ >>> Dovecot-news mailing list >>> Dovecot-news at dovecot.org >>> http://dovecot.org/cgi-bin/mailman/listinfo/dovecot-news > From trashcan at ellael.org Thu Mar 17 16:51:35 2016 From: trashcan at ellael.org (Michael Grimm) Date: Thu, 17 Mar 2016 17:51:35 +0100 Subject: Looking for way to monitor dsync, confirm it is or isn't running In-Reply-To: <3qNlmt410DzZ4VQL@pigeon.richw.org> References: <3qMDf45HV4zZ4VJr@pigeon.richw.org> <78164538-D4AA-47EF-93A6-8D406B3AB46B@ellael.org> <3qNlmt410DzZ4VQL@pigeon.richw.org> Message-ID: <5C82B9F6-F6A4-41C2-A71B-050853CC98B6@ellael.org> Rich Wales wrote: > As a followup question: If "doveadm replicator status" shows problems, > are there any commands available to pinpoint exactly which request(s) > is/are causing the problem(s)? Not to my knowledge. > One of the sites I am administering, for example, has been reporting > 1 "queued 'full resync' requests" and 9 "waiting 'failed' requests" for > the past couple of days. But I have no idea how to resolve the issue. > Suggestions welcome. Normally those messages do not persist for days at my site; I do only see them for an hour, longest. That hour may coincide with my setting: replication_full_sync_interval = 1 hours But that is a guess of mine, I do not know enough about replicator to answer your questions. Others should jump in here. Anyway: Did you try "doveadm -D replicator replicate '*'"? Regards, Michael From joliver at john-oliver.net Thu Mar 17 17:18:47 2016 From: joliver at john-oliver.net (John Oliver) Date: Thu, 17 Mar 2016 10:18:47 -0700 Subject: TLS handshake issue Message-ID: <20160317171847.GA14328@ns2.sdsitehosting.net> dovecot-2.0.9 on CentOS 6.7 The system in question is not connected to the Internet, so I can't copy-and-paste. I have to type anything required :-( Brand-new out-of-the-box install with a really minimal dovecot.conf including: service imap-login { inet_listener imaps { address = 192.168.1.10 port = 143 ssl = yes } } ssl_cert= References: <20160317171847.GA14328@ns2.sdsitehosting.net> Message-ID: On Thu, Mar 17, 2016 at 8:18 PM, John Oliver wrote: > dovecot-2.0.9 on CentOS 6.7 > > The system in question is not connected to the Internet, so I can't > copy-and-paste. I have to type anything required :-( > > Brand-new out-of-the-box install with a really minimal dovecot.conf > including: > > service imap-login { > inet_listener imaps { > address = 192.168.1.10 > port = 143 > ssl = yes > } > } > > ssl_cert= ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL > ssl_key = > > That's very, very similar to an existing dovecot server on an old VM I > need to replace. Certs are self-signed, I know that's a horrible thing > to do, but right now we don't have any choice. I'm connecting with > Apple Mail 8.2 running on OS X 10.10.5, another thing we have no choice > about :-/ The Apple Mail just sits there stupidly. It's "Connection > Doctor" just helpfully reports that it can't establish a connection. I > can use 'openssl s_client -showcerts -connect mail:143' and see what I > expect to see. The dovecot log with lots of verbosity enabled tells me: > > imap-login: Info: Disconnected (no auth attempts): rip=192.168.1.200, > lip=192.168.1.10, TLS handshaking: Disconnected > auth: Debug: auth client connected (pid=21006) > imap-login: Warning: SSL: where=0x10, ret=1: before/accept > initialization [192.168.1.200] > imap-login: Warning: SSL: where=0x2001, ret=1: before/accept > initialization [192.168.1.200] > imap-login: Warning: SSL: where=0x2002, ret=1: SSLv2/v3 read client > hello A [192.168.1.200] > > > And that's it... those lines get repeated every minute that Mail is > running. I'm not seeing anything in any logs that even hints at what > it's unhappy about, or any way to increase verbosity any more. > > Any hints appreciated! > > -- > *********************************************************************** > * John Oliver http://www.john-oliver.net/ * > * * > *********************************************************************** May be use -starttls imap or 993 port and more logs verbose_ssl=yes From joliver at john-oliver.net Thu Mar 17 18:11:42 2016 From: joliver at john-oliver.net (John Oliver) Date: Thu, 17 Mar 2016 11:11:42 -0700 Subject: TLS handshake issue In-Reply-To: References: <20160317171847.GA14328@ns2.sdsitehosting.net> Message-ID: <20160317181142.GB14328@ns2.sdsitehosting.net> On Thu, Mar 17, 2016 at 08:30:32PM +0300, Andrey Fesenko wrote: > May be use -starttls imap or 993 port and more logs verbose_ssl=yes I am using verbose_ssl = yes Dovecot is currently working with SSL on 143, and I'm trying to not change current client config. As for '-starttls', in what context? -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * *********************************************************************** From aki.tuomi at dovecot.fi Thu Mar 17 18:38:55 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 17 Mar 2016 20:38:55 +0200 Subject: VS: Re: TLS handshake issue Message-ID: openssl s_client -connect host:143 -starttls imap? ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: John Oliver P?iv?m??r?: 17.3.2016 20.11 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: TLS handshake issue On Thu, Mar 17, 2016 at 08:30:32PM +0300, Andrey Fesenko wrote: > May be use -starttls imap or 993 port and more logs verbose_ssl=yes I am using verbose_ssl = yes Dovecot is currently working with SSL on 143, and I'm trying to not change current client config. As for '-starttls', in what context? -- *********************************************************************** * John Oliver???????????????????????????? http://www.john-oliver.net/ * *???????????????????????????????????????????????????????????????????? * *********************************************************************** From jtolbert at illinois.edu Thu Mar 17 19:04:10 2016 From: jtolbert at illinois.edu (Tolbert, Joshua P) Date: Thu, 17 Mar 2016 19:04:10 +0000 Subject: Trouble getting vnd.dovecot.filter and filter visible/usable... Message-ID: Hello, I?m trying to make vnd.dovecot.filter available both globally and for users through sieve, but I haven?t had much luck getting things to work right. Sieve scripts won?t validate and vnd.dovecot.filter never shows up in the managesieve capability list. I?ve spent lots of time looking for where problems could be, but I?m out of ideas?So I?m asking you guys. In the protocol lmtp section, I?m defining mail_plugins = $mail_plugins sieve, however I?ve tried it without $mail_plugins too?No luck that way either. Any help/advice would be much appreciated. Thanks! Cheers, Josh -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: From joliver at john-oliver.net Thu Mar 17 19:45:45 2016 From: joliver at john-oliver.net (John Oliver) Date: Thu, 17 Mar 2016 12:45:45 -0700 Subject: VS: Re: TLS handshake issue In-Reply-To: References: Message-ID: <20160317194545.GC14328@ns2.sdsitehosting.net> On Thu, Mar 17, 2016 at 08:38:55PM +0200, Aki Tuomi wrote: > openssl s_client -connect host:143 -starttls imap? Why? 'openssl' works just fine, it shows me the certificate and the IMAP banner, and I can log in and list mail. -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * *********************************************************************** From ronleach at tesco.net Thu Mar 17 20:04:26 2016 From: ronleach at tesco.net (Ron Leach) Date: Thu, 17 Mar 2016 20:04:26 +0000 Subject: TLS handshake issue In-Reply-To: <20160317171847.GA14328@ns2.sdsitehosting.net> References: <20160317171847.GA14328@ns2.sdsitehosting.net> Message-ID: <56EB0DCA.8030006@tesco.net> On 17/03/2016 17:18, John Oliver wrote: > The dovecot log with lots of verbosity enabled tells me: > > imap-login: Info: Disconnected (no auth attempts): rip=192.168.1.200, > lip=192.168.1.10, TLS handshaking: Disconnected 'no auth attempts' has been reported on the list a few times before and, in some cases, it means what it says - the MUA made no attempt to authenticate with username and password. I think authentication is a different activity from setting up an encrypted comms channel. Two ideas: Is the MUA set up to use a login? And, as part of the secure connection, is the MUA setup to use 'starttls'? hth Ron From joliver at john-oliver.net Thu Mar 17 20:56:22 2016 From: joliver at john-oliver.net (John Oliver) Date: Thu, 17 Mar 2016 13:56:22 -0700 Subject: TLS handshake issue In-Reply-To: <56EB0DCA.8030006@tesco.net> References: <20160317171847.GA14328@ns2.sdsitehosting.net> <56EB0DCA.8030006@tesco.net> Message-ID: <20160317205622.GD14328@ns2.sdsitehosting.net> On Thu, Mar 17, 2016 at 08:04:26PM +0000, Ron Leach wrote: > On 17/03/2016 17:18, John Oliver wrote: > >The dovecot log with lots of verbosity enabled tells me: > > > >imap-login: Info: Disconnected (no auth attempts): rip=192.168.1.200, > >lip=192.168.1.10, TLS handshaking: Disconnected > > > 'no auth attempts' has been reported on the list a few times before > and, in some cases, it means what it says - the MUA made no attempt > to authenticate with username and password. I think authentication is > a different activity from setting up an encrypted comms channel. > > Two ideas: > > Is the MUA set up to use a login? > > And, as part of the secure connection, is the MUA setup to use 'starttls'? Unfortunately, as the MUA is Apple Mail, that answer is hard to determine. Have I configured a login? Sure. have I checked "Use SSL"? Yup. Do those settings mean anything? Who knows? With our old mail server, it "just works"... after going through the mail setup, we don't need to do anything fancy. I can't help but imagine that there's some other difference in the default configs. I'll have to dump the configs of both and do a diff and hope there aren't so many differences I can't pick out what may be relevant here... -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * *********************************************************************** From stephan at rename-it.nl Thu Mar 17 20:59:22 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 17 Mar 2016 21:59:22 +0100 Subject: Trouble getting vnd.dovecot.filter and filter visible/usable... In-Reply-To: References: Message-ID: <56EB1AAA.3070106@rename-it.nl> Op 3/17/2016 om 8:04 PM schreef Tolbert, Joshua P: > Hello, > > I?m trying to make vnd.dovecot.filter available both globally and for users through sieve, but I haven?t had much luck getting things to work right. Sieve scripts won?t validate and vnd.dovecot.filter never shows up in the managesieve capability list. I?ve spent lots of time looking for where problems could be, but I?m out of ideas?So I?m asking you guys. > > In the protocol lmtp section, I?m defining mail_plugins = $mail_plugins sieve, however I?ve tried it without $mail_plugins too?No luck that way either. > > Any help/advice would be much appreciated. Thanks! Then don't put it in sieve_global_extensions. That setting overrides the sieve_extensions setting and restricts all listed extensions to global context only; this way these extensions are only available from sieve_before, sieve_after, and sieve_global Sieve scripts. User scripts will not accept it in that case. Regards, Stephan From jtolbert at illinois.edu Thu Mar 17 21:04:16 2016 From: jtolbert at illinois.edu (Tolbert, Joshua P) Date: Thu, 17 Mar 2016 21:04:16 +0000 Subject: Trouble getting vnd.dovecot.filter and filter visible/usable... In-Reply-To: <56EB1AAA.3070106@rename-it.nl> References: <56EB1AAA.3070106@rename-it.nl> Message-ID: Hi Stephan, I?ll be damned, that was it. I figured it was something simple I was overlooking. Reading the description of sieve_global_extensions again, it makes sense now. Thanks again. Cheers, Josh On 3/17/16, 3:59 PM, "Stephan Bosch" wrote: >Op 3/17/2016 om 8:04 PM schreef Tolbert, Joshua P: >> Hello, >> >> I?m trying to make vnd.dovecot.filter available both globally and for >>users through sieve, but I haven?t had much luck getting things to work >>right. Sieve scripts won?t validate and vnd.dovecot.filter never shows >>up in the managesieve capability list. I?ve spent lots of time looking >>for where problems could be, but I?m out of ideas?So I?m asking you guys. >> >> In the protocol lmtp section, I?m defining mail_plugins = $mail_plugins >>sieve, however I?ve tried it without $mail_plugins too?No luck that way >>either. >> >> Any help/advice would be much appreciated. Thanks! > >Then don't put it in sieve_global_extensions. That setting overrides the >sieve_extensions setting and restricts all listed extensions to global >context only; this way these extensions are only available from >sieve_before, sieve_after, and sieve_global Sieve scripts. User scripts >will not accept it in that case. > >Regards, > >Stephan From stephan at rename-it.nl Fri Mar 18 00:08:30 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 18 Mar 2016 01:08:30 +0100 Subject: Released Pigeonhole v0.4.13 for Dovecot v2.2.22. Message-ID: <56EB46FE.8050304@rename-it.nl> Hello Dovecot users, Here is the final v0.4.13 release of Pigeonhole for Dovecot v2.2.22. Nothing changed since the RC. Changelog v0.4.13: * redirect action: Added the list-id header to the duplicate ID for mail loop prevention. This means that the message sent directly to the user and the message coming through the mailing list itself are treated as different messages by the loop detection of the redirect command, even though their Message-ID may be identical. * Changed the Sieve number type to uint64_t, which means that Sieve numbers can now technically range up to 2^64. Some other Sieve implementation allowed this, making this change necessary for successful migration. + Implemented the sieve_implicit_extensions setting. The extensions listed in this setting do not need to be enabled explicitly using the Sieve "require" command. This behavior directkly violates the standard, but can be necessary for compatibility with some existing implementations of Sieve. Do not use this setting unless you really need to! - redirect action: Made mail loop detection more robust by forcibly adding a Message-ID header if it is missing. - Prevent logging a useless "script not found" error message for LDAP scripts for which the entry exists but no attribute containing a script. This is not necessarily an error. - extprograms plugin: Changed the communication channel between parent and child process for a directly forked program from a socketpair to a double pipe. Linux does not support /dev/stdin, /dev/stdout and friends for sockets. For some shell program authors this may be confusing, so that is why it is changed. When using the script service, these device nodes are still not usable though. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.13.tar.gz http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.13.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From aki.tuomi at dovecot.fi Fri Mar 18 06:05:38 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 18 Mar 2016 08:05:38 +0200 Subject: VS: Re: VS: Re: TLS handshake issue Message-ID: Most applications would expect to see nonencrypted imap reply in 143 and would use starttls to engage ssl ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: John Oliver P?iv?m??r?: 17.3.2016 21.45 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: VS: Re: TLS handshake issue On Thu, Mar 17, 2016 at 08:38:55PM +0200, Aki Tuomi wrote: > openssl s_client -connect host:143 -starttls imap? Why?? 'openssl' works just fine, it shows me the certificate and the IMAP banner, and I can log in and list mail. -- *********************************************************************** * John Oliver???????????????????????????? http://www.john-oliver.net/ * *???????????????????????????????????????????????????????????????????? * *********************************************************************** From skdovecot at smail.inf.fh-brs.de Fri Mar 18 07:11:56 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 18 Mar 2016 08:11:56 +0100 (CET) Subject: lmtp timeout, locks and crashes In-Reply-To: <07bf8ef0ab5d81ce691fef7e724c937a@tomsommer.dk> References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> <50aa6f75cac931e0d15a6be80b3840b6@tomsommer.dk> <07bf8ef0ab5d81ce691fef7e724c937a@tomsommer.dk> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 17 Mar 2016, Tom Sommer wrote: > On 2016-03-17 13:41, Tom Sommer wrote: >> On 2016-03-15 10:53, Tom Sommer wrote: >>> I'm seeing some problems on accounts which get a lot of spam (like, a >>> lot). >> >> I did an "strace" on one of the hundreds of lmtp processes. >> >> It's doing stat() on all files in the new folder for the receiver: >> >> stat("/var/mail/dovecot/xxxx/xxxx/new/xx.xxx.xxxx.xxxx.com", >> {st_mode=S_IFREG|0600, st_size=15505, ...}) = 0 >> >> etc. >> >> The "new" folder contains hundreds of thousands of files. >> >> Is there any way to prevent all these stat() calls? It seems like >> something there would be an index or cache for? > > Seems like it might be due to maildir quota-recalculation? Yes possibly. But also in order to update the index files. For all I know this should happen only, if the mtime of the directory changes. Is there some external programm manipulating files in the new/cur directories bypassing Dovecot? E.g. a rm on command line? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVuuqPHz1H7kL/d9rAQIEFggAmwDF11PTTIUOZ66udkcfxjZ944MvFBE0 I5jgSe/qRwSchfPE/leyc15uEC477YdJavbOv8TtsdZQVgUcWZgM7Wdtn0iCNWsT LttwfEp2Ft0swdtwE5948Swt2P99UHi6KVC7XkOHm/uH8O3zLRNMo8h04IYkwhV+ zCz0FAEF57opFATpoJ1VPJE01PslKBEo5sublCaA2c35kE0ukDnNOsocJkiIw8+t ax85THVWFjIv2ybBbjYIIYFipkIo1vxzYaxfKnrLg9OdbUPceVaL0yL/WXm44wP7 Yoouoh+42E8jDvCHSCWmyBjXUw0CvmKExMSwigwNYYYhabCpYmEctg== =LQdS -----END PGP SIGNATURE----- From erickom at metropolitancollege.co.za Fri Mar 18 08:06:30 2016 From: erickom at metropolitancollege.co.za (Eric Kom) Date: Fri, 18 Mar 2016 10:06:30 +0200 Subject: Dovecot LDA with OpenSMTPD Message-ID: <56EBB706.3050305@metropolitancollege.co.za> Good day, Can any one help on how to get Dovecot LDA work with OpenSMTPD? From ekrava at hell.org.ua Fri Mar 18 08:20:06 2016 From: ekrava at hell.org.ua (Eugene V. Kravtsoff) Date: Fri, 18 Mar 2016 10:20:06 +0200 Subject: Dovecot LDA with OpenSMTPD In-Reply-To: <56EBB706.3050305@metropolitancollege.co.za> References: <56EBB706.3050305@metropolitancollege.co.za> Message-ID: <390f2f0da9efab0f2f3e25ffe7106461@hell.org.ua> read doc keywords opensmtpd "deliver to lmtp" and dovecot LMTP 18-03-2016 10:06, Eric Kom ???????: > Good day, > Can any one help on how to get Dovecot LDA work with OpenSMTPD? -- With best regards, Eugene V. Kravtsoff From jerry at seibercom.net Fri Mar 18 10:52:12 2016 From: jerry at seibercom.net (Jerry) Date: Fri, 18 Mar 2016 06:52:12 -0400 Subject: TLS handshake issue In-Reply-To: <20160317205622.GD14328@ns2.sdsitehosting.net> References: <20160317171847.GA14328@ns2.sdsitehosting.net> <56EB0DCA.8030006@tesco.net> <20160317205622.GD14328@ns2.sdsitehosting.net> Message-ID: <20160318065212.0000553a@seibercom.net> On Thu, 17 Mar 2016 13:56:22 -0700, John Oliver replied: > With our old mail server, it "just works"... after going through the > mail setup, we don't need to do anything fancy. I can't help but > imagine that there's some other difference in the default configs. > I'll have to dump the configs of both and do a diff and hope there > aren't so many differences I can't pick out what may be relevant > here... Could you post the unobfuscated output of "dovecot -n" so we can see what your actual configuration is? -- Jerry From jerry at seibercom.net Fri Mar 18 13:50:14 2016 From: jerry at seibercom.net (Jerry) Date: Fri, 18 Mar 2016 09:50:14 -0400 Subject: Dumb question: dovecot include file Message-ID: <20160318095014.000046ea@seibercom.net> Dovecot has an include file option. What I am not sure of is why those files use both a *.conf and *.conf.ext extension. I assume both types are included by using the !include .conf or !include .conf.ext syntax. -- Jerry From noel.butler at ausics.net Sat Mar 19 07:37:04 2016 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 19 Mar 2016 17:37:04 +1000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160314094946.a5d95f0a.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> <20160314005937.989a9f2e.skraw@ithnet.com> <20160314094946.a5d95f0a.skraw@ithnet.com> Message-ID: On 14/03/2016 18:49, Stephan von Krawczynski wrote: > >> >> and you've never seen these cause problems with FS? then you must be >> a >> newbie, in over 25 years I've seen it happen several times - yes even >> after an apparent controlled shutdown. > > Maybe you're doing something wrong then. because in my last 21 years > working > exactly in this business I've not seen a single deadly fs-crash because > of a > power-outage. Not one. And we had of course several, all backed by UPS. Consider yourself lucky, Most network admins whove been around large busy ISP DC's have seen this in their lifetime, to not have seen one is rare, go buy yourself a lotto ticket :) > > If your servers get drowned with water during a fire your fs is > probably the > least of your worries. You don't really plan to re-enable servers with > water- or fire-damage, do you? That's probably why there shouldn't be a > fireman pouring water in the first place. This shows you dont understand structural engineering, the fire does not have to be on your floor, it can be far away as two or so levels above, with the high pressure water used - equating to a shitload of water, there are ducts, shafts, other risers and so on that with a shit-tone of water can easily penetrate fireblocks of floors below - dont take my work, go ask a fireman, or maybe watch the nightly news sometime (building fire - many levels water affected blah blah blah)... so keeping those boxes on via UPS's is asking for lots of charcoaled boards and fried drives. IOW, total stupidity. Should those machines be depowered as required by our building codes, well, might take a few days of drying out but at least they will power back up without error - yes, done it in risk assessments. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From adrian.minta at gmail.com Sat Mar 19 08:05:53 2016 From: adrian.minta at gmail.com (Adrian Minta) Date: Sat, 19 Mar 2016 10:05:53 +0200 Subject: poppassd Message-ID: <56ED0861.2060407@gmail.com> Hello, does anyone of you knows a poppassd implementation compatible with dovecot mysql or ldap backends ? -- Best regards, Adrian Minta From skraw at ithnet.com Sat Mar 19 08:11:31 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Sat, 19 Mar 2016 09:11:31 +0100 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> <20160314005937.989a9f2e.skraw@ithnet.com> <20160314094946.a5d95f0a.skraw@ithnet.com> Message-ID: <20160319091131.2a24b0e6.skraw@ithnet.com> On Sat, 19 Mar 2016 17:37:04 +1000 Noel Butler wrote: > On 14/03/2016 18:49, Stephan von Krawczynski wrote: > > > >> > >> and you've never seen these cause problems with FS? then you must be > >> a > >> newbie, in over 25 years I've seen it happen several times - yes even > >> after an apparent controlled shutdown. > > > > Maybe you're doing something wrong then. because in my last 21 years > > working > > exactly in this business I've not seen a single deadly fs-crash because > > of a > > power-outage. Not one. And we had of course several, all backed by UPS. > > Consider yourself lucky, Most network admins whove been around large > busy ISP DC's have seen this in their lifetime, to not have seen one is > rare, go buy yourself a lotto ticket :) > > > > > If your servers get drowned with water during a fire your fs is > > probably the > > least of your worries. You don't really plan to re-enable servers with > > water- or fire-damage, do you? That's probably why there shouldn't be a > > fireman pouring water in the first place. > > This shows you dont understand structural engineering, the fire does not > have to be on your floor, it can be far away as two or so levels above, > with the high pressure water used - equating to a shitload of water, > there are ducts, shafts, other risers and so on that with a shit-tone of > water can easily penetrate fireblocks of floors below - dont take my > work, go ask a fireman, or maybe watch the nightly news sometime > (building fire - many levels water affected blah blah blah)... so > keeping those boxes on via UPS's is asking for lots of charcoaled boards > and fried drives. IOW, total stupidity. > > Should those machines be depowered as required by our building codes, > well, might take a few days of drying out but at least they will power > back up without error - yes, done it in risk assessments. Obviously you must work for people that have not the slightest idea about using hardware in a correct way and don't know when the time has come to throw it away. Man, there is no way to let a drowned box survive. It is not back to normal when it is dry. If you don't get that I am pretty happy to be no customer. This can only be an idea born in the sick mind of a controller who didn't want to pay insurance in the first place. We are talking about serious corrosion effects here let alone that you have a hard time even knowning when your boxes are really dry. Your fireman on the other hand seem to be stuck in the 80ths. Today there are solar panels almost everywhere _which you cannot turn off_. Sure you have a switch somewhere, but it does not help you for the space between the switch and the roof (which can be a pretty long distance). Really, sorry, I don't want to listen to more horror stories from you operating drowned equipment. And in the end: considering your "large busy ISP DC's" they should have backup DCs located elsewhere with mirrored data, right? Lets please end that now and for all. -- Regards, Stephan From lista at xdrv.co.uk Sat Mar 19 11:48:10 2016 From: lista at xdrv.co.uk (James) Date: Sat, 19 Mar 2016 11:48:10 +0000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160319091131.2a24b0e6.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> <20160314005937.989a9f2e.skraw@ithnet.com> <20160314094946.a5d95f0a.skraw@ithnet.com> <20160319091131.2a24b0e6.skraw@ithnet.com> Message-ID: <56ED3C7A.6030306@xdrv.co.uk> On 19/03/2016 08:11, Stephan von Krawczynski wrote: > Obviously you must work for people that have not the slightest idea about > using hardware ... So you have UPSes, power supplies and motherboards that never fail. Good luck to you, you are running on it. For everyone else reading this, do not set sync off. If sync writes are taking 3 seconds, or more than a few milliseconds, there is something else that needs fixing. From jerry at seibercom.net Sat Mar 19 12:23:46 2016 From: jerry at seibercom.net (Jerry) Date: Sat, 19 Mar 2016 08:23:46 -0400 Subject: Problem configuring sieve Message-ID: <20160319082346.000030b7@seibercom.net> This is a fresh installation of dovecot on a FreeBSD 11 system. Trying to run the following command produces this error: sievec ./default.sieve sievec(root): Debug: Loading modules from directory: /usr/local/lib/dovecot sievec(root): Error: Couldn't load required plugin /usr/local/lib/dovecot/lib90_sieve_plugin.so: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're sievec) sievec(root): Fatal: Internal error occurred. Refer to server log for more information. *** Error code 89 This is my configuration: # 2.2.22 (fe789d2): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.12 (c1c0a23) # OS: FreeBSD 11.0-CURRENT amd64 zfs auth_mechanisms = plain login lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vmail/%d/gerard mail_plugins = sieve mail_save_crlf = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users/passwd driver = passwd-file } plugin { sieve_default = /usr/local/etc/dovecot/sieve/default.sieve } postmaster_address = postmaster at seibercom.net service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } ssl_cert = In case somebody find this useful: https://blog.jcea.es/posts/20160211-delete_users_dovecot.html -- Jes?s Cea Avi?n _/_/ _/_/_/ _/_/_/ jcea at jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea at jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: OpenPGP digital signature URL: From mail at tomsommer.dk Sat Mar 19 15:56:48 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Sat, 19 Mar 2016 16:56:48 +0100 Subject: Crash when setting quota = count:User quota Message-ID: <9da1dcec4437b97c58fc0bd7348a2d0e@tomsommer.dk> Mar 19 16:54:37 lmtp(xxxx at xxx.xxx): Panic: file file-lock.c: line 269: unreached Mar 19 16:54:37 lmtp(xxxx at xxx.xxx): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x35f647e07a] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647e0e6] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647d4ac] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f6481edf] -> /usr/lib/dovecot/libdovecot.so.0(file_wait_lock_error+0x3a) [0x35f648205a] -> /usr/lib/dovecot/libdovecot.so.0(file_try_lock_error+0x13) [0x35f6482123] -> /usr/lib/dovecot/libdovecot.so.0(file_create_locked+0x284) [0x35f647f7a4] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f6068ec4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_vsize_update_wait_lock+0xe) [0x35f6068f2e] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_virtual_size+0x3d) [0x35f606919d] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_metadata+0x321) [0x35f606fcd1] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f60485a0] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f60593ce] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x6e) [0x35f603404e] -> /usr/lib/dovecot/lib10_quota_plugin.so(quota_count+0xe7) [0x2b45f03b9417] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b45f03b94fb] -> /usr/lib/dovecot/lib10_quota_plugin.so(quota_get_resource+0x77) [0x2b45f03b74b7] -> /usr/lib/dovecot/lib10_quota_plugin.so(quota_test_alloc+0x191) [0x2b45f03b78f1] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b45f03bd5f5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x5e) [0x35f6032eae] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x66) [0x35f602ac26] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x56) [0x35f60435d6] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b45f03bd71d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x7a) [0x35f6032cea] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1ba) [0x35f680813a] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf3) [0x35f68084c3] -> dovecot/lmtp [DATA 172.0.0.0 xxxx at xxx.xxx] [0x40645c] -> dovecot/lmtp [DATA 172.0.0.0 xxxx at xxx.xxx] [0x406bd6] Only happens when I set "quota = count:User quota" -- Tom Sommer From mail at tomsommer.dk Sat Mar 19 15:57:50 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Sat, 19 Mar 2016 16:57:50 +0100 Subject: lmtp timeout, locks and crashes In-Reply-To: References: <5b32a3d83261bc022323afb9cab51c76@tomsommer.dk> <50aa6f75cac931e0d15a6be80b3840b6@tomsommer.dk> <07bf8ef0ab5d81ce691fef7e724c937a@tomsommer.dk> Message-ID: <5d6c15e96a5bc057f6b61653d2c30077@tomsommer.dk> On 2016-03-18 08:11, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 17 Mar 2016, Tom Sommer wrote: >> On 2016-03-17 13:41, Tom Sommer wrote: >>> On 2016-03-15 10:53, Tom Sommer wrote: >>>> I'm seeing some problems on accounts which get a lot of spam (like, >>>> a lot). >>> >>> I did an "strace" on one of the hundreds of lmtp processes. >>> >>> It's doing stat() on all files in the new folder for the receiver: >>> >>> stat("/var/mail/dovecot/xxxx/xxxx/new/xx.xxx.xxxx.xxxx.com", >>> {st_mode=S_IFREG|0600, st_size=15505, ...}) = 0 >>> >>> etc. >>> >>> The "new" folder contains hundreds of thousands of files. >>> >>> Is there any way to prevent all these stat() calls? It seems like >>> something there would be an index or cache for? >> >> Seems like it might be due to maildir quota-recalculation? > > Yes possibly. But also in order to update the index files. Seems the use of Maildir++ quota was the problem in this case. > For all I know this should happen only, if the mtime of the directory > changes. Is there some external programm manipulating files in the > new/cur directories bypassing Dovecot? E.g. a rm on command line? Nope // Tom From lists at wiesinger.com Sat Mar 19 16:13:35 2016 From: lists at wiesinger.com (Gerhard Wiesinger) Date: Sat, 19 Mar 2016 17:13:35 +0100 Subject: v2.2.22 released In-Reply-To: <20206AF5-247D-4DAF-9A41-0234A35DAAEA@iki.fi> References: <20206AF5-247D-4DAF-9A41-0234A35DAAEA@iki.fi> Message-ID: <56ED7AAF.1010101@wiesinger.com> On 16.03.2016 09:27, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.22.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.22.tar.gz.sig > > - Expunges were forgotten in some situations, for example when > pipelining multiple IMAP MOVE commands. > Ad Expunge: I'm using Thunderbird latest with Xpunge Addon: http://www.theodoretegos.net/mozilla/tb/index.html Since some time I'm having the problem that when I press "XPUNGE" I get the following error message: "Some folders (e.g. foldername) cannot be compacted because there is not enough free disk space. Please delete some files and try again." I was hoping it was fixed with 2.2.22. Diskspace is of course enough available (locally and on imap server), using Maildir. Anyone having the same issues or any ideas? Thnx. Ciao, Gerhard https://www.wiesinger.com/ From mail at tomsommer.dk Sat Mar 19 16:39:46 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Sat, 19 Mar 2016 17:39:46 +0100 Subject: Crash when setting quota = count:User quota In-Reply-To: <9da1dcec4437b97c58fc0bd7348a2d0e@tomsommer.dk> References: <9da1dcec4437b97c58fc0bd7348a2d0e@tomsommer.dk> Message-ID: Actually it also happens with just "quota_vsizes = true" Mar 19 17:37:55 lmtp(xxx at xxx.xx): Panic: file file-lock.c: line 269: unreached Mar 19 17:37:55 lmtp(xxx at xxxx.xxx): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x35f647e07a] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647e0e6] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647d4ac] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f6481edf] -> /usr/lib/dovecot/libdovecot.so.0(file_wait_lock_error+0x3a) [0x35f648205a] -> /usr/lib/dovecot/libdovecot.so.0(file_try_lock_error+0x13) [0x35f6482123] -> /usr/lib/dovecot/libdovecot.so.0(file_create_locked+0x284) [0x35f647f7a4] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f6068ec4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_vsize_update_wait_lock+0xe) [0x35f6068f2e] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_virtual_size+0x3d) [0x35f606919d] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_metadata+0x321) [0x35f606fcd1] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f60485a0] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f60593ce] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x6e) [0x35f603404e] -> /usr/lib/dovecot/lib10_quota_plugin.so(quota_count+0xe7) [0x2b3e7464c417] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b3e7464d89d] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b3e7464dba5] -> /usr/lib/dovecot/lib10_quota_plugin.so(quota_get_resource+0x77) [0x2b3e7464a4b7] -> /usr/lib/dovecot/lib10_quota_plugin.so(quota_test_alloc+0x191) [0x2b3e7464a8f1] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b3e746505f5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x5e) [0x35f6032eae] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x66) [0x35f602ac26] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x56) [0x35f60435d6] -> /usr/lib/dovecot/lib10_quota_plugin.so [0x2b3e7465071d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x7a) [0x35f6032cea] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1ba) [0x35f680813a] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf3) [0x35f68084c3] -> dovecot/lmtp [DATA 172.17.165.5 xxxx at xxxx.xx] [0x40645c] // Tom From aclindsa at gmail.com Fri Mar 18 21:58:44 2016 From: aclindsa at gmail.com (Aaron Lindsay) Date: Fri, 18 Mar 2016 17:58:44 -0400 Subject: Allowing for multiple recipient_delimiter characters? Message-ID: Postfix allows the recipient_delimiter configuration parameter to contain multiple characters, splitting on the first such character it encounters. For example, if using 'recipient_delimiter=+-' both aaron+foo at example.com and aaron-bar at example.com would be delivered to aaron at example.com. Is anyone opposed to changing dovecot's handling of recipient_delimiter so that it's the same as that of postfix? If not, I am willing to rebase/merge/address review comments on Lennart Weller's patch[1] to get this functionality upstream. While I think aligning with postfix' behaviour would be convenient for those of us who run a server using both dovecot and postfix, would this break any other common use cases I'm not aware of? Thanks! -Aaron [1] - http://dovecot.org/pipermail/dovecot/2015-February/099660.html (I've talked with Lennart off-list, and he's OK with me working to get his patch merged, as long as I attribute his work to him, but doesn't have the time to work on it himself right now) From at lbutlr Sat Mar 19 22:25:43 2016 From: at lbutlr ( at lbutlr) Date: Sat, 19 Mar 2016 16:25:43 -0600 Subject: dovecot-sieve in ports? Message-ID: <30CA89DA-C732-4411-AF12-72C67692FDA2@kreme.com> # portmaster mail/dovecot-sieve ===>>> The dependency for mail/dovecot seems to be handled by dovecot2-2.2.22 ===>>> Initial dependency check complete for mail/dovecot-sieve ===>>> Starting build for mail/dovecot-sieve <<<=== ===>>> All dependencies are up to date ===> Cleaning for dovecot-sieve-1.2+0.1.19_2 ===>>> Waiting on fetch & checksum for mail/dovecot-sieve <<<=== ===> License LGPL21 accepted by the user ===> dovecot-sieve-1.2+0.1.19_2 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by dovecot-sieve-1.2+0.1.19_2 for building ===> dovecot-1.2.17_6 conflicts with installed package(s): dovecot2-2.2.22 Sooo? Is dovecot-sieve for dovecot 1.x only? Or is the ports tree wonky? -- 2+2=5 for sufficiently large values of 2. From larryrtx at gmail.com Sat Mar 19 22:35:43 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Sat, 19 Mar 2016 17:35:43 -0500 Subject: dovecot-sieve in ports? In-Reply-To: <30CA89DA-C732-4411-AF12-72C67692FDA2@kreme.com> References: <30CA89DA-C732-4411-AF12-72C67692FDA2@kreme.com> Message-ID: mail/dovecot2-pigeonhole is what you wanr. Larry Rosenman maintainer On Sat, Mar 19, 2016 at 5:25 PM, @lbutlr wrote: > # portmaster mail/dovecot-sieve > > ===>>> The dependency for mail/dovecot > seems to be handled by dovecot2-2.2.22 > > ===>>> Initial dependency check complete for mail/dovecot-sieve > > > ===>>> Starting build for mail/dovecot-sieve <<<=== > > ===>>> All dependencies are up to date > > ===> Cleaning for dovecot-sieve-1.2+0.1.19_2 > ===>>> Waiting on fetch & checksum for mail/dovecot-sieve <<<=== > ===> License LGPL21 accepted by the user > ===> dovecot-sieve-1.2+0.1.19_2 depends on file: /usr/local/sbin/pkg - > found > ===> Fetching all distfiles required by dovecot-sieve-1.2+0.1.19_2 for > building > > ===> dovecot-1.2.17_6 conflicts with installed package(s): > dovecot2-2.2.22 > > Sooo? Is dovecot-sieve for dovecot 1.x only? Or is the ports tree wonky? > > -- > 2+2=5 for sufficiently large values of 2. > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 From kremels at kreme.com Sat Mar 19 23:35:28 2016 From: kremels at kreme.com (@lbutlr) Date: Sat, 19 Mar 2016 17:35:28 -0600 Subject: dovecot-sieve in ports? In-Reply-To: References: <30CA89DA-C732-4411-AF12-72C67692FDA2@kreme.com> Message-ID: On Mar 19, 2016, at 4:35 PM, Larry Rosenman wrote: > mail/dovecot2-pigeonhole is what you want. Thank you. -- "Alas, earwax." From marti1234 at gmail.com Sun Mar 20 05:58:35 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sun, 20 Mar 2016 05:58:35 +0000 Subject: Setting up public mailboxes - user not found In-Reply-To: <56EA6C59.9070507@cms.hu-berlin.de> References: <56E13567.3020201@cms.hu-berlin.de> <794E973B-D7CF-45B1-A3DD-15EED61D357B@gmail.com> <56EA6C59.9070507@cms.hu-berlin.de> Message-ID: <31136424-F888-4DB8-A601-8F44B362E6DD@gmail.com> Hey, I actually went with the method suggested by Steffen Kaiser of creating a separate userdb because I use LDAP and I have an OU which contains all the public mailboxes and was just easier. I setup the userdb like so: userdb { args = /etc/dovecot/dovecot-ldap-shared_mailboxes.conf.ext driver = ldap override_fields = mail=maildir:/home/vmail/Public/.%n } Now when I send an email to office3 at xxx.com I don?t get any errors and it delivers the message to the office3 at xxx.com: root at mail:~# ls /home/vmail/Public/.office3/new/ 1458427035.M781836P21781.mail.xxx.com,S=2571,W=2630 1458427705.M750112P23338.mail.xxx.com,S=2501,W=2559 But from any mail client I try I don?t seem to be able to list anything in the Public directory. Am I missing something in the configuration? Here is the public namespace configuration: namespace { list = yes location = maildir:/home/vmail/Public:INDEXPVT=~/Maildir/Public prefix = Public/ separator = / subscriptions = yes type = public } > On 17 Mar 2016, at 08:35, Burckhard Schmidt wrote: > > hello Marti, > > Am 17.03.2016 um 06:18 schrieb Marti Markov: >> First of all thanks for the reply Burckhard. >> When you say: >>> You can use a "normal" user who has a sieve script: > > Normal user that's an account with one or more email aliasses. > So this "user" can receive emails like any other user. This I called "normal" user. But this ist not of interest in our case. > So you don't get an "user not found". > > Next you will add an appropriate email alias to the account if necessary (our accounts are cryptic). > > Now you have an account/user and you can write a sieve script for that user to deliver all emails into one public folder or into different folders. Public subfolders are possible too, if you like or are able to distinguish incomming emails. > > In your case it is not necessary to have an user/account "office3". This name you would only use in that sieve script with "fileinto". > > Regards! > > Burckhard > >> what would that user be in my case? office3? Because I don?t really see how it will solve the problem of getting the error 550 user not found when making the LDAP search. >> >>> On 10 Mar 2016, at 08:50, Burckhard Schmidt wrote: >>> >>> Am 09.03.2016 um 20:02 schrieb Marti Markov: >>>> Hi all, >>>> >>>> This is the first time I use the dovecot mail list so I?m sorry if I forget something. >>>> >>>> My problem is that for some reason I can get public mailboxes to work. I have setup the directory Public, the folders and the cur,tmp and new folder in them: >>>> >>>> Public >>>> | >>>> |- .office3 >>>> | >>>> |- cur >>>> |- tmp >>>> |- new >>>> |- dovecot-acl >>>> >>>> >>>> Here is my dovecot conf: >>>> >>> >>>> namespace { >>>> list = yes >>>> location = maildir:/home/vmail/xxx.com/Public:INDEXPVT=~/Maildir/Public >>>> prefix = Public/ >>>> separator = / >>>> subscriptions = yes >>>> type = public >>>> } >>> >>> You can use a "normal" user who has a sieve script: >>> require ... >>> any filter if necessary >>> fileinto "Public"; >>> discard; >>> ... >>> >>> "Public" is your prefix >>> I have several subfolder so I use: fileinto "Public/subfolder1"; >>> >>> You would have >>> /home/vmail/xxx.com/Public/subfolder1 >>> with cur new tmp >>> and a file "dovecot-acl" containing anyone lrs >>> >>> -- >>> Burckhard Schmidt >> > > > -- > Mit freundlichen Gr??en --- Burckhard Schmidt > > Abteilung Systemsoftware und Kommunikation > ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin > Postanschrift: Unter den Linden 6, 10099 Berlin > Standort: Rudower Chaussee 26; 12489 Berlin > Tel.: +49-30-2093-70058 Fax: +49-30-2093-70199 > Mail: bschmidt at cms.hu-berlin.de From marti1234 at gmail.com Sun Mar 20 05:58:35 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sun, 20 Mar 2016 05:58:35 +0000 Subject: Setting up public mailboxes - user not found In-Reply-To: <56EA6C59.9070507@cms.hu-berlin.de> References: <56E13567.3020201@cms.hu-berlin.de> <794E973B-D7CF-45B1-A3DD-15EED61D357B@gmail.com> <56EA6C59.9070507@cms.hu-berlin.de> Message-ID: <31136424-F888-4DB8-A601-8F44B362E6DD@gmail.com> Hey, I actually went with the method suggested by Steffen Kaiser of creating a separate userdb because I use LDAP and I have an OU which contains all the public mailboxes and was just easier. I setup the userdb like so: userdb { args = /etc/dovecot/dovecot-ldap-shared_mailboxes.conf.ext driver = ldap override_fields = mail=maildir:/home/vmail/Public/.%n } Now when I send an email to office3 at xxx.com I don?t get any errors and it delivers the message to the office3 at xxx.com: root at mail:~# ls /home/vmail/Public/.office3/new/ 1458427035.M781836P21781.mail.xxx.com,S=2571,W=2630 1458427705.M750112P23338.mail.xxx.com,S=2501,W=2559 But from any mail client I try I don?t seem to be able to list anything in the Public directory. Am I missing something in the configuration? Here is the public namespace configuration: namespace { list = yes location = maildir:/home/vmail/Public:INDEXPVT=~/Maildir/Public prefix = Public/ separator = / subscriptions = yes type = public } > On 17 Mar 2016, at 08:35, Burckhard Schmidt wrote: > > hello Marti, > > Am 17.03.2016 um 06:18 schrieb Marti Markov: >> First of all thanks for the reply Burckhard. >> When you say: >>> You can use a "normal" user who has a sieve script: > > Normal user that's an account with one or more email aliasses. > So this "user" can receive emails like any other user. This I called "normal" user. But this ist not of interest in our case. > So you don't get an "user not found". > > Next you will add an appropriate email alias to the account if necessary (our accounts are cryptic). > > Now you have an account/user and you can write a sieve script for that user to deliver all emails into one public folder or into different folders. Public subfolders are possible too, if you like or are able to distinguish incomming emails. > > In your case it is not necessary to have an user/account "office3". This name you would only use in that sieve script with "fileinto". > > Regards! > > Burckhard > >> what would that user be in my case? office3? Because I don?t really see how it will solve the problem of getting the error 550 user not found when making the LDAP search. >> >>> On 10 Mar 2016, at 08:50, Burckhard Schmidt wrote: >>> >>> Am 09.03.2016 um 20:02 schrieb Marti Markov: >>>> Hi all, >>>> >>>> This is the first time I use the dovecot mail list so I?m sorry if I forget something. >>>> >>>> My problem is that for some reason I can get public mailboxes to work. I have setup the directory Public, the folders and the cur,tmp and new folder in them: >>>> >>>> Public >>>> | >>>> |- .office3 >>>> | >>>> |- cur >>>> |- tmp >>>> |- new >>>> |- dovecot-acl >>>> >>>> >>>> Here is my dovecot conf: >>>> >>> >>>> namespace { >>>> list = yes >>>> location = maildir:/home/vmail/xxx.com/Public:INDEXPVT=~/Maildir/Public >>>> prefix = Public/ >>>> separator = / >>>> subscriptions = yes >>>> type = public >>>> } >>> >>> You can use a "normal" user who has a sieve script: >>> require ... >>> any filter if necessary >>> fileinto "Public"; >>> discard; >>> ... >>> >>> "Public" is your prefix >>> I have several subfolder so I use: fileinto "Public/subfolder1"; >>> >>> You would have >>> /home/vmail/xxx.com/Public/subfolder1 >>> with cur new tmp >>> and a file "dovecot-acl" containing anyone lrs >>> >>> -- >>> Burckhard Schmidt >> > > > -- > Mit freundlichen Gr??en --- Burckhard Schmidt > > Abteilung Systemsoftware und Kommunikation > ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin > Postanschrift: Unter den Linden 6, 10099 Berlin > Standort: Rudower Chaussee 26; 12489 Berlin > Tel.: +49-30-2093-70058 Fax: +49-30-2093-70199 > Mail: bschmidt at cms.hu-berlin.de From andreas.jobs at ruhr-uni-bochum.de Sun Mar 20 10:31:38 2016 From: andreas.jobs at ruhr-uni-bochum.de (Andreas Jobs) Date: Sun, 20 Mar 2016 11:31:38 +0100 Subject: [BUG] Dovecot 2.2.22 lmtp child killed with signal 11 Message-ID: <20160320103138.GA84802@ruhr-uni-bochum.de> Hello, after upgrading to 2.2.22 the lmtp service is crashing (segfault) a few times per hours. >From the logs: Mar 19 16:37:29 lmtp(redacted at ruhr-uni-bochum.de): Info: ohZXLe1x7VaUeQAAEc+Mrg: sieve: msgid=: discarding vacation response to mailinglist recipient Mar 19 16:37:29 lmtp(31124): Info: Disconnect from 134.147.42.228: Successful quit Mar 19 16:37:29 lmtp(31124): Fatal: master: service(lmtp): child 31124 killed with signal 11 (core dumped) All those crashes have either a "send vacation response" or a "discarnding vacation response" in common. I'll attach a backtrace and the current configuration. --Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! -------------- next part -------------- # 2.2.22 (fe789d2): /usr/local/dovecot/etc/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 3.13.0-74-generic x86_64 Ubuntu 14.04.4 LTS auth_master_user_separator = * auth_worker_max_count = 50 dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it import_environment = TZ CORE_OUTOFMEM CORE_ERROR USER lda_mailbox_autocreate = yes lmtp_rcpt_check_quota = yes lock_method = flock log_path = /var/log/dovecot.log login_trusted_networks = 134.147.42.224/28 mail_access_groups = nofiles mail_fsync = never mail_location = mdbox:~/mdbox mail_plugins = " quota zlib mail_log notify virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader vnd.dovecot.debug vnd.dovecot.filter mdbox_rotate_size = 5 M mmap_disable = yes namespace { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox UCE-TMP { special_use = \Junk } prefix = separator = / type = private } namespace restore { hidden = yes inbox = no list = children location = mdbox:/var/qmail/data/emptyreadonlymdbox/ prefix = "#RESTORE/" separator = / subscriptions = no type = private } passdb { args = /var/qmail/data/dovecot.disabled deny = yes driver = passwd-file } passdb { args = /usr/local/dovecot/etc/dovecot-auth-mysql.conf driver = sql } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = UCE-TMP;UCE-MELDEN antispam_spam_pattern_ignorecase = junk* antispam_spool2dir_notspam = /opt/rubmail/data/antispam/ham/ham-%%020lu-%u-%%05lu antispam_spool2dir_spam = /opt/rubmail/data/antispam/spam/spam-%%020lu-%u-%%05lu antispam_trash = Trash;Papierkorb antispam_trash_pattern_ignorecase = gel?scht*;gel&APY-scht*;deleted* mail_log_events = mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota:%i:noenforcing:proxy::quota quota_over_flag_value = * quota_over_script = quota-warning mismatch %u sieve_extensions = -reject +editheader +vnd.dovecot.filter +vnd.dovecot.debug sieve_filter_bin_dir = /opt/rubmail/sieve_bin sieve_max_actions = 200 sieve_max_redirects = 200 sieve_plugins = sieve_extprograms sieve_quota_max_scripts = 10 stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap lmtp sieve quota_full_tempfail = yes sendmail_path = /opt/rubmail/bin/sendmailwrapper.dovecot service auth { client_limit = 5300 user = root } service dict { process_limit = 5120 unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } vsz_limit = 512 M } service imap-hibernate { unix_listener imap-hibernate { group = mode = 0666 user = } } service imap-login { inet_listener imap { address = 10.21.8.25 port = 143 } process_min_avail = 4 service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 5120 vsz_limit = 1 G } service lmtp { executable = lmtp inet_listener lmtp { address = 10.21.8.25 port = 24 } process_limit = 50 } service managesieve-login { inet_listener sieve { address = 10.21.8.25 } } service pop3-login { inet_listener pop3 { address = 10.21.8.25 port = 110 } process_min_avail = 4 service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service postlogin { executable = script-login -d rawlog -t } service quota-warning { executable = script /opt/rubmail/bin/quota-warning.pl unix_listener quota-warning { group = nofiles mode = 0666 user = nobody } user = dovecot } service stats { fifo_listener stats-mail { group = nofiles mode = 0666 } unix_listener stats { mode = 0666 } } ssl = no stats_memory_limit = 512 M userdb { driver = prefetch } userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_plugins = " quota zlib mail_log notify virtual sieve" } protocol lmtp { mail_fsync = optimized mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = " quota zlib mail_log notify virtual imap_quota antispam" } -------------- next part -------------- GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/dovecot/libexec/dovecot/lmtp...done. [New LWP 31124] Core was generated by `dovecot/lmtp'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007f466de6d9fc in i_stream_skip (stream=0x0, count=0) at istream.c:241 241 struct istream_private *_stream = stream->real_stream; #0 0x00007f466de6d9fc in i_stream_skip (stream=0x0, count=0) at istream.c:241 _stream = 0x7f4670603020 data_size = 139940470939840 #1 0x00007f466de71e9b in i_stream_concat_skip (cstream=0x7f467069af80) at istream-concat.c:128 stream = 0x7f467069af80 bytes_skipped = 0 __FUNCTION__ = "i_stream_concat_skip" #2 0x00007f466de71805 in i_stream_concat_close (stream=0x7f467069af80, close_parent=false) at istream-concat.c:26 cstream = 0x7f467069af80 i = 32582 #3 0x00007f466de6a598 in io_stream_unref (stream=0x7f467069af80) at iostream.c:43 dc = 0x7ffe4f9dcec0 __FUNCTION__ = "io_stream_unref" #4 0x00007f466de6d11a in i_stream_unref (stream=0x7ffe4f9dcf08) at istream.c:55 _stream = 0x7f467069af80 #5 0x00007f466e8aee3c in client_input_data_write (client=0x7f46705f0660) at commands.c:1151 input = 0x7f467069aff0 #6 0x00007f466e8af1f7 in client_input_data_handle (client=0x7f46705f0660) at commands.c:1238 data = 0x7f467069c8e0 "" size = 1781 ret = -1 #7 0x00007f466e8af230 in client_input_data (client=0x7f46705f0660) at commands.c:1248 No locals. #8 0x00007f466de7b595 in io_loop_call_io (io=0x7f46705f0ff0) at ioloop.c:564 ioloop = 0x7f46705e8720 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f466de7d98d in io_loop_handler_run_internal (ioloop=0x7f46705e8720) at ioloop-epoll.c:220 ctx = 0x7f46705ee340 events = 0x7f46705eff10 event = 0x7f46705eff10 list = 0x7f46705f11b0 io = 0x7f46705f0ff0 tv = {tv_sec = 299, tv_usec = 999248} events_count = 5 msecs = 300000 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f466de7b73b in io_loop_handler_run (ioloop=0x7f46705e8720) at ioloop.c:612 No locals. #11 0x00007f466de7b689 in io_loop_run (ioloop=0x7f46705e8720) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #12 0x00007f466ddeb7f0 in master_service_run (service=0x7f46705e85c0, callback=0x7f466e8aa145 ) at master-service.c:640 No locals. #13 0x00007f466e8aa43d in main (argc=1, argv=0x7f46705e8390) at main.c:127 set_roots = {0x7f466e67e740 , 0x7f466eab3740 , 0x0} service_flags = (MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN | MASTER_SERVICE_FLAG_USE_SSL_SETTINGS) storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT | MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_LOG_INIT | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT | MAIL_STORAGE_SERVICE_FLAG_AUTOEXPUNGE) c = -1 From CMarcus at Media-Brokers.com Sun Mar 20 13:38:53 2016 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 20 Mar 2016 09:38:53 -0400 Subject: Allowing for multiple recipient_delimiter characters? In-Reply-To: References: Message-ID: <56EEA7ED.30904@Media-Brokers.com> On 3/18/2016 5:58 PM, Aaron Lindsay wrote: > Is anyone opposed to changing dovecot's handling of > recipient_delimiter so that it's the same as that of postfix? If not, > I am willing to rebase/merge/address review comments on Lennart > Weller's patch[1] to get this functionality upstream. > > While I think aligning with postfix' behaviour would be convenient for > those of us who run a server using both dovecot and postfix, would > this break any other common use cases I'm not aware of? I can't see how it would break anything, as long as it was configurable (if adding more than '+' breaks anything, then revert the change). But I would love to see support for this. Many systems do not allow the '+' character, but do allow the '-' character, so having the ability to use both would be great. Thanks Aaron! Charles From stephan at rename-it.nl Sun Mar 20 17:49:00 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 20 Mar 2016 18:49:00 +0100 Subject: Problem configuring sieve In-Reply-To: <20160319082346.000030b7@seibercom.net> References: <20160319082346.000030b7@seibercom.net> Message-ID: <56EEE28C.9080506@rename-it.nl> Op 3/19/2016 om 1:23 PM schreef Jerry: > This is a fresh installation of dovecot on a FreeBSD 11 system. Trying > to run the following command produces this error: > > sievec ./default.sieve > sievec(root): Debug: Loading modules from directory: /usr/local/lib/dovecot > sievec(root): Error: Couldn't load required plugin /usr/local/lib/dovecot/lib90_sieve_plugin.so: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're sievec) > sievec(root): Fatal: Internal error occurred. Refer to server log for more information. > *** Error code 89 You must not put the sieve plugin in the mail_plugins setting at top level, only inside protocol lmtp {} or protocol lda {}. Regards, Stephan. > This is my configuration: > > # 2.2.22 (fe789d2): /usr/local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.12 (c1c0a23) > # OS: FreeBSD 11.0-CURRENT amd64 zfs > auth_mechanisms = plain login > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > log_path = /var/log/dovecot.log > mail_debug = yes > mail_location = maildir:/var/mail/vmail/%d/gerard > mail_plugins = sieve > mail_save_crlf = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > auto = subscribe > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > } > passdb { > args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users/passwd > driver = passwd-file > } > plugin { > sieve_default = /usr/local/etc/dovecot/sieve/default.sieve > } > postmaster_address = postmaster at seibercom.net > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0666 > user = vmail > } > } > service dict { > unix_listener dict { > group = vmail > mode = 0600 > user = vmail > } > } > ssl_cert = ssl_key = ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = username_format=%u /usr/local/etc/dovecot/users/passwd > driver = passwd-file > } > protocol lda { > mail_plugins = sieve > } > > There is nothing in the logs regarding this. Can anyone help me? > From andre at rodier.me Mon Mar 21 07:06:39 2016 From: andre at rodier.me (Andre Rodier) Date: Mon, 21 Mar 2016 07:06:39 +0000 Subject: Email hosting provider Message-ID: Hello, Sorry if I am off topic a little. I am looking for an email host provider that supports dovecot, sieve and manage sieve. Ideally with the roundcube webmail and managesieve plugin Better if it is in Europe or switzerland. I don't mind paying a little. Thanks, Andr?. From tobster at brain-force.ch Mon Mar 21 09:14:17 2016 From: tobster at brain-force.ch (Tobi) Date: Mon, 21 Mar 2016 10:14:17 +0100 Subject: Understand the UID value in mailbox debug Message-ID: <56EFBB69.5040204@brain-force.ch> Hi list we have a client who complains that mails from a certain sender are always put into his spamfolder. Our strong guess is that this is an issue with the webmail (Roundcube), but I need some help in understanding the output from dovecot's mailbox-debug. In order to narrow down the source of the problem we activated the mailbox-debug from Dovecot. Now we can see that the mail is moved into the spamfolder. But the strange thing is that a UID is logged which does not exist on the mailserver The following log is the "move" of the mail into the spamfolder Mar 19 11:53:57 backend3 dovecot: imap(REMOVED_FOR_PRIVACY): OmQLrmQubgDAqDIW copy from INBOX: box=INBOX.Spam, uid=58, msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 Mar 19 11:53:57 backend3 dovecot: imap(REMOVED_FOR_PRIVACY): OmQLrmQubgDAqDIW delete: box=INBOX, uid=1614, msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 Mar 19 11:53:57 backend3 dovecot: imapREMOVED_FOR_PRIVACY): OmQLrmQubgDAqDIW expunge: box=INBOX, uid=1614, msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 I do not understand whose UID this is, as it does not exist on the server. Does dovecot create temporary UID or something like that? Or is it more a process ID? Thanks and regards tobi -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From Hajo.Locke at gmx.de Mon Mar 21 09:24:10 2016 From: Hajo.Locke at gmx.de (Hajo Locke) Date: Mon, 21 Mar 2016 10:24:10 +0100 Subject: sieve - editheader - edit in place Message-ID: <56EFBDBA.2030206@gmx.de> Hello, i do some tests with sieve editheader extensions. deleteheader and addheader are working, but i noticed that new headerlines are always prepended to current header. So new lines can be found always on top. I am looking for a possibility to edit a headerline in place, without moving the new line to top of stack(replaceheader?). It is not looking good if a Subject-Line suddenly moves to top of header. Is there a possibility for me? Thanks, Hajo From voytek at sbt.net.au Mon Mar 21 09:30:18 2016 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Mon, 21 Mar 2016 20:30:18 +1100 Subject: Understand the UID value in mailbox debug In-Reply-To: <56EFBB69.5040204@brain-force.ch> References: <56EFBB69.5040204@brain-force.ch> Message-ID: > Mar 19 11:53:57 backend3 dovecot: imap(REMOVED_FOR_PRIVACY): > OmQLrmQubgDAqDIW copy from INBOX: box=INBOX.Spam, uid=58, > msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 Mar 19 > 11:53:57 backend3 dovecot: imap(REMOVED_FOR_PRIVACY): > OmQLrmQubgDAqDIW delete: box=INBOX, uid=1614, > msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 Mar 19 > 11:53:57 backend3 dovecot: imapREMOVED_FOR_PRIVACY): > OmQLrmQubgDAqDIW expunge: box=INBOX, uid=1614, > msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 > > I do not understand whose UID this is, as it does not exist on the > server. Does dovecot create temporary UID or something like that? Or is it > more a process ID? do you mean '58' ? grep 58 /etc/passwd ? From tobster at brain-force.ch Mon Mar 21 09:35:16 2016 From: tobster at brain-force.ch (Tobi) Date: Mon, 21 Mar 2016 10:35:16 +0100 Subject: Understand the UID value in mailbox debug In-Reply-To: References: <56EFBB69.5040204@brain-force.ch> Message-ID: <56EFC054.5090809@brain-force.ch> Am 21.03.2016 um 10:30 schrieb voytek at sbt.net.au: > > do you mean '58' ? > > grep 58 /etc/passwd ? > that I did for sure already. Otherwise I would not claim that the UID does not exist ;-) From moiseev at mezonplus.ru Mon Mar 21 09:37:03 2016 From: moiseev at mezonplus.ru (Alexander Moisseev) Date: Mon, 21 Mar 2016 12:37:03 +0300 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> References: <20160307135040.6923898b@ass> <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> <56E1788B.30209@Media-Brokers.com> <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> Message-ID: <555f555d-5a03-4926-52ff-fe525b2a86a6@mezonplus.ru> On 11.03.16 3:56, Timo Sirainen wrote: > >> On 11 Mar 2016, at 02:37, Charles Marcus wrote: >> >> On 3/9/2016 9:02 PM, Timo Sirainen wrote: >>> On 08 Mar 2016, at 01:50, Pavel Stano wrote: >>>> >>>> sis attachment deduplication is broken in 2.2.16 upwards. >>>> It is caused by this commit. >>>> https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 >>>> >>>> in src/lib-fs/fs-sis.c function fs_sis_try_link() is comparation of >>>> inodes of hash files. >>>> Because fs_stat() after that commit use fstat() on open fd of temporary >>>> file instead of stat on filename. But that temporary file has differnt >>>> inode. >>>> >>>> It not cause any corruption but it will not save any space. >>>> Because every duplicate attachment will be in separate file. >>> Thanks, fixed: https://github.com/dovecot/core/commit/3b39022ea0513363241cf852b7d454c841584ea1 >> >> So, after the fix is applied, does dovecot silently delete the >> duplicated files, or is there a command that needs to be run manually? > > You'd have to do it manually in some way. A script that does something like: > > Go through all attachment directories and for each file: > - Sort files by filename > - Identify that files A and B the same (beginning of the filename begins with same hash), but have a different inode > - ln A B.tmp && mv B.tmp B > I've also found that many of /hashes/ directories have missed. # ll /tank1/vmail/attachments/1f/1f total 3300 -rw------- 1 vmail vmail 403976 12 ??? 00:20 1f1f504c582600a2af94b39c088692aba714fe72-c53b9e1508b14356797d0100d09efc50 -rw------- 1 vmail vmail 403976 12 ??? 00:20 1f1f504c582600a2af94b39c088692aba714fe72-c93b9e1508b14356797d0100d09efc50 -rw------- 1 vmail vmail 403976 12 ??? 00:20 1f1f504c582600a2af94b39c088692aba714fe72-f2a777181eb14356807d0100d09efc50 -rw------- 1 vmail vmail 403976 12 ??? 00:20 1f1f504c582600a2af94b39c088692aba714fe72-f31a5e2917b143567e7d0100d09efc50 -rw------- 1 vmail vmail 2582016 3 ??? 00:20 1f1f97880e8cddc2dfe3c4ad2654b9da937226b7-94c53d358bd33756d6140000d09efc50 Is it related to the same bug or there is another issue? Is it safe to delete attachment files if there is no file with the same hash in the /hashes/ directory or there is no /hashes/ directory at all? From skdovecot at smail.inf.fh-brs.de Mon Mar 21 11:08:21 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 21 Mar 2016 12:08:21 +0100 (CET) Subject: Understand the UID value in mailbox debug In-Reply-To: <56EFBB69.5040204@brain-force.ch> References: <56EFBB69.5040204@brain-force.ch> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 21 Mar 2016, Tobi wrote: > Mar 19 11:53:57 backend3 dovecot: imap(REMOVED_FOR_PRIVACY): > OmQLrmQubgDAqDIW copy from INBOX: box=INBOX.Spam, uid=58, > msgid=<000601d181cd$71401940$53c04bc0$@bluewin.ch>, size=314585 > I do not understand whose UID this is, as it does not exist on the > server. Does dovecot create temporary UID or something like that? Or is > it more a process ID? it's the UID of the message. http://tools.ietf.org/html/rfc3501#section-2.3.1.1 - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVu/WJXz1H7kL/d9rAQLdKgf/WzjAU9+iDh/Pj1LT2oFI3OPbHJCIYwjj g5EoSyYmdn11bwbdJA5SaWvnQ2D48/5pZEvHQrZmXiZS0rO0thNQmv79vTTYMxHg WsBxsBJVdsEvkgXq35Ewq5DF2//HsPbd2GIE39djUqeG7cW5LnJc9euKYhLcDsGp fXsYFzgmOHoB2uQB2qevYXpAeuLClDmK2aRLnAbJXIVjZOOOtp5MbBvwWA4vTngi Jd3WHu29CWlg2Ysy2QSbM8k7I4ScMaLLIZ2aJkkmBdvgCMADuXu4k4YDoZ2Aaa3p CmODzDaQ6mEhqtJBGxNCBEe6fvyfEQFsJyszYHxCeRd9jVcA/FqAOg== =6yXZ -----END PGP SIGNATURE----- From hs at schlittermann.de Mon Mar 21 12:45:56 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Mon, 21 Mar 2016 13:45:56 +0100 Subject: doveadm sync/backup doesn't sync the metadata? Message-ID: <20160321124556.GJ29784@jumper.schlittermann.de> Hello, in a current migration project we want to migrate from Cyrus to Dovecot. The Cyrus server stores expiry information as ANNOTATIONS. On the Dovecot side I've set up the metadata/annotations plugin and it is working. But 'dovecot backup ?' doesn't seem to sync these metadata? Did I miss something here? Shouldn't the metadata be part of the backup? (I'm using the latest 2.2.22 for sync purposes, as the stock dovecot just crashed when used as 'doveadm backup ?') Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From tss at iki.fi Mon Mar 21 12:55:49 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 21 Mar 2016 21:55:49 +0900 Subject: [BUG] Dovecot 2.2.22 lmtp child killed with signal 11 In-Reply-To: <20160320103138.GA84802@ruhr-uni-bochum.de> References: <20160320103138.GA84802@ruhr-uni-bochum.de> Message-ID: <53AE54D8-B549-4A29-9FA1-C00A022DB760@iki.fi> On 20 Mar 2016, at 19:31, Andreas Jobs wrote: > > Hello, > > after upgrading to 2.2.22 the lmtp service is crashing (segfault) a few > times per hours. > > From the logs: > Mar 19 16:37:29 lmtp(redacted at ruhr-uni-bochum.de): Info: ohZXLe1x7VaUeQAAEc+Mrg: sieve: msgid=: discarding vacation response to mailinglist recipient > Mar 19 16:37:29 lmtp(31124): Info: Disconnect from 134.147.42.228: Successful quit > Mar 19 16:37:29 lmtp(31124): Fatal: master: service(lmtp): child 31124 killed with signal 11 (core dumped) > > All those crashes have either a "send vacation response" or a > "discarnding vacation response" in common. > > I'll attach a backtrace and the current configuration. I don't know why vacation would affect this, but these should fix the crash: https://github.com/dovecot/core/commit/421973339968d444d4433cb4d47d1f150e4ab288.patch https://github.com/dovecot/core/commit/65d8efa66dca27db85f74ee2574188b51569a4c2.patch From mail at tomsommer.dk Mon Mar 21 13:08:38 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Mon, 21 Mar 2016 14:08:38 +0100 Subject: Option to not add "Received" header ? In-Reply-To: <55114A32.4090201@coppint.com> References: <55114A32.4090201@coppint.com> Message-ID: On 2015-03-24 12:27, Florent B wrote: > I use Dovecot in lmtp mode to receive mails. > > I would like an option to tell Dovecot to not add a "Reveived" header > on > each server (I use a director, so Director also adds this header). I would love this as well. From tobster at brain-force.ch Mon Mar 21 13:13:09 2016 From: tobster at brain-force.ch (Tobi) Date: Mon, 21 Mar 2016 14:13:09 +0100 Subject: Understand the UID value in mailbox debug In-Reply-To: References: <56EFBB69.5040204@brain-force.ch> Message-ID: <56EFF365.6080406@brain-force.ch> Am 21.03.2016 um 12:08 schrieb Steffen Kaiser: > > it's the UID of the message. > http://tools.ietf.org/html/rfc3501#section-2.3.1.1 thanks a lot this explains why I was unable to find the UID in passwd May I add another question related to mailbox debug log? would it be possible to log the session ID (from IMAP login) that triggered the copy of the mail? I checked mail-log-plugin.c but could not find a session field. Basically I need to relate the action logged by mailbox debug to the respective IMAP login on the server. If it's not possible at the moment to get this information, would it be possible to implement in future versions of dovecot? Thanks tobi From tss at iki.fi Mon Mar 21 14:00:39 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 21 Mar 2016 23:00:39 +0900 Subject: Option to not add "Received" header ? In-Reply-To: References: <55114A32.4090201@coppint.com> Message-ID: <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> On 21 Mar 2016, at 22:08, Tom Sommer wrote: > > On 2015-03-24 12:27, Florent B wrote: > >> I use Dovecot in lmtp mode to receive mails. >> I would like an option to tell Dovecot to not add a "Reveived" header on >> each server (I use a director, so Director also adds this header). > > I would love this as well. How about the other way around: Does anybody want Dovecot LMTP to add a Received header? dovecot-lda doesn't. And proxy/director logs nowadays about what goes through them. Dovecot itself doesn't check the Received headers in any way for looping or other purposes. Maybe Dovecot v2.3 shouldn't add any Received headers at all? From tss at iki.fi Mon Mar 21 14:06:00 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 21 Mar 2016 23:06:00 +0900 Subject: Understand the UID value in mailbox debug In-Reply-To: <56EFF365.6080406@brain-force.ch> References: <56EFBB69.5040204@brain-force.ch> <56EFF365.6080406@brain-force.ch> Message-ID: <94F52866-4BB3-4920-93B5-4AD70814844C@iki.fi> On 21 Mar 2016, at 22:13, Tobi wrote: > > would it be possible to log the session ID (from IMAP login) that > triggered the copy of the mail? I checked mail-log-plugin.c but could > not find a session field. Basically I need to relate the action logged > by mailbox debug to the respective IMAP login on the server. > > If it's not possible at the moment to get this information, would it be > possible to implement in future versions of dovecot? mail_log_prefix = "%s(%u)<%{session}>: " From tss at iki.fi Mon Mar 21 14:10:32 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 21 Mar 2016 23:10:32 +0900 Subject: doveadm sync/backup doesn't sync the metadata? In-Reply-To: <20160321124556.GJ29784@jumper.schlittermann.de> References: <20160321124556.GJ29784@jumper.schlittermann.de> Message-ID: <11884B4B-4A4C-4B03-9B59-C1D43F7C38A4@iki.fi> On 21 Mar 2016, at 21:45, Heiko Schlittermann wrote: > > Hello, > > in a current migration project we want to migrate from Cyrus to > Dovecot. The Cyrus server stores expiry information as ANNOTATIONS. ANNOTATE(-EXPERIMENT-1) is about per-email metadata. I think you're talking about the METADATA extension, which is per-folder. > On the Dovecot side I've set up the metadata/annotations plugin and it > is working. > > But 'dovecot backup ?' doesn't seem to sync these metadata? Did I miss > something here? Shouldn't the metadata be part of the backup? No, currently imapc code doesn't support METADATA. If it did, dsync should work. It's not a small amount of code, but it shouldn't be very difficult to implement either. Anyway something that is very low priority for me right now, especially since you're the first person to ever request this functionality. From rob0 at gmx.co.uk Mon Mar 21 14:22:13 2016 From: rob0 at gmx.co.uk (/dev/rob0) Date: Mon, 21 Mar 2016 09:22:13 -0500 Subject: Email hosting provider In-Reply-To: References: Message-ID: <20160321142212.GL30292@harrier.slackbuilds.org> On Mon, Mar 21, 2016 at 07:06:39AM +0000, Andre Rodier wrote: > Sorry if I am off topic a little. It's not that bad, as you say, only a little off topic. :) > I am looking for an email host provider that supports dovecot, > sieve and manage sieve. Ideally with the roundcube webmail and > managesieve plugin I can't suggest any provider, sorry, but I want to point out that if your provider gives you the described tools on the server, you can easily set up your own webmail clients. If you can use a MUA like Thunderbird, you can also use your own webmail. If the goal is to outsource all server functionality this suggestion obviously won't be useful, but I know I have seen a lot of companies who lack email expertise on staff, yet they run many HTTP servers with advanced features. > Better if it is in Europe or switzerland. I don't mind paying a > little. -- http://rob0.nodns4.us/ Offlist GMX mail is seen only if "/dev/rob0" is in the Subject: From ac at stacksoft.ru Mon Mar 21 14:23:33 2016 From: ac at stacksoft.ru (Anton Cheyvhchalov) Date: Mon, 21 Mar 2016 17:23:33 +0300 Subject: Index corruption in 2.2.18 In-Reply-To: <7383E7C5-AE10-427F-9F4F-71BFA04147DF@iki.fi> References: <20160316120910.7b3bd32a@tahmasib.office.stacksoft.ru> <7383E7C5-AE10-427F-9F4F-71BFA04147DF@iki.fi> Message-ID: <20160321172333.14486e13@tahmasib.office.stacksoft.ru> Yep, 2.2.22 fix the problem. Thank you. -- Anton On Wed, 16 Mar 2016 21:26:02 +1100 Timo Sirainen wrote: > On 16 Mar 2016, at 20:09, Anton Chevychalov wrote: > > > > We are using dbox with lz4 compression and dovecot-lda + sieve for delivery. > > > > Mail recieved: > > Mar 16 06:27:55 mail2 dovecot: lda(svs at example.com): sieve: msgid=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>: stored mail into mailbox 'INBOX' > > > > Around 08:14:00 user start his thunderbird with local filters. He found one mail without headers. > > > > Around that time user do repair folder in thunderbird: > > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139) failed: Cached message size larger than expected (1572 > 980, box=Logs/Backup, UID=9763, cached Message-Id=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>) > > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 9763 > > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139) failed: Cached message size larger than expected (1572 > 980, box=Logs/Backup, UID=9763, cached Message-Id=<20160316032754.4C89D2C4 at rdbms.oldstable.office.example.com>) (FETCH BODY[] for mailbox Logs/Backup UID 9763) > > Mar 16 10:14:44 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH read() failed in=14812 out=1077049 > > Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139): FETCH BODY[] for mailbox Logs/Backup UID 9763 got too little data: 1008 vs 1613 > > Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 9763 > > Mar 16 10:14:45 mail2 dovecot: imap(svs at example.com): Disconnected: > > FETCH failed in=837 out=641651 > > > > And still in a same state: > > Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Error: read(/mail/boxes/example.com/svs/storage/m.139): FETCH BODY[] for mailbox Logs/Backup UID 9763 got too little data: 1008 vs 1613 > > Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Error: Corrupted index cache file /mail/boxes/example.com/svs/mailboxes/Logs/Backup/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 9763 > > Mar 16 11:42:51 mail2 dovecot: imap(svs at example.com): Disconnected: FETCH failed in=12462 out=984043 > > > > In thunderbird we see raw lz4 data. > > > > I have today backup (duplicate mail on exim to per day mbox). So I can restore that message, but I found older problems in other mailboxes and I can't restore it due to tapes rotation > > > > I see a lot of fixes in 2.2.19? Was it fixed after 2.2.18? > > Probably this: https://github.com/dovecot/core/commit/879dfd4da1a9a379936b8d51c1e00c3bd77873b4 > > The mails aren't actually corrupted. Dovecot just didn't detect LZ4 compressed mails correctly always. v2.2.22 should help. From rs at sys4.de Mon Mar 21 16:32:11 2016 From: rs at sys4.de (Robert Schetterer) Date: Mon, 21 Mar 2016 17:32:11 +0100 Subject: sieve - editheader - edit in place In-Reply-To: <56EFBDBA.2030206@gmx.de> References: <56EFBDBA.2030206@gmx.de> Message-ID: <56F0220B.3030903@sys4.de> Am 21.03.2016 um 10:24 schrieb Hajo Locke: > Hello, > > i do some tests with sieve editheader extensions. deleteheader and > addheader are working, but i noticed that new headerlines are always > prepended to current header. So new lines can be found always on top. I > am looking for a possibility to edit a headerline in place, without > moving the new line to top of stack(replaceheader?). It is not looking > good if a Subject-Line suddenly moves to top of header. > Is there a possibility for me? > > Thanks, > Hajo i tested this https://sys4.de/de/blog/2016/01/24/e-mail-weiterleitungen-mit-dovecot-sieve-ohne-spf-dmarc-und-dkim-konflikte-2/ perhaps the example helps Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From stephan at rename-it.nl Mon Mar 21 16:57:42 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 21 Mar 2016 17:57:42 +0100 Subject: sieve - editheader - edit in place In-Reply-To: <56EFBDBA.2030206@gmx.de> References: <56EFBDBA.2030206@gmx.de> Message-ID: <56F02806.80607@rename-it.nl> Op 21-3-2016 om 10:24 schreef Hajo Locke: > Hello, > > i do some tests with sieve editheader extensions. deleteheader and > addheader are working, but i noticed that new headerlines are always > prepended to current header. They can also be appended with ":last". > So new lines can be found always on top. I am looking for a > possibility to edit a headerline in place, without moving the new line > to top of stack(replaceheader?). It is not looking good if a > Subject-Line suddenly moves to top of header. Things not looking good in the header is not really a good reason for wanting this, is it? :) I do understand the sentiment, though. > Is there a possibility for me? Well, the editheader extension was born with a replaceheader command: https://tools.ietf.org/html/draft-degener-sieve-editheader-00 But it was quickly removed after the first draft. I am not sure why. So, there is currently no standard way to achieve this. I could create a "vnd.dovecot.replaceheader" extension to reinstate it, but no GUI would use it. Is anyone else longing for this ability? Regards, Stephan. From gedalya at gedalya.net Mon Mar 21 17:50:56 2016 From: gedalya at gedalya.net (Gedalya) Date: Mon, 21 Mar 2016 13:50:56 -0400 Subject: Option to not add "Received" header ? In-Reply-To: <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> References: <55114A32.4090201@coppint.com> <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> Message-ID: <56F03480.6050405@gedalya.net> On 03/21/2016 10:00 AM, Timo Sirainen wrote: > On 21 Mar 2016, at 22:08, Tom Sommer wrote: >> On 2015-03-24 12:27, Florent B wrote: >> >>> I use Dovecot in lmtp mode to receive mails. >>> I would like an option to tell Dovecot to not add a "Reveived" header on >>> each server (I use a director, so Director also adds this header). >> I would love this as well. > How about the other way around: Does anybody want Dovecot LMTP to add a Received header? dovecot-lda doesn't. And proxy/director logs nowadays about what goes through them. Dovecot itself doesn't check the Received headers in any way for looping or other purposes. Maybe Dovecot v2.3 shouldn't add any Received headers at all? I'd say definitely add an option. I can think of some deployments where I would set it one way and some where I would the other way. From andrzej.filip at gmail.com Mon Mar 21 21:13:58 2016 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Mon, 21 Mar 2016 22:13:58 +0100 Subject: Option to not add "Received" header ? In-Reply-To: <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> (Timo Sirainen's message of "Mon, 21 Mar 2016 23:00:39 +0900") References: <55114A32.4090201@coppint.com> <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> Message-ID: Timo Sirainen wrote: > On 21 Mar 2016, at 22:08, Tom Sommer wrote: >> >> On 2015-03-24 12:27, Florent B wrote: >> >>> I use Dovecot in lmtp mode to receive mails. >>> I would like an option to tell Dovecot to not add a "Reveived" header on >>> each server (I use a director, so Director also adds this header). >> >> I would love this as well. > > How about the other way around: Does anybody want Dovecot LMTP to add > a Received header? dovecot-lda doesn't. And proxy/director logs > nowadays about what goes through them. Dovecot itself doesn't check > the Received headers in any way for looping or other purposes. Maybe > Dovecot v2.3 shouldn't add any Received headers at all? IMHO The "Received:" may be handy for purposes of debugging delivery. I can easily agree with your "suggestion" that it should not be added _by default_ . From andreas.jobs at ruhr-uni-bochum.de Mon Mar 21 23:27:41 2016 From: andreas.jobs at ruhr-uni-bochum.de (Andreas Jobs) Date: Tue, 22 Mar 2016 00:27:41 +0100 Subject: [BUG] Dovecot 2.2.22 lmtp child killed with signal 11 In-Reply-To: <53AE54D8-B549-4A29-9FA1-C00A022DB760@iki.fi> References: <20160320103138.GA84802@ruhr-uni-bochum.de> <53AE54D8-B549-4A29-9FA1-C00A022DB760@iki.fi> Message-ID: <20160321232741.GD89016@ruhr-uni-bochum.de> On Mon, Mar 21, 2016 at 09:55:49PM +0900, Timo Sirainen wrote: > I don't know why vacation would affect this, but these should fix the crash: > > https://github.com/dovecot/core/commit/421973339968d444d4433cb4d47d1f150e4ab288.patch > https://github.com/dovecot/core/commit/65d8efa66dca27db85f74ee2574188b51569a4c2.patch Yes, they fixed it. Thank you. --Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! From andreas.jobs at ruhr-uni-bochum.de Mon Mar 21 23:33:58 2016 From: andreas.jobs at ruhr-uni-bochum.de (Andreas Jobs) Date: Tue, 22 Mar 2016 00:33:58 +0100 Subject: Dovecot 2.2.22 - doveadm via socket not working Message-ID: <20160321233358.GE89016@ruhr-uni-bochum.de> Hello, (my) doveadm is no longer working if I use the -S socket_path. # doveadm quota get -S mbx7:542 -u myaccount doveadm(myaccount): Error: doveadm server disconnected before handshake: EOF doveadm(myaccount): Error: mbx7:542: Command quota get failed for jobsanzl: EOF Quota name Type Value Limit % The server logs: Mar 22 00:29:47 doveadm(134.147.53.150): Fatal: USER environment is missing and -u option not used Mar 22 00:29:47 doveadm(134.147.53.150): Fatal: master: service(doveadm): child 31599 returned error 64 Any hints? --Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! -------------- next part -------------- # 2.2.22 (fe789d2): /usr/local/dovecot/etc/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 3.13.0-74-generic x86_64 Ubuntu 14.04.4 LTS auth_master_user_separator = * auth_worker_max_count = 50 dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it import_environment = TZ CORE_OUTOFMEM CORE_ERROR USER lda_mailbox_autocreate = yes lmtp_rcpt_check_quota = yes lock_method = flock log_path = /var/log/dovecot.log login_trusted_networks = 134.147.42.224/28 mail_access_groups = nofiles mail_fsync = never mail_location = mdbox:~/mdbox mail_plugins = " quota zlib mail_log notify virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader vnd.dovecot.debug vnd.dovecot.filter mdbox_rotate_size = 5 M mmap_disable = yes namespace { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox UCE-TMP { special_use = \Junk } prefix = separator = / type = private } namespace restore { hidden = yes inbox = no list = children location = mdbox:/var/qmail/data/emptyreadonlymdbox/ prefix = "#RESTORE/" separator = / subscriptions = no type = private } passdb { args = /var/qmail/data/dovecot.disabled deny = yes driver = passwd-file } passdb { args = /usr/local/dovecot/etc/dovecot-auth-mysql.conf driver = sql } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = UCE-TMP;UCE-MELDEN antispam_spam_pattern_ignorecase = junk* antispam_spool2dir_notspam = /opt/rubmail/data/antispam/ham/ham-%%020lu-%u-%%05lu antispam_spool2dir_spam = /opt/rubmail/data/antispam/spam/spam-%%020lu-%u-%%05lu antispam_trash = Trash;Papierkorb antispam_trash_pattern_ignorecase = gel?scht*;gel&APY-scht*;deleted* mail_log_events = mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota:%i:noenforcing:proxy::quota quota_over_flag_value = * quota_over_script = quota-warning mismatch %u sieve_extensions = -reject +editheader +vnd.dovecot.filter +vnd.dovecot.debug sieve_filter_bin_dir = /opt/rubmail/sieve_bin sieve_max_actions = 200 sieve_max_redirects = 200 sieve_plugins = sieve_extprograms sieve_quota_max_scripts = 10 stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap lmtp sieve quota_full_tempfail = yes sendmail_path = /opt/rubmail/bin/sendmailwrapper.dovecot service auth { client_limit = 5300 user = root } service dict { process_limit = 5120 unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } vsz_limit = 512 M } service imap-hibernate { unix_listener imap-hibernate { group = mode = 0666 user = } } service imap-login { inet_listener imap { address = 10.21.8.25 port = 143 } process_min_avail = 4 service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 5120 vsz_limit = 1 G } service lmtp { executable = lmtp inet_listener lmtp { address = 10.21.8.25 port = 24 } process_limit = 50 } service managesieve-login { inet_listener sieve { address = 10.21.8.25 } } service pop3-login { inet_listener pop3 { address = 10.21.8.25 port = 110 } process_min_avail = 4 service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service postlogin { executable = script-login -d rawlog -t } service quota-warning { executable = script /opt/rubmail/bin/quota-warning.pl unix_listener quota-warning { group = nofiles mode = 0666 user = nobody } user = dovecot } service stats { fifo_listener stats-mail { group = nofiles mode = 0666 } unix_listener stats { mode = 0666 } } ssl = no stats_memory_limit = 512 M userdb { driver = prefetch } userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_plugins = " quota zlib mail_log notify virtual sieve" } protocol lmtp { mail_fsync = optimized mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = " quota zlib mail_log notify virtual imap_quota antispam" } From andreas.jobs at ruhr-uni-bochum.de Mon Mar 21 23:39:28 2016 From: andreas.jobs at ruhr-uni-bochum.de (Andreas Jobs) Date: Tue, 22 Mar 2016 00:39:28 +0100 Subject: [BUG] Dovecot 2.2.22 Pigeonhole 0.4.13 - Panic: epoll_ctl(del, 18) failed: Bad file descriptor Message-ID: <20160321233928.GF89016@ruhr-uni-bochum.de> Hi, I just found some of these in my logs: Mar 21 18:42:17 lmtp(andreas.jobs at ruhr-uni-bochum.de): Panic: epoll_ctl(del, 18) failed: Bad file descriptor Mar 21 18:42:17 lmtp(andreas.jobs at ruhr-uni-bochum.de): Error: Raw backtrace: /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9acdb) [0x7f4d97ec9cdb] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9c074) [0x7f4d97ecb074] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4d97eca021] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handle_remove+0x126) [0x7f4d97ee8830] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xb63f7) [0x7f4d97ee53f7] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f4d97ee544e] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc85c4) [0x7f4d97ef75c4] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc867b) [0x7f4d97ef767b] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_stream_close+0x28) [0x7f4d97ed56b5] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc6349) [0x7f4d97ef5349] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(o_stream_destroy+0x20) [0x7f4d97ef53d9] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x95550) [0x7f4d9720b550] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x95c5a) [0x7f4d9720bc5a] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc992c) [0x7f4d97ef892c] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0xcd) [0x7f4d97ee6680] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x1f6) [0x7f4d97ee8a78] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x24) [0x7f4d97ee6826] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0xaf) [0x7f4d97ee6774] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0x100) [0x7f4d9720c943] -> /usr/local/dovecot/lib/dovecot/sieve/lib90_sieve_extprograms_plugin.so(sieve_extprogram_run+0x1c) [0x7f4d96735f84] -> /usr/local/dovecot/lib/dovecot/sieve/lib90_sieve_extprograms_plugin.so(+0x459f) [0x7f4d9673359f] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x3fd61) [0x7f4d971b5d61] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0xaa) [0x7f4d971b5e84] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_start+0x140) [0x7f4d971b6054] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_run+0x47) [0x7f4d971b609d] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x5a1c6) [0x7f4d971d01c6] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x5c) [0x7f4d971d06fa] -> /usr/local/dovecot/lib/dovecot/lib90_sieve_plugin.so(+0x3278) [0x7f4d9744b278] Mar 21 18:42:17 lmtp(andreas.jobs at ruhr-uni-bochum.de): Fatal: master: service(lmtp): child 18908 killed with signal 6 (core dumped) Regards, Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! -------------- next part -------------- # 2.2.22 (fe789d2): /usr/local/dovecot/etc/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 3.13.0-74-generic x86_64 Ubuntu 14.04.4 LTS auth_master_user_separator = * auth_worker_max_count = 50 dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it import_environment = TZ CORE_OUTOFMEM CORE_ERROR USER lda_mailbox_autocreate = yes lmtp_rcpt_check_quota = yes lock_method = flock log_path = /var/log/dovecot.log login_trusted_networks = 134.147.42.224/28 mail_access_groups = nofiles mail_fsync = never mail_location = mdbox:~/mdbox mail_plugins = " quota zlib mail_log notify virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader vnd.dovecot.debug vnd.dovecot.filter mdbox_rotate_size = 5 M mmap_disable = yes namespace { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox UCE-TMP { special_use = \Junk } prefix = separator = / type = private } namespace restore { hidden = yes inbox = no list = children location = mdbox:/var/qmail/data/emptyreadonlymdbox/ prefix = "#RESTORE/" separator = / subscriptions = no type = private } passdb { args = /var/qmail/data/dovecot.disabled deny = yes driver = passwd-file } passdb { args = /usr/local/dovecot/etc/dovecot-auth-mysql.conf driver = sql } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = UCE-TMP;UCE-MELDEN antispam_spam_pattern_ignorecase = junk* antispam_spool2dir_notspam = /opt/rubmail/data/antispam/ham/ham-%%020lu-%u-%%05lu antispam_spool2dir_spam = /opt/rubmail/data/antispam/spam/spam-%%020lu-%u-%%05lu antispam_trash = Trash;Papierkorb antispam_trash_pattern_ignorecase = gel?scht*;gel&APY-scht*;deleted* mail_log_events = mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota:%i:noenforcing:proxy::quota quota_over_flag_value = * quota_over_script = quota-warning mismatch %u sieve_extensions = -reject +editheader +vnd.dovecot.filter +vnd.dovecot.debug sieve_filter_bin_dir = /opt/rubmail/sieve_bin sieve_max_actions = 200 sieve_max_redirects = 200 sieve_plugins = sieve_extprograms sieve_quota_max_scripts = 10 stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap lmtp sieve quota_full_tempfail = yes sendmail_path = /opt/rubmail/bin/sendmailwrapper.dovecot service auth { client_limit = 5300 user = root } service dict { process_limit = 5120 unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } vsz_limit = 512 M } service imap-hibernate { unix_listener imap-hibernate { group = mode = 0666 user = } } service imap-login { inet_listener imap { address = 10.21.8.25 port = 143 } process_min_avail = 4 service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 5120 vsz_limit = 1 G } service lmtp { executable = lmtp inet_listener lmtp { address = 10.21.8.25 port = 24 } process_limit = 50 } service managesieve-login { inet_listener sieve { address = 10.21.8.25 } } service pop3-login { inet_listener pop3 { address = 10.21.8.25 port = 110 } process_min_avail = 4 service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service postlogin { executable = script-login -d rawlog -t } service quota-warning { executable = script /opt/rubmail/bin/quota-warning.pl unix_listener quota-warning { group = nofiles mode = 0666 user = nobody } user = dovecot } service stats { fifo_listener stats-mail { group = nofiles mode = 0666 } unix_listener stats { mode = 0666 } } ssl = no stats_memory_limit = 512 M userdb { driver = prefetch } userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_plugins = " quota zlib mail_log notify virtual sieve" } protocol lmtp { mail_fsync = optimized mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = " quota zlib mail_log notify virtual imap_quota antispam" } -------------- next part -------------- GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/dovecot/libexec/dovecot/lmtp...done. [New LWP 18908] Core was generated by `dovecot/lmtp'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f4d97aa0cc9 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #0 0x00007f4d97aa0cc9 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 18908 selftid = 18908 #1 0x00007f4d97aa40d8 in __GI_abort () at abort.c:89 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x7fffa0f592d8, sa_sigaction = 0x7fffa0f592d8}, sa_mask = {__val = {156, 0, 7219096932624331887, 139971224717635, 139971258218976, 139971213342111, 139971258219032, 0, 139971258218976, 140735893836416, 139971238304302, 139971224471290, 139971258218976, 140735893836464, 139971238050258, 4294967296}}, sa_flags = -1594518824, sa_restorer = 0x7f4d97f23f1c} sigs = {__val = {32, 0 }} #2 0x00007f4d97ec9d2a in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x7f4d991ffa18 "/usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9acdb) [0x7f4d97ec9cdb] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9c074) [0x7f4d97ecb074] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0"... #3 0x00007f4d97ecb074 in i_internal_fatal_handler (ctx=0x7fffa0f59340, format=0x7f4d97f23f1c "%s", args=0x7fffa0f59358) at failures.c:670 status = 0 #4 0x00007f4d97eca021 in i_panic (format=0x7f4d97f23f1c "%s") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7fffa0f59430, reg_save_area = 0x7fffa0f59370}} #5 0x00007f4d97ee8830 in io_loop_handle_remove (io=0x7f4d992b4370, closed=false) at ioloop-epoll.c:150 errstr = 0x7f4d991ff998 "epoll_ctl(del, 18) failed: Bad file descriptor" ctx = 0x7f4d992b0860 list = 0x7f4d992b0fb0 event = {events = 0, data = {ptr = 0x7f4d992b43d0, fd = -1725217840, u32 = 2569749456, u64 = 139971258958800}} op = 2 last = true #6 0x00007f4d97ee53f7 in io_remove_full (_io=0x7f4d992a8358, closed=false) at ioloop.c:148 io_file = 0x7f4d992b4370 istream = 0x0 io = 0x7f4d992b4370 __FUNCTION__ = "io_remove_full" #7 0x00007f4d97ee544e in io_remove (io=0x7f4d992a8358) at ioloop.c:162 No locals. #8 0x00007f4d97ef75c4 in stream_closed (fstream=0x7f4d992a8270) at ostream-file.c:57 No locals. #9 0x00007f4d97ef767b in o_stream_file_close (stream=0x7f4d992a8270, close_parent=false) at ostream-file.c:78 fstream = 0x7f4d992a8270 #10 0x00007f4d97ed56b5 in io_stream_close (stream=0x7f4d992a8270, close_parent=false) at iostream.c:58 No locals. #11 0x00007f4d97ef5349 in o_stream_close_full (stream=0x7f4d992a8300, close_parents=false) at ostream.c:54 __FUNCTION__ = "o_stream_close_full" #12 0x00007f4d97ef53d9 in o_stream_destroy (stream=0x7f4d992a76c8) at ostream.c:68 No locals. #13 0x00007f4d9720b550 in program_client_close_output (pclient=0x7f4d992a7640) at program-client.c:54 ret = 1 #14 0x00007f4d9720bc5a in program_client_program_output (pclient=0x7f4d992a7640) at program-client.c:215 input = 0x0 output = 0x7f4d992a8300 data = 0x0 size = 0 ret = 1 #15 0x00007f4d97ef892c in stream_send_io (fstream=0x7f4d992a8270) at ostream-file.c:482 ostream = 0x7f4d992a8300 ret = 0 #16 0x00007f4d97ee6680 in io_loop_call_io (io=0x7f4d992b4370) at ioloop.c:564 ioloop = 0x7f4d992a7ff0 t_id = 5 __FUNCTION__ = "io_loop_call_io" #17 0x00007f4d97ee8a78 in io_loop_handler_run_internal (ioloop=0x7f4d992a7ff0) at ioloop-epoll.c:220 ctx = 0x7f4d992b0860 events = 0x7f4d992b08d0 event = 0x7f4d992b08d0 list = 0x7f4d992b43d0 io = 0x7f4d992b4370 tv = {tv_sec = 9, tv_usec = 998008} events_count = 2 msecs = 9999 ret = 1 i = 0 j = 1 call = true __FUNCTION__ = "io_loop_handler_run_internal" #18 0x00007f4d97ee6826 in io_loop_handler_run (ioloop=0x7f4d992a7ff0) at ioloop.c:612 No locals. #19 0x00007f4d97ee6774 in io_loop_run (ioloop=0x7f4d992a7ff0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #20 0x00007f4d9720c943 in program_client_run (pclient=0x7f4d992a7640) at program-client.c:510 ret = 0 #21 0x00007f4d96735f84 in sieve_extprogram_run (sprog=0x7f4d99290a90) at sieve-extprograms-common.c:631 No locals. #22 0x00007f4d9673359f in cmd_filter_operation_execute (renv=0x7f4d9928f3b8, address=0x7f4d9928f400) at cmd-filter.c:190 mail = 0x7f4d9921cf60 this_ext = 0x7f4d99287d48 is_test = 0 args_list = 0x0 error = SIEVE_ERROR_NONE pname = 0x7f4d991ff838 program_name = 0x7f4d9929ed2f "arffilter" args = 0x0 newmsg = 0x0 sprog = 0x7f4d99290a90 ret = 1 #23 0x00007f4d971b5d61 in sieve_interpreter_operation_execute (interp=0x7f4d9928f360) at sieve-interpreter.c:870 _data_stack_cur_id = 4 op = 0x7f4d969387a0 result = 1 oprtn = 0x7f4d9928f448 address = 0x7f4d9928f400 #24 0x00007f4d971b5e84 in sieve_interpreter_continue (interp=0x7f4d9928f360, interrupted=0x0) at sieve-interpreter.c:908 renv = 0x7f4d9928f3b8 address = 0x7f4d9928f400 ret = 1 #25 0x00007f4d971b6054 in sieve_interpreter_start (interp=0x7f4d9928f360, result=0x7f4d992a5bd0, interrupted=0x0) at sieve-interpreter.c:939 eregs = 0x7f4d9928f4a8 ext_count = 18 i = 18 #26 0x00007f4d971b609d in sieve_interpreter_run (interp=0x7f4d9928f360, result=0x7f4d992a5bd0) at sieve-interpreter.c:950 ret = 0 #27 0x00007f4d971d01c6 in sieve_run (sbin=0x7f4d9929ab90, result=0x7fffa0f59988, msgdata=0x7fffa0f59a60, senv=0x7fffa0f59a90, ehandler=0x7f4d9928b040, flags=SIEVE_RUNTIME_FLAG_NOGLOBAL) at sieve.c:343 interp = 0x7f4d9928f360 ret = 0 #28 0x00007f4d971d06fa in sieve_execute (sbin=0x7f4d9929ab90, msgdata=0x7fffa0f59a60, senv=0x7fffa0f59a90, exec_ehandler=0x7f4d9928b040, action_ehandler=0x7f4d9928eb50, flags=SIEVE_RUNTIME_FLAG_NOGLOBAL, keep=0x0) at sieve.c:552 result = 0x7f4d992a5bd0 ret = 32589 #29 0x00007f4d9744b278 in lda_sieve_singlescript_execute (srctx=0x7fffa0f59b80) at lda-sieve-plugin.c:449 svinst = 0x7f4d99287260 mdctx = 0x7fffa0f59cd0 script = 0x7f4d9928b860 user_script = true exec_ehandler = 0x7f4d9928b040 action_ehandler = 0x7f4d9928eb50 sbin = 0x7f4d9929ab90 debug = false cpflags = SIEVE_COMPILE_FLAG_NOGLOBAL rtflags = SIEVE_RUNTIME_FLAG_NOGLOBAL error = SIEVE_ERROR_NONE ret = 32589 #30 0x00007f4d9744c137 in lda_sieve_execute (srctx=0x7fffa0f59b80, storage_r=0x7fffa0f59c68) at lda-sieve-plugin.c:865 mdctx = 0x7fffa0f59cd0 svinst = 0x7f4d99287260 msgdata = {mail = 0x7f4d9921cf60, return_path = 0x7f4d9920f228 "scomp at aol.net", orig_envelope_to = 0x7f4d9920f4a8 "andreas.jobs+abusefwd at ruhr-uni-bochum.de", final_envelope_to = 0x7f4d9920f4a8 "andreas.jobs+abusefwd at ruhr-uni-bochum.de", auth_user = 0x7f4d9922de28 "andreas.jobs at ruhr-uni-bochum.de", id = 0x0} scriptenv = {user = 0x7f4d9922dd30, default_mailbox = 0x7f4d9891c07a "INBOX", postmaster_address = 0x7f4d9920eae0 "postmaster at mbx7.mail.ruhr-uni-bochum.de", mailbox_autocreate = true, mailbox_autosubscribe = false, script_context = 0x7fffa0f59cd0, smtp_start = 0x7f4d9744a830 , smtp_add_rcpt = 0x7f4d9744a865 , smtp_send = 0x7f4d9744a896 , smtp_finish = 0x7f4d9744a8bc , duplicate_check = 0x7f4d9744a938 , duplicate_mark = 0x7f4d9744a980 , duplicate_flush = 0x7f4d9744a9d0 , reject_mail = 0x7f4d9744a8ff , exec_status = 0x7fffa0f59a50, trace_stream = 0x0, trace_config = {level = SIEVE_TRLVL_NONE, flags = 0}} estatus = {last_storage = 0x0, message_saved = 0, message_forwarded = 0, tried_default_save = 0, keep_original = 0, store_failed = 0} debug = false ret = 32589 #31 0x00007f4d9744c397 in lda_sieve_deliver_mail (mdctx=0x7fffa0f59cd0, storage_r=0x7fffa0f59c68) at lda-sieve-plugin.c:926 _data_stack_cur_id = 3 srctx = {svinst = 0x7f4d99287260, mdctx = 0x7fffa0f59cd0, home_dir = 0x7f4d99230148 "/net/storage-1/home/26/jobsanzl", scripts = 0x7f4d991ff758, script_count = 1, user_script = 0x7f4d9928b860, main_script = 0x7f4d9928b860, msgdata = 0x7fffa0f59a60, scriptenv = 0x7fffa0f59a90, user_ehandler = 0x7f4d9928b040, master_ehandler = 0x7f4d9928af30, action_ehandler = 0x0, userlog = 0x7f4d991ff7d8 "/net/storage-1/home/26/jobsanzl/.dovecot.sieve.log"} debug = false svenv = {hostname = 0x7f4d992bfda8 "mbx7.mail.ruhr-uni-bochum.de", domainname = 0x0, base_dir = 0x7f4d9922f218 "/var/run/dovecot", username = 0x7f4d9922de28 "andreas.jobs at ruhr-uni-bochum.de", home_dir = 0x7f4d99230148 "/net/storage-1/home/26/jobsanzl", temp_dir = 0x7f4d992303e0 "/tmp", flags = SIEVE_FLAG_HOME_RELATIVE, location = SIEVE_ENV_LOCATION_MDA, delivery_phase = SIEVE_DELIVERY_PHASE_DURING} i = 2569077496 ret = 0 #32 0x00007f4d984e490c in mail_deliver (ctx=0x7fffa0f59cd0, storage_r=0x7fffa0f59c68) at mail-deliver.c:440 ret = 32589 #33 0x00007f4d98919219 in client_deliver (client=0x7f4d9920e660, rcpt=0x7f4d9920f470, src_mail=0x7f4d9921cf60, session=0x7f4d9921bd00) at commands.c:867 dctx = {pool = 0x7f4d9921bce0, set = 0x7f4d992bfd28, session = 0x7f4d9921bd00, timeout_secs = 30, session_time_msecs = 43, delivery_time_started = {tv_sec = 1458582137, tv_usec = 963241}, dup_ctx = 0x7f4d992871d0, session_id = 0x7f4d9920f210 "bKkQF0Iy8FbcSQAAEc+Mrg", src_mail = 0x7f4d9921cf60, src_envelope_sender = 0x7f4d9920f228 "scomp at aol.net", dest_user = 0x7f4d9922dd30, dest_addr = 0x7f4d9920f4a8 "andreas.jobs+abusefwd at ruhr-uni-bochum.de", final_dest_addr = 0x7f4d9920f4a8 "andreas.jobs+abusefwd at ruhr-uni-bochum.de", dest_mailbox_name = 0x7f4d9891c07a "INBOX", dest_mail = 0x0, var_expand_table = 0x0, tempfail_error = 0x0, tried_default_save = false, saved_mail = false, save_dest_mail = false, mailbox_full = false, dsn = false} storage = 0x0 input = 0x7f4d992be910 mail_set = 0x7f4d992becc8 lda_set = 0x7f4d992bfd28 ns = 0xa0f60 set_parser = 0x7f4d99229690 delivery_time_started = {tv_sec = 1458582137, tv_usec = 963241} sets = 0x7f4d991ff4e0 line = 0x7fffa0f59cd0 "\340\274!\231M\177" error = 0x400 username = 0x7f4d991fe0b0 "andreas.jobs at ruhr-uni-bochum.de" str = 0x7f4d991ff398 mail_error = 2700450960 ret = 32767 __FUNCTION__ = "client_deliver" #34 0x00007f4d989194dc in client_deliver_next (client=0x7f4d9920e660, src_mail=0x7f4d9921cf60, session=0x7f4d9921bd00) at commands.c:912 rcpts = 0x7f4d9920f270 count = 1 ret = 32589 #35 0x00007f4d989198f1 in client_input_data_write_local (client=0x7f4d9920e660, input=0x7f4d992281a0) at commands.c:1008 session = 0x7f4d9921bd00 src_mail = 0x7f4d9921cf60 old_uid = 37226 first_uid = 4294967295 __FUNCTION__ = "client_input_data_write_local" #36 0x00007f4d98919dd3 in client_input_data_write (client=0x7f4d9920e660) at commands.c:1143 input = 0x7f4d992281a0 #37 0x00007f4d9891a1f7 in client_input_data_handle (client=0x7f4d9920e660) at commands.c:1238 data = 0x7f4d99239cf0 "" size = 3035 ret = -1 #38 0x00007f4d9891a230 in client_input_data (client=0x7f4d9920e660) at commands.c:1248 No locals. #39 0x00007f4d97ee6680 in io_loop_call_io (io=0x7f4d992c0000) at ioloop.c:564 ioloop = 0x7f4d99206720 t_id = 2 __FUNCTION__ = "io_loop_call_io" #40 0x00007f4d97ee8a78 in io_loop_handler_run_internal (ioloop=0x7f4d99206720) at ioloop-epoll.c:220 ctx = 0x7f4d9920c340 events = 0x7f4d9920df10 event = 0x7f4d9920df10 list = 0x7f4d9920f1b0 io = 0x7f4d992c0000 tv = {tv_sec = 299, tv_usec = 999654} events_count = 5 msecs = 300000 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run_internal" #41 0x00007f4d97ee6826 in io_loop_handler_run (ioloop=0x7f4d99206720) at ioloop.c:612 No locals. #42 0x00007f4d97ee6774 in io_loop_run (ioloop=0x7f4d99206720) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #43 0x00007f4d97e567f0 in master_service_run (service=0x7f4d992065c0, callback=0x7f4d98915145 ) at master-service.c:640 No locals. #44 0x00007f4d9891543d in main (argc=1, argv=0x7f4d99206390) at main.c:127 set_roots = {0x7f4d986e9740 , 0x7f4d98b1e740 , 0x0} service_flags = (MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN | MASTER_SERVICE_FLAG_USE_SSL_SETTINGS) storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT | MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_LOG_INIT | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT | MAIL_STORAGE_SERVICE_FLAG_AUTOEXPUNGE) c = -1 From aki.tuomi at dovecot.fi Tue Mar 22 07:04:41 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Tue, 22 Mar 2016 09:04:41 +0200 Subject: Dovecot 2.2.22 - doveadm via socket not working In-Reply-To: <20160321233358.GE89016@ruhr-uni-bochum.de> References: <20160321233358.GE89016@ruhr-uni-bochum.de> Message-ID: <56F0EE89.2020900@dovecot.fi> On 22.03.2016 01:33, Andreas Jobs wrote: > Hello, > > (my) doveadm is no longer working if I use the -S socket_path. > > # doveadm quota get -S mbx7:542 -u myaccount > doveadm(myaccount): Error: doveadm server disconnected before handshake: EOF > doveadm(myaccount): Error: mbx7:542: Command quota get failed for jobsanzl: EOF > Quota name Type Value Limit % > > The server logs: > Mar 22 00:29:47 doveadm(134.147.53.150): Fatal: USER environment is missing and -u option not used > Mar 22 00:29:47 doveadm(134.147.53.150): Fatal: master: service(doveadm): child 31599 returned error 64 > > Any hints? > > > --Andreas Hi! I can confirm this bug exists, I'll take a look. Aki From Hajo.Locke at gmx.de Tue Mar 22 08:02:46 2016 From: Hajo.Locke at gmx.de (Hajo Locke) Date: Tue, 22 Mar 2016 09:02:46 +0100 Subject: sieve - editheader - edit in place In-Reply-To: <56F02806.80607@rename-it.nl> References: <56EFBDBA.2030206@gmx.de> <56F02806.80607@rename-it.nl> Message-ID: <56F0FC26.7060100@gmx.de> Hello, Am 21.03.2016 um 17:57 schrieb Stephan Bosch: > > > Op 21-3-2016 om 10:24 schreef Hajo Locke: >> Hello, >> >> i do some tests with sieve editheader extensions. deleteheader and >> addheader are working, but i noticed that new headerlines are always >> prepended to current header. > > They can also be appended with ":last". > >> So new lines can be found always on top. I am looking for a >> possibility to edit a headerline in place, without moving the new >> line to top of stack(replaceheader?). It is not looking good if a >> Subject-Line suddenly moves to top of header. > > Things not looking good in the header is not really a good reason for > wanting this, is it? :) > > I do understand the sentiment, though. yeah, an ordinary mailheader with lines in "natural" order looks best. > >> Is there a possibility for me? > > Well, the editheader extension was born with a replaceheader command: > > https://tools.ietf.org/html/draft-degener-sieve-editheader-00 I think replaceheader was designed as shortcut for deleteheader->addheader. so there was no additional value. http://www.ietf.org/mail-archive/web/sieve/current/msg02977.html replacing without losing position would be nice. > > But it was quickly removed after the first draft. I am not sure why. > > So, there is currently no standard way to achieve this. > > I could create a "vnd.dovecot.replaceheader" extension to reinstate > it, but no GUI would use it. > > Is anyone else longing for this ability? i hope more people would like this. if not, i would have sympathy for not implementing this. > > Regards, > > Stephan. > Thanks, Hajo From ivan at jurisic.org Tue Mar 22 09:43:26 2016 From: ivan at jurisic.org (=?UTF-8?B?SXZhbiBKdXJpxaFpxIc=?=) Date: Tue, 22 Mar 2016 10:43:26 +0100 Subject: Upgrade Dovecot from 2.1.17 to 2.2.13 lmtp child killed with signal 6 Message-ID: <56F113BE.30102@jurisic.org> After upgrade Debian (Wheezy to Jessie) Dovecot version 2.1.17 is upgraded to 2.2.13. I have random crash of lmtp-a and I got lot message in queue. Any solution for this problem? ---------- Postqueue ---------- 7A5B77F72B 1160457 Tue Mar 22 10:10:15 ivan at jurisic.org (delivery temporarily suspended: lost connection with mail.jurisic.org[private/dovecot-lmtp] while sending end of data -- message may be sent more than once) ante.starcevic at gmail.com ---------- Log file ---------- Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Panic: file fs-api.c: line 615 (fs_copy): assertion failed: (src->fs == dest->fs) Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6b6fe) [0x7f7647a8b6fe] -> /usr/lib/dovecot/libdovecot.so.0(+0x6b7ec) [0x7f7647a8b7ec] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7647a428fb] -> /usr/lib/dovecot/libdovecot.so.0(fs_copy+0x90) [0x7f7647a4c4a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(sdbox_copy+0x4e0) [0x7f7647d3ec10] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0xbaab) [0x7f764726aaab] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x7d) [0x7f7647d7b01d] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x196) [0x7f76480229d6] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf3) [0x7f7648022e13] -> dovecot/lmtp(+0x6171) [0x7f7648452171] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x3f) [0x7f7647a9cd0f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xf9) [0x7f7647a9dd09] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f7647a9cd79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f7647a9cdf8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7647a47dc3] -> dovecot/lmtp(main+0x165) [0x7f76484509b5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f7647696b45] -> dovecot/lmtp(+0x4a95) [0x7f7648450a95] Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Fatal: master: service(lmtp): child 23497 killed with signal 6 (core dumps disabled) ---------- Dovecot configuration ---------- # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.3 ext4 auth_mechanisms = plain login debug_log_path = /var/log/dovecot.debug default_client_limit = 10000 default_process_limit = 1000 default_vsz_limit = 512 M dict { quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = mail.jurisic.org info_log_path = /var/log/dovecot.info lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_path = /var/log/dovecot.log mail_attachment_dir = /var/mail/vhosts/%d/attachment mail_home = /var/mail/vhosts/%d/mail/%n mail_location = sdbox:/var/mail/vhosts/%d/mail/%n mail_plugins = " quota" mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Sent autocreate2 = Drafts autocreate3 = Junk autocreate4 = Trash autosubscribe = Sent autosubscribe2 = Drafts autosubscribe3 = Junk autosubscribe4 = Trash expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:user::proxy::quota quota_rule = *:storage=102400 quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster@%d protocols = " imap lmtp sieve pop3" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { mode = 0660 user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 512 M } service imap { vsz_limit = 512 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-warning { executable = script /opt/mail-old.sh unix_listener quota-warning { group = root mode = 0666 user = root } user = root } ssl = required ssl_cert = References: <56F113BE.30102@jurisic.org> Message-ID: <56F1222D.6090408@dovecot.fi> On 22.03.2016 11:43, Ivan Juri?i? wrote: > After upgrade Debian (Wheezy to Jessie) Dovecot version 2.1.17 is > upgraded to 2.2.13. > I have random crash of lmtp-a and I got lot message in queue. Any > solution for this problem? This looks like it is fixed by https://github.com/dovecot/core/commit/98449946caeaf8a3b413a0d93128315b158cbffb Please upgrade, if possible. br, Teemu Huovila > > ---------- Postqueue ---------- > > 7A5B77F72B 1160457 Tue Mar 22 10:10:15 ivan at jurisic.org > (delivery temporarily suspended: lost connection with > mail.jurisic.org[private/dovecot-lmtp] while sending end of data -- > message may be sent more than once) > ante.starcevic at gmail.com > > ---------- Log file ---------- > > Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Panic: file fs-api.c: > line 615 (fs_copy): assertion failed: (src->fs == dest->fs) > > Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x6b6fe) [0x7f7647a8b6fe] -> > /usr/lib/dovecot/libdovecot.so.0(+0x6b7ec) [0x7f7647a8b7ec] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7647a428fb] -> > /usr/lib/dovecot/libdovecot.so.0(fs_copy+0x90) [0x7f7647a4c4a0] -> > /usr/lib/dovecot/libdovecot-storage.so.0(sdbox_copy+0x4e0) > [0x7f7647d3ec10] -> > /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0xbaab) [0x7f764726aaab] > -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x7d) > [0x7f7647d7b01d] -> > /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x196) > [0x7f76480229d6] -> > /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf3) [0x7f7648022e13] > -> dovecot/lmtp(+0x6171) [0x7f7648452171] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x3f) [0x7f7647a9cd0f] > -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xf9) > [0x7f7647a9dd09] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) > [0x7f7647a9cd79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) > [0x7f7647a9cdf8] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f7647a47dc3] -> dovecot/lmtp(main+0x165) [0x7f76484509b5] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f7647696b45] > -> dovecot/lmtp(+0x4a95) [0x7f7648450a95] > > Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Fatal: master: > service(lmtp): child 23497 killed with signal 6 (core dumps disabled) > > ---------- Dovecot configuration ---------- > > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.3 ext4 > auth_mechanisms = plain login > debug_log_path = /var/log/dovecot.debug > default_client_limit = 10000 > default_process_limit = 1000 > default_vsz_limit = 512 M > dict { > quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext > } > hostname = mail.jurisic.org > info_log_path = /var/log/dovecot.info > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > listen = * > log_path = /var/log/dovecot.log > mail_attachment_dir = /var/mail/vhosts/%d/attachment > mail_home = /var/mail/vhosts/%d/mail/%n > mail_location = sdbox:/var/mail/vhosts/%d/mail/%n > mail_plugins = " quota" > mail_privileged_group = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace inbox { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > autocreate = Sent > autocreate2 = Drafts > autocreate3 = Junk > autocreate4 = Trash > autosubscribe = Sent > autosubscribe2 = Drafts > autosubscribe3 = Junk > autosubscribe4 = Trash > expire = Trash > expire2 = Trash/* > expire3 = Spam > expire_dict = proxy::expire > quota = dict:user::proxy::quota > quota_rule = *:storage=102400 > quota_warning = storage=75%% quota-warning 75 %u > quota_warning2 = storage=90%% quota-warning 90 %u > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > postmaster_address = postmaster@%d > protocols = " imap lmtp sieve pop3" > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > mode = 0600 > user = vmail > } > user = dovecot > } > service dict { > unix_listener dict { > mode = 0660 > user = vmail > } > } > service imap-login { > process_min_avail = 4 > service_count = 0 > vsz_limit = 512 M > } > service imap { > vsz_limit = 512 M > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service quota-warning { > executable = script /opt/mail-old.sh > unix_listener quota-warning { > group = root > mode = 0666 > user = root > } > user = root > } > ssl = required > ssl_cert = ssl_cipher_list = > !aNULL:!eNULL:!EXPORT:!DES:!MD5:!PSK:!EDH:!ADH:!DSS:!RC4:HIGH:+3DES > ssl_key = ssl_prefer_server_ciphers = yes > ssl_protocols = TLSv1 !SSLv2 !SSLv3 > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol lmtp { > mail_plugins = " quota sieve" > } > protocol lda { > mail_plugins = " quota sieve" > } > protocol imap { > mail_max_userip_connections = 20 > mail_plugins = " quota imap_quota" > } > protocol pop3 { > mail_max_userip_connections = 20 > mail_plugins = " quota quota" > } > From hs at schlittermann.de Tue Mar 22 13:27:55 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Tue, 22 Mar 2016 14:27:55 +0100 Subject: LMTP proxy does not pass RCPT TO: ... 5xx response back In-Reply-To: References: <20160211233716.GC30205@jumper.schlittermann.de> Message-ID: <20160322132755.GM29784@jumper.schlittermann.de> Hi, Timo Sirainen (So 21 Feb 2016 02:57:55 CET): > The way it's commonly done in larger environments is that the over-quota is already checked by the MTA and have it fail the RCPT TO. You can have Dovecot update the over-quota flags via quota-warning scripts (and quota_over_script) in whatever way and have the MTA look that up. Then in Dovecot LMTP you could simply disable quota checks. The over-quota flag isn't supported on 2.2.9 (which is what Ubuntu 14.04 has). I tried the quota-status plugin. But it seems, this plugin tries to read the maildir directly. Doesn't help. Since I have a director/backend setup. Can't quota-status use the same interface doveadm quota uses? Unfortunenatly I didn't find further documentation, except the source itself. Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From bmxstreet at gmx.net Tue Mar 22 14:50:50 2016 From: bmxstreet at gmx.net (Kieran) Date: Tue, 22 Mar 2016 15:50:50 +0100 Subject: protocols.d/ dir empty? Message-ID: <56F15BCA.6030700@gmx.net> (I hope I'm doing this right) Hey there. I have a problem with the dovecot protocols. When I do /telnet 127.0.0.1 143/ it gives me a connection refused error. I looked in the wiki and then after trying /doveconf protocols listen /I realized that I don't have any protocols.//I went in //usr/share/dovecot/protocols.d/ and it's empty. How can I fix that? From ml+dovecot at valo.at Tue Mar 22 14:59:52 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Tue, 22 Mar 2016 15:59:52 +0100 Subject: protocols.d/ dir empty? In-Reply-To: <56F15BCA.6030700@gmx.net> References: <56F15BCA.6030700@gmx.net> Message-ID: <2eaba7e7076feb7628e04d5e24ded7d9@valo.at> On 2016-03-22 15:50, Kieran wrote: > (I hope I'm doing this right) > Hey there. I have a problem with the dovecot protocols. When I do > /telnet 127.0.0.1 143/ it gives me a connection refused error. I bet dovecot is not running. > I looked in the wiki and then after trying /doveconf protocols listen > /I > realized that I don't have any protocols.//I went in > //usr/share/dovecot/protocols.d/ and it's empty. > How can I fix that? That directory doesn't even exist on my system... Please provide output of doveconf -n. -- Christian Kivalo From alessio at skye.it Tue Mar 22 15:59:51 2016 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 22 Mar 2016 16:59:51 +0100 Subject: Dovecot 2.2.21 change imap logout format (and broke my log parsing) Message-ID: <56F16BF7.4000409@skye.it> Hi, after upgrade to dovecot-2.2.21 the log of "imap logout" format changed from: Mar 1 03:40:44 pop01 dovecot: imap(info at domain.com): Connection closed in=111 out=1522 session= to: Mar 3 03:48:11 pop01 dovecot: imap(info at domain.com): Connection closed (IDLE running for 0.001 + waiting input for 2088.878 secs, 2 B in + 10+0 B out, state=wait-input) in=224 out=2834 session=<6XTzihst3uUFqB6m> Can "(IDLE running for 0.001 + waiting input for 2088.878 secs, 2 B in + 10+0 B out, state=wait-input)" removed from the log? My imap_logout_format is: imap_logout_format = in=%i out=%o session=<%{session}> Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From stephan at rename-it.nl Tue Mar 22 16:15:55 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 22 Mar 2016 17:15:55 +0100 Subject: protocols.d/ dir empty? In-Reply-To: <56F15BCA.6030700@gmx.net> References: <56F15BCA.6030700@gmx.net> Message-ID: <56F16FBB.5010603@rename-it.nl> Op 22-3-2016 om 15:50 schreef Kieran: > (I hope I'm doing this right) > Hey there. I have a problem with the dovecot protocols. When I do > /telnet 127.0.0.1 143/ it gives me a connection refused error. I > looked in the wiki and then after trying /doveconf protocols listen /I > realized that I don't have any protocols.//I went in > //usr/share/dovecot/protocols.d/ and it's empty. > How can I fix that? That protocols directory is specific to Debian. Did you install the dovecot-imapd package? The question is similar for other protocols that you may want to use; each has its own binary package. Regards, Stephan. From abi at oleane.net Tue Mar 22 17:48:21 2016 From: abi at oleane.net (abi at oleane.net) Date: Tue, 22 Mar 2016 18:48:21 +0100 Subject: multiple imapc settings in different namespaces Message-ID: <56F18565.1000303@oleane.net> hello all i assume this question must have already been asked, but i'm looking for a way to circumvent which might work specifically on my system. the version can be any available version between 2.2.9 and 2.2.22 (i'm testing with both of the above and no other ) i'm using imapc in 2 different namespaces. in both cases, the imapc_host is local, and a custom passdb program is expected to handle proxying to different servers. one of the case should proxy to a different legacy platform, and the other is used for shared mailboxes. is there any way at all to be able to tell which is which in passdb ? i don't care about the password, i can use a login prefix or suffix, different ports, different master passwords, ssl, maybe a different protocol name or auth method... somehow i've seen in the source code there is a namespace "owner" but did not manage to change this parameter. i guess it is used internally. anything else ? thanks a lot for any help you can provide best regards @abi From bmxstreet at gmx.net Tue Mar 22 17:56:39 2016 From: bmxstreet at gmx.net (Kieran) Date: Tue, 22 Mar 2016 18:56:39 +0100 Subject: protocols.d/ dir empty? In-Reply-To: <2eaba7e7076feb7628e04d5e24ded7d9@valo.at> References: <56F15BCA.6030700@gmx.net> <2eaba7e7076feb7628e04d5e24ded7d9@valo.at> Message-ID: <56F18757.9020104@gmx.net> # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 4.1.13-v7+ armv7l Debian 7.9 auth_mechanisms = plain login disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir namespace { inbox = yes location = mailbox { special_use = \Drafts name = Drafts } mailbox { special_use = \Junk name = Junk } mailbox { special_use = \Sent name = Sent } mailbox { special_use = \Sent name = Sent Messages } mailbox { special_use = \Trash name = Trash } prefix = name = inbox } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service { unix_listener { group = postfix mode = 0660 user = postfix path = /var/spool/postfix/private/auth } name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service { inet_listener { port = 143 name = imap } inet_listener { port = 993 ssl = yes name = imaps } name = imap-login } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } ssl_cert = On 2016-03-22 15:50, Kieran wrote: >> (I hope I'm doing this right) >> Hey there. I have a problem with the dovecot protocols. When I do >> /telnet 127.0.0.1 143/ it gives me a connection refused error. > I bet dovecot is not running. > >> I looked in the wiki and then after trying /doveconf protocols listen /I >> realized that I don't have any protocols.//I went in >> //usr/share/dovecot/protocols.d/ and it's empty. >> How can I fix that? > > That directory doesn't even exist on my system... > > Please provide output of doveconf -n. > From wlt-ml at o-sinc.com Tue Mar 22 19:30:38 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Tue, 22 Mar 2016 15:30:38 -0400 Subject: Replication issues master <-> master nfs backend Message-ID: I keep having some replication issues and not sure what can be done to resolve or correct. It does not seem to happen all the time, though for the last ~30 or so minutes and many messages seems to be happening consistent for me. I have 2 mail servers, basically clones, and thus master master replication. Most of the time things work fine. But many times an email or several will arrive on one, and never replicate to the other. I am not as concerned on the never replicating, as I am that the user never gets notified. Mail arrives on say server 1, users are checking mail on server 2, and they never see the email on server 2. This is not always the case, but its happening enough daily. I then log into one and run sync manually. Which usually syncs the mail on both servers, and then it arrives in the inbox. Here is an example, mail is on mail2, but not mail1. I am checking email on mail1 so I am not seeing the 1 email. Mail1 /home/wlt-ml/.maildir/new: total 0 Mail2 /home/wlt-ml/.maildir/new: total 12 -rw------- 1 wlt-ml site1 8502 Mar 22 14:57 1458673024.7643.mail2 Then I manually log into mail2 and run this command, though usually I can run it from either side, and just change the name to the other server. doveadm sync -u "*" remote:mail1 And then I end up with the missing email on mail1, and it arrives in my email client shortly there after Mail1 /home/wlt-ml/.maildir/new: total 12 -rw------- 1 wlt-ml site1 8502 Mar 22 14:57 1458673051.M838843P26735.mail1,S=8502,W=8678:2,T I have no idea why it does this. It seems to happen when when a full sync has taken place per doveadm replicator status wlt-ml. There does not seem to be any settings to force a full vs fast sync more often. No clue if this is even a full vs fast issue or other. I think it tends to happen more when people stay connected to the imap server. I had a theory that closing the email client and opening it again will get dovecot to sync. I believe this is still the case, but not able to confirm 100%. Also users are reporting closing Thunderbird. I can see them logging out and back in in the logs, but email does not replicate or show till I run doveadm sync manually. Tempted to have cron invoke that on the regular, but seems very hackish and likely will have its own issues doing that. Since its not the right way or how things were designed. Not sure if this is a bug or what. Hopefully miss-configuration on my end. Open to any feedback, advice, etc. I can provide replicator configuration but its pretty straight forward and mostly copy/paste from the replication page. Replication works, just seems it is not triggered to replicate at times or something. dovecot --version 2.2.22 (fe789d2) -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com From aclindsa at gmail.com Tue Mar 22 23:57:33 2016 From: aclindsa at gmail.com (Aaron Lindsay) Date: Tue, 22 Mar 2016 19:57:33 -0400 Subject: Allowing for multiple recipient_delimiter characters? In-Reply-To: References: Message-ID: On Fri, Mar 18, 2016 at 5:58 PM, Aaron Lindsay wrote: > Postfix allows the recipient_delimiter configuration parameter to > contain multiple characters, splitting on the first such character it > encounters. For example, if using 'recipient_delimiter=+-' both > aaron+foo at example.com and aaron-bar at example.com would be delivered to > aaron at example.com. > > Is anyone opposed to changing dovecot's handling of > recipient_delimiter so that it's the same as that of postfix? If not, > I am willing to rebase/merge/address review comments on Lennart > Weller's patch[1] to get this functionality upstream. I didn't receive any opposition to my proposal, so I've created two github pull requests for discussion - one for dovecot and one for pigeonhole: https://github.com/dovecot/core/pull/4 https://github.com/dovecot/pigeonhole/pull/2 I've also attached the two patches for review here in case that is preferred. Please keep me in CC as I'm not subscribed to the list. Thanks! -Aaron -------------- next part -------------- A non-text attachment was scrubbed... Name: 0001-subaddress-Support-multiple-recipient_delimiters.patch Type: application/x-download Size: 4333 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 0001-Support-multiple-recipient_delimiters.patch Type: application/x-download Size: 3666 bytes Desc: not available URL: From xun.zhong at hpe.com Wed Mar 23 03:46:43 2016 From: xun.zhong at hpe.com (Zhong, Xun) Date: Wed, 23 Mar 2016 03:46:43 +0000 Subject: plugin can't be loaded in imap proxy mode Message-ID: When dovecot v2.2.21 work in IMAP proxy mode, plugin can not be loaded and work, so my question is: plugins do not work in proxy mode? Anyone can help me ? Thanks a lot. From xun.zhong at hpe.com Wed Mar 23 05:28:45 2016 From: xun.zhong at hpe.com (Zhong, Xun) Date: Wed, 23 Mar 2016 05:28:45 +0000 Subject: plugin can't be loaded in imap proxy mode Message-ID: Hi, All I tested [last-login] plugin, when I directly logined by pam way, the last-login plugin can load and run, but when I logined by proxy way(Dovecot forward my imap request to another imap server), the last-login plugin did not load and run. Thanks From: Zhong, Xun Sent: Wednesday, March 23, 2016 11:47 AM To: 'dovecot at dovecot.org' Subject: plugin can't be loaded in imap proxy mode When dovecot v2.2.21 work in IMAP proxy mode, plugin can not be loaded and work, so my question is: plugins do not work in proxy mode? Anyone can help me ? Thanks a lot. From teemu.huovila at dovecot.fi Wed Mar 23 09:19:07 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Wed, 23 Mar 2016 11:19:07 +0200 Subject: Replication issues master <-> master nfs backend In-Reply-To: References: Message-ID: <56F25F8B.9060700@dovecot.fi> On 22.03.2016 21:30, William L. Thomson Jr. wrote: > I keep having some replication issues and not sure what can be done to resolve or correct. It > does not seem to happen all the time, though for the last ~30 or so minutes and many > messages seems to be happening consistent for me. > > I have 2 mail servers, basically clones, and thus master master replication. Most of the time > things work fine. But many times an email or several will arrive on one, and never replicate > to the other. I am not as concerned on the never replicating, as I am that the user never gets > notified. > > Mail arrives on say server 1, users are checking mail on server 2, and they never see the email > on server 2. This is not always the case, but its happening enough daily. I then log into one > and run sync manually. Which usually syncs the mail on both servers, and then it arrives in > the inbox. > > Here is an example, mail is on mail2, but not mail1. I am checking email on mail1 so I am not > seeing the 1 email. > > Mail1 > /home/wlt-ml/.maildir/new: > total 0 > > Mail2 > /home/wlt-ml/.maildir/new: > total 12 > -rw------- 1 wlt-ml site1 8502 Mar 22 14:57 1458673024.7643.mail2 > > Then I manually log into mail2 and run this command, though usually I can run it from either > side, and just change the name to the other server. > > doveadm sync -u "*" remote:mail1 > > And then I end up with the missing email on mail1, and it arrives in my email client shortly > there after > > Mail1 > /home/wlt-ml/.maildir/new: > total 12 > -rw------- 1 wlt-ml site1 8502 Mar 22 14:57 > 1458673051.M838843P26735.mail1,S=8502,W=8678:2,T > > I have no idea why it does this. It seems to happen when when a full sync has taken place > per doveadm replicator status wlt-ml. There does not seem to be any settings to force a full > vs fast sync more often. No clue if this is even a full vs fast issue or other. > > I think it tends to happen more when people stay connected to the imap server. I had a > theory that closing the email client and opening it again will get dovecot to sync. I believe > this is still the case, but not able to confirm 100%. Also users are reporting closing > Thunderbird. I can see them logging out and back in in the logs, but email does not replicate > or show till I run doveadm sync manually. > > Tempted to have cron invoke that on the regular, but seems very hackish and likely will have > its own issues doing that. Since its not the right way or how things were designed. Not sure > if this is a bug or what. Hopefully miss-configuration on my end. You should still include your doveconf -n output. Also any errors and warnings logged by dovecot, could be useful. br, Teemu Huovila > Open to any feedback, advice, etc. I can provide replicator configuration but its pretty > straight forward and mostly copy/paste from the replication page. Replication works, just > seems it is not triggered to replicate at times or something. > > dovecot --version > 2.2.22 (fe789d2) > > From aki.tuomi at dovecot.fi Wed Mar 23 09:29:41 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Wed, 23 Mar 2016 11:29:41 +0200 Subject: Dovecot 2.2.22 - doveadm via socket not working In-Reply-To: <20160321233358.GE89016@ruhr-uni-bochum.de> References: <20160321233358.GE89016@ruhr-uni-bochum.de> Message-ID: <56F26205.4050800@dovecot.fi> On 22.03.2016 01:33, Andreas Jobs wrote: > Hello, > > (my) doveadm is no longer working if I use the -S socket_path. > > # doveadm quota get -S mbx7:542 -u myaccount > doveadm(myaccount): Error: doveadm server disconnected before handshake: EOF > doveadm(myaccount): Error: mbx7:542: Command quota get failed for jobsanzl: EOF > Quota name Type Value Limit % > > The server logs: > Mar 22 00:29:47 doveadm(134.147.53.150): Fatal: USER environment is missing and -u option not used > Mar 22 00:29:47 doveadm(134.147.53.150): Fatal: master: service(doveadm): child 31599 returned error 64 > > Any hints? > > > --Andreas Hi! This has been now fixed in master in commits https://github.com/dovecot/core/commit/7b98fc3ad1392e60f750211538fa8e502755e63e https://github.com/dovecot/core/commit/fcb8a4a04df3de83cf41b548440e8d42ff24fa98 https://github.com/dovecot/core/commit/619994941f9d9e8e2d108eb3f9f9821a35f60cae --- Aki Tuomi Dovecot Oy From teemu.huovila at dovecot.fi Wed Mar 23 10:54:13 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Wed, 23 Mar 2016 12:54:13 +0200 Subject: Dovecot 2.2.21 change imap logout format (and broke my log parsing) In-Reply-To: <56F16BF7.4000409@skye.it> References: <56F16BF7.4000409@skye.it> Message-ID: <56F275D5.60407@dovecot.fi> On 22.03.2016 17:59, Alessio Cecchi wrote: > Hi, > > after upgrade to dovecot-2.2.21 the log of "imap logout" format changed > > from: > Mar 1 03:40:44 pop01 dovecot: imap(info at domain.com): Connection closed in=111 out=1522 session= > > to: > Mar 3 03:48:11 pop01 dovecot: imap(info at domain.com): Connection closed (IDLE running for 0.001 + waiting input for 2088.878 secs, 2 B in + 10+0 B out, state=wait-input) in=224 out=2834 session=<6XTzihst3uUFqB6m> > > Can "(IDLE running for 0.001 + waiting input for 2088.878 secs, 2 B in + 10+0 B out, state=wait-input)" removed from the log? > > My imap_logout_format is: > > imap_logout_format = in=%i out=%o session=<%{session}> I think this should only happen when a client disconnects without issuing the LOGOUT command. So it can be viewed as an error condition. The extra output was added, to support debugging such situations. It could be argued it is a more common use case to want to know the issue, than not, but it is a matter of opinion. Maybe a setting to disable it could be considered. For reference, these are the commits that break your parsing: https://github.com/dovecot/core/commit/266d72b0b32d5b105de96aac0c050d5a4c0ed3a8 https://github.com/dovecot/core/commit/fa5c3e6ebdcebde921ddbbe43219774ceaf081f0 br, Teemu Huovila > > Thanks From sergey.schwartz at bgoperator.com Wed Mar 23 13:30:47 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Wed, 23 Mar 2016 16:30:47 +0300 Subject: attachement disappeared Message-ID: <56F29A87.8060400@bgoperator.com> Gentelmen, Is it possible for the attachment to dissappear? I've got an important email with a file attached and today the attachement is absent. -- Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com From stephan at rename-it.nl Wed Mar 23 13:48:35 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 23 Mar 2016 14:48:35 +0100 Subject: attachement disappeared In-Reply-To: <56F29A87.8060400@bgoperator.com> References: <56F29A87.8060400@bgoperator.com> Message-ID: <56F29EB3.8090307@rename-it.nl> Op 23-3-2016 om 14:30 schreef Sergey Schwartz: > Gentelmen, > > Is it possible for the attachment to dissappear? > I've got an important email with a file attached and today the > attachement is absent. > Seems unlikely, but without some insight in your configuration we cannot help you. You at least should provide the output of `dovecot -n`. Regards, Stephan. From sergey.schwartz at bgoperator.com Wed Mar 23 14:00:32 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Wed, 23 Mar 2016 17:00:32 +0300 Subject: attachement disappeared In-Reply-To: <56F29EB3.8090307@rename-it.nl> References: <56F29A87.8060400@bgoperator.com> <56F29EB3.8090307@rename-it.nl> Message-ID: <56F2A180.3040903@bgoperator.com> Stephan, current config # 2.2.devel (513c911): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (3f32cd0) # OS: Linux 3.13.0-34-generic x86_64 Ubuntu 14.04.3 LTS xfs auth_cache_negative_ttl = 0 auth_cache_size = 512 M auth_default_realm = bgoperator.com auth_failure_delay = 5 secs auth_worker_max_count = 4096 default_client_limit = 40960 default_process_limit = 8192 default_vsz_limit = 2 G disable_plaintext_auth = no first_valid_gid = 500 mail_location = mdbox:/srv/vmail/current/%d/%n mail_plugins = acl zlib notify replication mail_shared_explicit_inbox = yes mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 32 M namespace { list = yes location = mdbox:/srv/vmail/current/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/virtual/base.conf.ext driver = sql } passdb { args = /etc/dovecot/virtual/master.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/srv/vmail/current/shared.db/000-shared-mailboxes.db sieve = file:/srv/vmail/current/%d/%n/sieve;active=/srv/vmail/current/%d/%n/active.sieve sieve_max_redirects = 0 zlib_save = xz zlib_save_level = 6 } protocols = " imap lmtp sieve" service auth-worker { process_limit = 4096 } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { process_limit = 4096 process_min_avail = 24 } service imap { process_limit = 4096 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = > > Op 23-3-2016 om 14:30 schreef Sergey Schwartz: >> Gentelmen, >> >> Is it possible for the attachment to dissappear? >> I've got an important email with a file attached and today the >> attachement is absent. >> > > Seems unlikely, but without some insight in your configuration we > cannot help you. > > You at least should provide the output of `dovecot -n`. > > Regards, > > Stephan. From bunkertor at tiscali.it Wed Mar 23 18:47:20 2016 From: bunkertor at tiscali.it (ferdinando) Date: Wed, 23 Mar 2016 19:47:20 +0100 Subject: pigeonhole Message-ID: hi all im trying to install pigeonhole with dovecot2 but it stops during "make install" with this error: ========================================================================================== .... /bin/sh ../../libtool --mode=install /usr/bin/install -c sievec sieve-dump sieve-test sieve-filter '/usr/local/cluster/fs-cl00/mail/sieve/bin' libtool: install: /usr/bin/install -c .libs/sievec /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec /usr/bin/install: setting permissions for '/usr/local/cluster/fs-cl00/mail/sieve/bin/sievec': No data available Makefile:450: recipe for target 'install-binPROGRAMS' failed make[3]: *** [install-binPROGRAMS] Error 1 make[3]: Leaving directory '/usr/local/src/pigeonhole/src/sieve-tools' Makefile:648: recipe for target 'install-am' failed make[2]: *** [install-am] Error 2 make[2]: Leaving directory '/usr/local/src/pigeonhole/src/sieve-tools' Makefile:417: recipe for target 'install-recursive' failed make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory '/usr/local/src/pigeonhole/src' Makefile:732: recipe for target 'install-recursive' failed make: *** [install-recursive] Error 1 [root at mail02 pigeonhole]# [root at mail02 pigeonhole]# ls -l /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec -rw------- 1 root root 118504 Mar 23 19:31 /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec [root at mail02 pigeonhole]# file /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 2.6.32, BuildID[sha1]=586da03004b77848d5e1c66f9bb33259a984ba48, not stripped [root at mail02 pigeonhole]# ... ========================================================================================== configure is ok, no particular options are required, only ldap module enabled by plugin. make is ok, the job exits with no errors. dovecot itself seems ok, it's up and running what do i miss? need some particular uids/gids to accomplish the installation? here's my specs: pigeonhole commit 1d36af65473016aa8339a3671d8b555adc71cef3 dovecot commit 4a769606eb49926c6dfb9a532186e9e737683283 Fedora release 23 Linux version 4.4.5-300.fc23.x86_64 gcc version 5.3.1 thanks a lot in advance for any help =) Connetti gratis il mondo con la nuova indoona: hai la chat, le chiamate, le video chiamate e persino le chiamate di gruppo. E chiami gratis anche i numeri fissi e mobili nel mondo! Scarica subito l?app Vai su https://www.indoona.com/ From wlt-ml at o-sinc.com Wed Mar 23 19:44:16 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Wed, 23 Mar 2016 15:44:16 -0400 Subject: Replication issues master <-> master nfs backend In-Reply-To: <56F25F8B.9060700@dovecot.fi> References: <56F25F8B.9060700@dovecot.fi> Message-ID: Forgot to mention before I run 2 NFS servers, each mail server uses a different NFS server. It is not the same NFS server for both. Just to clarify that, as I am not trying to replicate using the same NFS server with 2 mail servers. I have 2 of each, mail + nfs, and not at the same location. On Wednesday, March 23, 2016 11:19:07 AM Teemu Huovila wrote: > > You should still include your doveconf -n output. Below, end of email > Also any errors and warnings logged by dovecot, could be useful. Not many errors are logged. It does not give me anything to go on for the replication issues. The only errors I have ever seen logged other than some initial deployment fubar with assertion errors. The only other error logged is due to an account I use for nagios but does not exist, nobody. Mar 23 13:01:44 Error: dsync-local(nobody): Couldn't create lock /var/empty/.dovecot- sync.lock: Permission denied Messed with changing nobody's home directory but screwed up other things like ssh. I just do doveadm replicator remove nobody Not sure if I can put that in a config file, or somewhere so it is more permanent. I could not figure out how to ignore that user, while bring in all others. Occasionally some others with inability to reach the other mail server due to VPN issues. But that is not happening when I am experiencing replication issue and is very rare. Just does log a few times when it happens. doveconf -n # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # OS: Linux 4.3.3-hardened-r1 x86_64 Gentoo Base System release 2.2 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_gid = 1000 first_valid_uid = 1000 listen = *,[::] login_greeting = Mail server ready. login_log_format_elements = user=<%u> ip=[%r] port=[%b] method=[%m] security=[%c] mail_fsync = always mail_location = maildir:~/.maildir mail_nfs_index = yes mail_plugins = " notify replication" mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = * driver = pam } plugin { mail_replica = tcp:mail2.obsidian-studios.com:12345 } service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = root } unix_listener replication-notify { mode = 0666 user = root } } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { From dovecot at knutejohnson.com Wed Mar 23 21:26:21 2016 From: dovecot at knutejohnson.com (Knute Johnson) Date: Wed, 23 Mar 2016 14:26:21 -0700 Subject: Setting up replication? Message-ID: <56F309FD.6030704@knutejohnson.com> I'm trying to set up replication between two servers and I've hit a snag. I have two users and am using mbox files. If anybody has a sample config file for a simple system like mine I would really be grateful to see it. Thanks, The error I'm getting is: Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: user nobody: Initialization failed: Namespace '': mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) egid=65534(nogroup)) Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: dsync-server: User init failed Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: Failed to start dsync-server command: 75 knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' nobody knute penny I don't know why the user 'nobody' shows up here? nobody is in the /etc/passwd file but he has no group. knute at knute2:/ $ cat /etc/passwd | grep nobody nobody:x:65534:65534:nobody:/nonexistent:/usr/sbin/nologin ----------------------- I created a separate config file as suggested in Peer Heinlein's book. knute at knute2:/etc/dovecot/conf.d $ cat 12-replication.conf mail_plugins = $mail_plugins notify replication service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service doveadm { inet_listener { port = 30303 } } #doveadm_port = 30303 doveadm_password = secret plugin { mail_replica = tcp:knute2.frazmtn.com:30303 } replication_dsync_parameters = -d -N -l 30 -U --------------------- knute at knute2:/etc/dovecot/conf.d $ dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 4.1.19-v7+ armv7l Debian 8.0 doveadm_password = secret mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" namespace { inbox = yes location = mailbox { special_use = \Drafts name = Drafts } mailbox { special_use = \Junk name = Junk } mailbox { special_use = \Sent name = Sent } mailbox { special_use = \Sent name = Sent Messages } mailbox { auto = subscribe special_use = \Trash name = Trash } prefix = name = inbox } passdb { driver = pam } plugin { mail_replica = tcp:knute3.frazmtn.com:30303 } protocols = " imap" service { fifo_listener { mode = 0666 path = replication-notify-fifo } unix_listener { mode = 0666 path = replication-notify } name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service { inet_listener { port = 30303 name = } name = doveadm } service imap { inet_listener { port = 0 name = imaps } name = imap-login } service imap-urlauth { name = imap-urlauth-login } service imap-urlauth-worker { name = imap-urlauth-worker } service token-login/imap-urlauth { name = imap-urlauth } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service { inet_listener { port = 0 name = pop3 } inet_listener { port = 0 name = pop3s } name = pop3-login } service login/pop3 { name = pop3 } service { process_min_avail = 1 unix_listener { mode = 0600 path = replicator-doveadm } name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } ssl_cert = References: <20160321233358.GE89016@ruhr-uni-bochum.de> <56F26205.4050800@dovecot.fi> Message-ID: <20160324005616.GA95430@ruhr-uni-bochum.de> Hi, On Wed, Mar 23, 2016 at 11:29:41AM +0200, Aki Tuomi wrote: > This has been now fixed in master in commits > > https://github.com/dovecot/core/commit/7b98fc3ad1392e60f750211538fa8e502755e63e > https://github.com/dovecot/core/commit/fcb8a4a04df3de83cf41b548440e8d42ff24fa98 > https://github.com/dovecot/core/commit/619994941f9d9e8e2d108eb3f9f9821a35f60cae Thank you for the patches. I'm now getting some other errors in the logs: doveadm quota get -S localhost:542 -u myaccount is showing Mar 24 01:36:26 doveadm(myaccount): Fatal: mail-storage-service: seteuid(4294967295) failed: Invalid argument and doveadm mailbox status -u myaccount -S localhost:542 messages '*' is showing Mar 24 01:37:43 doveadm(127.0.0.1): Fatal: Client sent invalid command. Usage: mailbox status [-u |-A] [-S ] [...] Without the '-S ...' they are working as expected. Regards, Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! From stephan at rename-it.nl Thu Mar 24 01:06:58 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 24 Mar 2016 02:06:58 +0100 Subject: [BUG] Dovecot 2.2.22 Pigeonhole 0.4.13 - Panic: epoll_ctl(del, 18) failed: Bad file descriptor In-Reply-To: <20160321233928.GF89016@ruhr-uni-bochum.de> References: <20160321233928.GF89016@ruhr-uni-bochum.de> Message-ID: <56F33DB2.50706@rename-it.nl> Op 3/22/2016 om 12:39 AM schreef Andreas Jobs: > Hi, > > I just found some of these in my logs: > > Mar 21 18:42:17 lmtp(andreas.jobs at ruhr-uni-bochum.de): Panic: epoll_ctl(del, 18) failed: Bad file descriptor > Mar 21 18:42:17 lmtp(andreas.jobs at ruhr-uni-bochum.de): Error: Raw backtrace: > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9acdb) [0x7f4d97ec9cdb] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9c074) [0x7f4d97ecb074] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4d97eca021] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handle_remove+0x126) [0x7f4d97ee8830] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xb63f7) [0x7f4d97ee53f7] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f4d97ee544e] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc85c4) [0x7f4d97ef75c4] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc867b) [0x7f4d97ef767b] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_stream_close+0x28) [0x7f4d97ed56b5] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc6349) [0x7f4d97ef5349] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(o_stream_destroy+0x20) [0x7f4d97ef53d9] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x95550) [0x7f4d9720b550] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x95c5a) [0x7f4d9720bc5a] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0xc992c) [0x7f4d97ef892c] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0xcd) [0x7f4d97ee6680] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x1f6) [0x7f4d97ee8a78] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x24) [0x7f4d97ee6826] -> > /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0xaf) [0x7f4d97ee6774] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0x100) [0x7f4d9720c943] -> > /usr/local/dovecot/lib/dovecot/sieve/lib90_sieve_extprograms_plugin.so(sieve_extprogram_run+0x1c) [0x7f4d96735f84] -> > /usr/local/dovecot/lib/dovecot/sieve/lib90_sieve_extprograms_plugin.so(+0x459f) [0x7f4d9673359f] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x3fd61) [0x7f4d971b5d61] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0xaa) [0x7f4d971b5e84] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_start+0x140) [0x7f4d971b6054] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_run+0x47) [0x7f4d971b609d] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x5a1c6) [0x7f4d971d01c6] -> > /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x5c) [0x7f4d971d06fa] -> > /usr/local/dovecot/lib/dovecot/lib90_sieve_plugin.so(+0x3278) [0x7f4d9744b278] > Mar 21 18:42:17 lmtp(andreas.jobs at ruhr-uni-bochum.de): Fatal: master: service(lmtp): child 18908 killed with signal 6 (core dumped) Fixed (few days ago actually): https://github.com/dovecot/pigeonhole/commit/a95b0579b89c13fb3ee5700e76cbe6a4a3e898e0 Regards, Stephan. From ivan at jurisic.org Thu Mar 24 07:20:58 2016 From: ivan at jurisic.org (=?UTF-8?B?SXZhbiBKdXJpxaFpxIc=?=) Date: Thu, 24 Mar 2016 08:20:58 +0100 Subject: Upgrade Dovecot from 2.1.17 to 2.2.13 lmtp child killed with signal 6 In-Reply-To: <56F1222D.6090408@dovecot.fi> References: <56F113BE.30102@jurisic.org> <56F1222D.6090408@dovecot.fi> Message-ID: <56F3955A.8000704@jurisic.org> Hi Teemu, I upgrade Dovecot on 2.2.22-1~auto+6 from repository http://xi.dovecot.fi/debian/ and now all works well. Thanks loot, Ivan On 03/22/2016 11:45 AM, Teemu Huovila wrote: > > On 22.03.2016 11:43, Ivan Juri?i? wrote: >> After upgrade Debian (Wheezy to Jessie) Dovecot version 2.1.17 is >> upgraded to 2.2.13. >> I have random crash of lmtp-a and I got lot message in queue. Any >> solution for this problem? > This looks like it is fixed by https://github.com/dovecot/core/commit/98449946caeaf8a3b413a0d93128315b158cbffb > Please upgrade, if possible. > > br, > Teemu Huovila > >> ---------- Postqueue ---------- >> >> 7A5B77F72B 1160457 Tue Mar 22 10:10:15 ivan at jurisic.org >> (delivery temporarily suspended: lost connection with >> mail.jurisic.org[private/dovecot-lmtp] while sending end of data -- >> message may be sent more than once) >> ante.starcevic at gmail.com >> >> ---------- Log file ---------- >> >> Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Panic: file fs-api.c: >> line 615 (fs_copy): assertion failed: (src->fs == dest->fs) >> >> Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Error: Raw backtrace: >> /usr/lib/dovecot/libdovecot.so.0(+0x6b6fe) [0x7f7647a8b6fe] -> >> /usr/lib/dovecot/libdovecot.so.0(+0x6b7ec) [0x7f7647a8b7ec] -> >> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7647a428fb] -> >> /usr/lib/dovecot/libdovecot.so.0(fs_copy+0x90) [0x7f7647a4c4a0] -> >> /usr/lib/dovecot/libdovecot-storage.so.0(sdbox_copy+0x4e0) >> [0x7f7647d3ec10] -> >> /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0xbaab) [0x7f764726aaab] >> -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x7d) >> [0x7f7647d7b01d] -> >> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x196) >> [0x7f76480229d6] -> >> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf3) [0x7f7648022e13] >> -> dovecot/lmtp(+0x6171) [0x7f7648452171] -> >> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x3f) [0x7f7647a9cd0f] >> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xf9) >> [0x7f7647a9dd09] -> >> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) >> [0x7f7647a9cd79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) >> [0x7f7647a9cdf8] -> >> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) >> [0x7f7647a47dc3] -> dovecot/lmtp(main+0x165) [0x7f76484509b5] -> >> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f7647696b45] >> -> dovecot/lmtp(+0x4a95) [0x7f7648450a95] >> >> Mar 22 10:10:15 lmtp(23497, ivan at jurisic.org): Fatal: master: >> service(lmtp): child 23497 killed with signal 6 (core dumps disabled) >> >> ---------- Dovecot configuration ---------- >> >> # 2.2.13: /etc/dovecot/dovecot.conf >> # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.3 ext4 >> auth_mechanisms = plain login >> debug_log_path = /var/log/dovecot.debug >> default_client_limit = 10000 >> default_process_limit = 1000 >> default_vsz_limit = 512 M >> dict { >> quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext >> } >> hostname = mail.jurisic.org >> info_log_path = /var/log/dovecot.info >> lda_mailbox_autocreate = yes >> lda_mailbox_autosubscribe = yes >> listen = * >> log_path = /var/log/dovecot.log >> mail_attachment_dir = /var/mail/vhosts/%d/attachment >> mail_home = /var/mail/vhosts/%d/mail/%n >> mail_location = sdbox:/var/mail/vhosts/%d/mail/%n >> mail_plugins = " quota" >> mail_privileged_group = vmail >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character vacation subaddress comparator-i;ascii-numeric >> relational regex imap4flags copy include variables body enotify >> environment mailbox date ihave >> namespace inbox { >> inbox = yes >> location = >> mailbox Drafts { >> auto = subscribe >> special_use = \Drafts >> } >> mailbox Junk { >> auto = subscribe >> special_use = \Junk >> } >> mailbox Sent { >> auto = subscribe >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> auto = subscribe >> special_use = \Trash >> } >> prefix = >> } >> passdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> plugin { >> autocreate = Sent >> autocreate2 = Drafts >> autocreate3 = Junk >> autocreate4 = Trash >> autosubscribe = Sent >> autosubscribe2 = Drafts >> autosubscribe3 = Junk >> autosubscribe4 = Trash >> expire = Trash >> expire2 = Trash/* >> expire3 = Spam >> expire_dict = proxy::expire >> quota = dict:user::proxy::quota >> quota_rule = *:storage=102400 >> quota_warning = storage=75%% quota-warning 75 %u >> quota_warning2 = storage=90%% quota-warning 90 %u >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> } >> postmaster_address = postmaster@%d >> protocols = " imap lmtp sieve pop3" >> service auth-worker { >> user = vmail >> } >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0666 >> user = postfix >> } >> unix_listener auth-userdb { >> mode = 0600 >> user = vmail >> } >> user = dovecot >> } >> service dict { >> unix_listener dict { >> mode = 0660 >> user = vmail >> } >> } >> service imap-login { >> process_min_avail = 4 >> service_count = 0 >> vsz_limit = 512 M >> } >> service imap { >> vsz_limit = 512 M >> } >> service lmtp { >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = postfix >> mode = 0600 >> user = postfix >> } >> } >> service quota-warning { >> executable = script /opt/mail-old.sh >> unix_listener quota-warning { >> group = root >> mode = 0666 >> user = root >> } >> user = root >> } >> ssl = required >> ssl_cert = > ssl_cipher_list = >> !aNULL:!eNULL:!EXPORT:!DES:!MD5:!PSK:!EDH:!ADH:!DSS:!RC4:HIGH:+3DES >> ssl_key = > ssl_prefer_server_ciphers = yes >> ssl_protocols = TLSv1 !SSLv2 !SSLv3 >> userdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> protocol lmtp { >> mail_plugins = " quota sieve" >> } >> protocol lda { >> mail_plugins = " quota sieve" >> } >> protocol imap { >> mail_max_userip_connections = 20 >> mail_plugins = " quota imap_quota" >> } >> protocol pop3 { >> mail_max_userip_connections = 20 >> mail_plugins = " quota quota" >> } >> From andrzej.filip at gmail.com Thu Mar 24 15:45:21 2016 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Thu, 24 Mar 2016 16:45:21 +0100 Subject: sieve: filtering based on default destination/folder Message-ID: Is it possible to make sieve filter based on default destination/folder? How to trigger special processing/filtering rules when deliver has been executed as 'deliver -m archive ...' ? -- A. Filip From dovecot at knutejohnson.com Thu Mar 24 15:54:47 2016 From: dovecot at knutejohnson.com (Knute Johnson) Date: Thu, 24 Mar 2016 08:54:47 -0700 Subject: Setting up replication? In-Reply-To: <56F309FD.6030704@knutejohnson.com> References: <56F309FD.6030704@knutejohnson.com> Message-ID: <56F40DC7.7000309@knutejohnson.com> On 3/23/2016 14:26, Knute Johnson wrote: > I'm trying to set up replication between two servers and I've hit a > snag. I have two users and am using mbox files. If anybody has a > sample config file for a simple system like mine I would really be > grateful to see it. > > Thanks, > > The error I'm getting is: > > Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: > user nobody: Initialization failed: Namespace '': > mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) > egid=65534(nogroup)) > Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: > dsync-server: User init failed > Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: Failed > to start dsync-server command: 75 > > knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' > nobody > knute > penny > > I don't know why the user 'nobody' shows up here? nobody is in the > /etc/passwd file but he has no group. > > knute at knute2:/ $ cat /etc/passwd | grep nobody > nobody:x:65534:65534:nobody:/nonexistent:/usr/sbin/nologin > > ----------------------- > > I created a separate config file as suggested in Peer Heinlein's book. > > knute at knute2:/etc/dovecot/conf.d $ cat 12-replication.conf > mail_plugins = $mail_plugins notify replication > > service replicator { > process_min_avail = 1 > unix_listener replicator-doveadm { > mode = 0600 > } > } > > service aggregator { > fifo_listener replication-notify-fifo { > mode = 0666 > } > unix_listener replication-notify { > mode = 0666 > } > } > > service doveadm { > inet_listener { > port = 30303 > } > } > > #doveadm_port = 30303 > > doveadm_password = secret > > plugin { > mail_replica = tcp:knute2.frazmtn.com:30303 > } > > replication_dsync_parameters = -d -N -l 30 -U > > --------------------- I've got it working more or less. I had to change the mode of replicator-doveadm to 0666. I'm still getting errors for 'nobody' but that doesn't seem to cause it to not work, just annoying. Can anybody explain the significance of the mode? I'm syncing between a 2.2.9 and 2.2.13 system. Any thing I should look for? Thanks, -- Knute Johnson From wlt-ml at o-sinc.com Thu Mar 24 19:10:33 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Thu, 24 Mar 2016 15:10:33 -0400 Subject: Replication issues master <-> master nfs backend In-Reply-To: References: Message-ID: On Tuesday, March 22, 2016 03:30:38 PM William L. Thomson Jr. wrote: > > Then I manually log into mail2 and run this command, though usually I can > run it from either side, and just change the name to the other server. > > doveadm sync -u "*" remote:mail1 > > Tempted to have cron invoke that on the regular, but seems very hackish and > likely will have its own issues doing that. Broke down and went with the hackish approach of having cron run doveadm sync every 15 minutes during business hours. Not ideal, but seems to correct the syncing delays. Hopefully no side effects. */15 8-18 * * * root /usr/bin/doveadm sync -u "*" remote:mail2 It corrects or bandaids the problem where mail remains on one server only for extended periods, several hours. While users check email on another, and never see the emails on the other server. While sync status shows fast and full sync having completed, no errors in logs etc. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com From stephan at rename-it.nl Thu Mar 24 20:14:45 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 24 Mar 2016 21:14:45 +0100 Subject: sieve: filtering based on default destination/folder In-Reply-To: References: Message-ID: <56F44AB5.2060105@rename-it.nl> Op 3/24/2016 om 4:45 PM schreef Andrzej A. Filip: > Is it possible to make sieve filter based on default destination/folder? > > How to trigger special processing/filtering rules when deliver has been executed as > 'deliver -m archive ...' ? > Not in any standard way. Dovecot has a vendor-specific extension for this: https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/rfc/spec-bosch-sieve-dovecot-environment.txt But only for fairly recent versions. You need to enable this extension using the sieve_extensions setting (or sieve_global_extensions). Regards, Stephan. From bunkertor at tiscali.it Thu Mar 24 22:21:11 2016 From: bunkertor at tiscali.it (dovecot) Date: Fri, 25 Mar 2016 01:21:11 +0300 Subject: Fw: new important message Message-ID: <0000da12aab0$81bc66ed$66b78746$@tiscali.it> Hello! New message, please read dovecot From andrzej.filip at gmail.com Fri Mar 25 00:22:38 2016 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Fri, 25 Mar 2016 01:22:38 +0100 Subject: sieve: filtering based on default destination/folder In-Reply-To: <56F44AB5.2060105@rename-it.nl> (Stephan Bosch's message of "Thu, 24 Mar 2016 21:14:45 +0100") References: <56F44AB5.2060105@rename-it.nl> Message-ID: Stephan Bosch wrote: > Op 3/24/2016 om 4:45 PM schreef Andrzej A. Filip: >> Is it possible to make sieve filter based on default destination/folder? >> >> How to trigger special processing/filtering rules when deliver has been executed as >> 'deliver -m archive ...' ? >> > Not in any standard way. > > Dovecot has a vendor-specific extension for this: > > https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/rfc/spec-bosch-sieve-dovecot-environment.txt > > But only for fairly recent versions. > > You need to enable this extension using the sieve_extensions setting (or > sieve_global_extensions). > > Regards, > > Stephan. It seems to be what I have wanted. Precompiled dovecot package I use does not support it (yet). Thank you for the hint what I should wait for :-) -- A. Filip From dwilson at hanceville.biz Fri Mar 25 00:45:57 2016 From: dwilson at hanceville.biz (Dan Wilson) Date: Thu, 24 Mar 2016 19:45:57 -0500 Subject: Trouble handling encrypted passwords Message-ID: <56F48A45.8050903@hanceville.biz> I am running into trouble when I try to use encrypted passwords. I set my dovecot 2.2.10-5 installation back to plain text passwords and was then able to login and retrieve emails. When I set the default_pass_scheme to MD5-CRYPT in my sql config file, and store an MD5-CRYPT password in the sql database, I invariably get password mismatch errors on login: Mar 24 19:40:30 server1 dovecot: auth: Debug: client in: AUTH#0113#011PLAIN#011service=imap#011secured#011session=25HcztQuwQBHCDBi#011lip=xx.x.xx.xxx#011rip=71.8.48.98#011lport=993#011rport=60609#011resp= Mar 24 19:40:34 server1 dovecot: auth-worker(9443): Debug: sql(test1 at xxxxxx.com,xx.x.xx.xx): query: SELECT email as user, password FROM virtual_users WHERE email='test1 at xxxxxx.com'; Mar 24 19:40:34 server1 dovecot: auth-worker(9443): sql(test1 at xxxxxx,xx.x.xx.xx): Password mismatch Mar 24 19:40:36 server1 dovecot: auth: Debug: client passdb out: FAIL#0113#011user=test1 at xxxxxx.com The password in the database was created using doveadm pw command and is stored as: {MD5-CRYPT}$1$5QAeG70c$dP8y7XJVd.VxZBF/DvcAa0 I tried removing the {MD5-CRYPT} from the password string, but that didn't help. I have to be doing something stupid because this should just work! Any ideas from anyone? Thanks much, Dan From pj.netfilter at gmail.com Fri Mar 25 06:51:29 2016 From: pj.netfilter at gmail.com (Joy) Date: Fri, 25 Mar 2016 12:21:29 +0530 Subject: IMAP Idle Message-ID: Hi guys, We have implement imap idle in web mail built by us to have push mail feature. IMAP idle working perfectly with browser notification and we are happy with it but having one issue with users who close the browser directly and never logout in that case there are number of idle connection which are not in use and users are unable to login once IP wise connection limit is reached. Dovecot is not closing connection which are not in use, is there any setting available which can help me to resolve this issue. From nmilas at noa.gr Fri Mar 25 11:19:12 2016 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 25 Mar 2016 13:19:12 +0200 Subject: Some mails seen only via POP3 but not via IMAP Message-ID: <56F51EB0.10703@noa.gr> Hello, We are using dovecot-2.2.18 on CentOS 5 (with Postfix 2.11.6). There is a usercomplaining that some incoming mails never show up in webmail (we are using squirrelmail - the user is checking for mail regularly and is not ignorant) and can only be seen/downloaded through a mail client via POP3 (the user uses "Leave on Server" option). Has anyone seen such a behavior? Can you suggest some troubleshooting steps or solution? What may cause some mails to not show in webmail - (or in general to mails accessed via IMAP, as I interpret it)? Here is a description of user's mail directory (I have modified real server name and real user name): [root at vmail ~]# tree -a /home/vmail/userx/Maildir /home/vmail/userx/Maildir |-- .Drafts | |-- cur | | `-- 1291495293.M455532P28446.mail.example.com,S=2016,W=2060:2,DS | |-- dovecot-uidlist | |-- dovecot.index.cache | |-- dovecot.index.log | |-- maildirfolder | |-- new | `-- tmp |-- .INBOX.Drafts | |-- cur | | `-- 1317985345.M717332P17981.mail.example.com,S=1256,W=1298:2,S | |-- dovecot-uidlist | |-- dovecot.index.cache | |-- dovecot.index.log | |-- maildirfolder | |-- new | `-- tmp |-- .INBOX.Sent | |-- cur | | |-- 1303148518.M786490P28055.mail.example.com,S=383974,W=388998:2,S | | |-- | | `-- 1458641247.M780515P22153.mail.example.com,S=2778,W=2888:2,S | |-- dovecot-uidlist | |-- dovecot.index | |-- dovecot.index.cache | |-- dovecot.index.log | |-- maildirfolder | |-- new | `-- tmp |-- .INBOX.Trash | |-- cur | | |-- 1455084995.M236797P27939.mail.example.com,S=39655,W=40327:2,S | | |-- 1455084996.M373621P27992.mail.example.com,S=94946,W=97005:2,S | | |-- 1455690687.M743447P11583.mail.example.com,S=109210,W=111694:2,S | | |-- 1456121828.M32979P25956.mail.example.com,S=174894,W=178527:2,S | | `-- 1456366474.M522472P27380.mail.example.com,S=20063,W=20335:2,S | |-- dovecot-uidlist | |-- dovecot.index.cache | |-- dovecot.index.log | |-- maildirfolder | |-- new | | |-- 1449469045.M142541P26276.mail.example.com,S=118084,W=120599 | | |-- 1449814602.M29713P24846.mail.example.com,S=113968,W=116461 | | |-- 1450678606.M352804P11212.mail.example.com,S=191359,W=195422 | | |-- 1451034941.M878471P18927.mail.example.com,S=77701,W=79419 | | |-- 1451097359.M319601P27933.mail.example.com,S=117288,W=119151 | | |-- 1451459809.M54788P7084.mail.example.com,S=134906,W=137765 | | |-- 1453702659.M398592P1919.mail.example.com,S=142222,W=145237 | | `-- 1455441375.M222594P8728.mail.example.com,S=72778,W=74381 | `-- tmp |-- .Sent | |-- cur | | |-- 1291025141.M538922P4661.mail.example.com,S=428,W=440:2,S | | `-- 1291028972.M219139P6461.mail.example.com,S=678,W=703:2,S | |-- dovecot-uidlist | |-- dovecot.index.cache | |-- dovecot.index.log | |-- maildirfolder | |-- new | `-- tmp |-- .Trash | |-- cur | |-- dovecot-uidlist | |-- dovecot.index.cache | |-- dovecot.index.log | |-- maildirfolder | |-- new | `-- tmp |-- cur | |-- 1457129096.M348209P26766.mail.example.com,S=146633,W=148587:2,S | |-- | `-- 1458901831.M100577P22147.mail.example.com,S=2439,W=2485:2,S |-- dovecot-keywords |-- dovecot-uidlist |-- dovecot-uidvalidity |-- dovecot-uidvalidity.4cf379b0 |-- dovecot-uidvalidity.53347527 |-- dovecot.index |-- dovecot.index.cache |-- dovecot.index.log |-- dovecot.index.thread |-- dovecot.mailbox.log |-- maildirfolder |-- maildirsize |-- new |-- subscriptions `-- tmp 27 directories, 468 files Some additional info: [root at mail ~]# doveadm quota get -u userx Quota name Type Value Limit % User quota STORAGE 274366 5242880 5 User quota MESSAGE 430 - 0 Thanks in advance, Nick From SOAN at stofa.dk Fri Mar 25 16:20:50 2016 From: SOAN at stofa.dk (=?iso-8859-1?Q?S=F8ren_Andersen?=) Date: Fri, 25 Mar 2016 16:20:50 +0000 Subject: Dovecot on FreeBSD 10.1 Message-ID: I'm experiencing the same problem as mentioned earlier in the mailing list. - Is there some kind of workaround for this issue? http://dovecot.org/pipermail/dovecot/2015-April/100549.html /S?ren From bunkertor at tiscali.it Fri Mar 25 16:23:14 2016 From: bunkertor at tiscali.it (ferdinando) Date: Fri, 25 Mar 2016 17:23:14 +0100 Subject: pigeonhole In-Reply-To: References: Message-ID: <7565f7ff61fe14cc610a75733875c095@tiscali.it> > hi all > > im trying to install pigeonhole with dovecot2 but it stops > during "make install" with this > error: > > ========================================================================================== > .... > /bin/sh > ../../libtool --mode=install /usr/bin/install -c sievec sieve-dump > sieve-test sieve-filter > '/usr/local/cluster/fs-cl00/mail/sieve/bin' > libtool: install: > /usr/bin/install -c .libs/sievec > /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec > /usr/bin/install: > setting permissions for > '/usr/local/cluster/fs-cl00/mail/sieve/bin/sievec': No data > available > Makefile:450: recipe for target 'install-binPROGRAMS' > failed > make[3]: *** [install-binPROGRAMS] Error 1 > make[3]: Leaving > directory '/usr/local/src/pigeonhole/src/sieve-tools' > Makefile:648: > recipe for target 'install-am' failed > make[2]: *** [install-am] Error > 2 > make[2]: Leaving directory > '/usr/local/src/pigeonhole/src/sieve-tools' > Makefile:417: recipe for > target 'install-recursive' failed > make[1]: *** [install-recursive] Error > 1 > make[1]: Leaving directory > '/usr/local/src/pigeonhole/src' > Makefile:732: recipe for target > 'install-recursive' failed > make: *** [install-recursive] Error > 1 > [root at mail02 pigeonhole]# > [root at mail02 pigeonhole]# ls -l > /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec > -rw------- 1 root root > 118504 Mar 23 19:31 > /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec > [root at mail02 > pigeonhole]# file > /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec > /usr/local/cluster/fs-cl00/mail/sieve/bin/sievec: > ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically > linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux > 2.6.32, > BuildID[sha1]=586da03004b77848d5e1c66f9bb33259a984ba48, not > stripped > [root at mail02 > pigeonhole]# > ... > ========================================================================================== > > configure > is ok, no particular options are required, only ldap module enabled > by > plugin. > make is ok, the job exits with no errors. > dovecot itself seems > ok, it's up and running > what do i miss? need some particular uids/gids > to accomplish the installation? > > here's my specs: > pigeonhole commit > 1d36af65473016aa8339a3671d8b555adc71cef3 > dovecot commit > 4a769606eb49926c6dfb9a532186e9e737683283 > Fedora release 23 > Linux > version 4.4.5-300.fc23.x86_64 > gcc version 5.3.1 > > thanks a lot in advance > for any help =) > > Connetti gratis il mondo con la nuova indoona: hai la chat, le > chiamate, > le video chiamate e persino le chiamate di gruppo. > E chiami gratis anche i numeri fissi e mobili nel mondo! > Scarica subito l'app Vai su https://www.indoona.com/ [1] hi all probably solved installing pigeonhole on xfs partitions. it returns the error above on gfs2 partitions. with regards. Connetti gratis il mondo con la nuova indoona: hai la chat, le chiamate, le video chiamate e persino le chiamate di gruppo. E chiami gratis anche i numeri fissi e mobili nel mondo! Scarica subito l?app Vai su https://www.indoona.com/ From jamieson.maria at yahoo.com Fri Mar 25 16:48:37 2016 From: jamieson.maria at yahoo.com (MARIA jamieson) Date: Fri, 25 Mar 2016 16:48:37 +0000 (UTC) Subject: Need help solving issue References: <1199314360.5382711.1458924517308.JavaMail.yahoo.ref@mail.yahoo.com> Message-ID: <1199314360.5382711.1458924517308.JavaMail.yahoo@mail.yahoo.com> Hi, I am using Dovecot 2.2.18 ?and have migrated from a 1.x versions. After this migration I had several errors and obsolete errors in logs. I fixed them and after all that I finally was able to run postfix and dovecot again. The problem I have facing right now is that in the mail logs and in the dovecot logs. I am getting auth errors. In mail log the postfix is spitting out: "?fatal: no SASL authentication mechanisms" Dovecot is spitting this out?"imap-login?:?Auth process broken (disconnected before auth was ready, waited 0 secs): ,user<>, the shows client ip, my server ip and then the 0 seconds connection?etc. Error: auth: environment corrupt; missing value for DOVECOT_" That is what it spits out. ?I asked for help and many threads.I am using freebsd 10.2. ?I do use mysql for database. I need someone to explain what the error means and how I can fix it?? Thank you for your time!? From larryrtx at gmail.com Fri Mar 25 16:56:13 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Fri, 25 Mar 2016 11:56:13 -0500 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: I'm running the latest dovecot2 port (and am the maintainer of mail/dovecot2-pigeonhole). What version of dovecot are you running? You should be using the ports version (mail/dovecot2). It runs just fine out of the box. If you need help, ping me. On Fri, Mar 25, 2016 at 11:20 AM, S?ren Andersen wrote: > I'm experiencing the same problem as mentioned earlier in the mailing > list. - Is there some kind of workaround for this issue? > > http://dovecot.org/pipermail/dovecot/2015-April/100549.html > > > /S?ren > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 From SOAN at stofa.dk Fri Mar 25 18:32:53 2016 From: SOAN at stofa.dk (=?utf-8?B?U8O4cmVuIEFuZGVyc2Vu?=) Date: Fri, 25 Mar 2016 18:32:53 +0000 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: Hi Larry, I?m running dovecot2-2.2.22. ? I?ve tried to compile dovecot from the souce, and I see the same error :/ Are you using sql auth in your setup? root at beastie:/var/log # doveconf -n # 2.2.22 (fe789d2): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: FreeBSD 10.1-RELEASE-p6 amd64 zfs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no hostname = beastie.*** info_log_path = /var/log/dovecot-info.log mail_debug = yes mail_location = maildir:/data/vmail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = postmaster@**** protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = no ssl_cert = Cc: dovecot at dovecot.org Subject: Re: Dovecot on FreeBSD 10.1 I'm running the latest dovecot2 port (and am the maintainer of mail/dovecot2-pigeonhole). What version of dovecot are you running? You should be using the ports version (mail/dovecot2). It runs just fine out of the box. If you need help, ping me. On Fri, Mar 25, 2016 at 11:20 AM, S?ren Andersen > wrote: I'm experiencing the same problem as mentioned earlier in the mailing list. - Is there some kind of workaround for this issue? http://dovecot.org/pipermail/dovecot/2015-April/100549.html /S?ren -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 From larryrtx at gmail.com Fri Mar 25 18:35:05 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Fri, 25 Mar 2016 13:35:05 -0500 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: please give me the EXACT error you receive? And, what DB are you using? On Fri, Mar 25, 2016 at 1:32 PM, S?ren Andersen wrote: > Hi Larry, > > > > I?m running dovecot2-2.2.22. ? I?ve tried to compile dovecot from the > souce, and I see the same error :/ > > > > Are you using sql auth in your setup? > > > > root at beastie:/var/log # doveconf -n > > # 2.2.22 (fe789d2): /usr/local/etc/dovecot/dovecot.conf > > # Pigeonhole version 0.4.13 (7b14904) > > # OS: FreeBSD 10.1-RELEASE-p6 amd64 zfs > > auth_debug = yes > > auth_debug_passwords = yes > > auth_mechanisms = plain login > > auth_verbose = yes > > disable_plaintext_auth = no > > hostname = beastie.*** > > info_log_path = /var/log/dovecot-info.log > > mail_debug = yes > > mail_location = maildir:/data/vmail/%d/%n > > managesieve_notify_capability = mailto > > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date index ihave > duplicate mime foreverypart extracttext > > namespace inbox { > > inbox = yes > > location = > > mailbox Drafts { > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > special_use = \Sent > > } > > mailbox Trash { > > special_use = \Trash > > } > > prefix = > > } > > passdb { > > args = /usr/local/etc/dovecot/dovecot-sql.conf.ext > > driver = sql > > } > > postmaster_address = postmaster@**** > > protocols = imap lmtp > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0666 > > user = postfix > > } > > } > > ssl = no > > ssl_cert = > ssl_key = > userdb { > > args = uid=vmail gid=vmail home=/data/vmail/%d/%n > > driver = static > > } > > verbose_proctitle = yes > > verbose_ssl = yes > > protocol lda { > > mail_plugins = > > } > > > > /S?ren > > > > *From:* Larry Rosenman [mailto:larryrtx at gmail.com] > *Sent:* 25. marts 2016 17:56 > *To:* S?ren Andersen > *Cc:* dovecot at dovecot.org > *Subject:* Re: Dovecot on FreeBSD 10.1 > > > > I'm running the latest dovecot2 port (and am the maintainer of > mail/dovecot2-pigeonhole). What version of dovecot are you > > running? You should be using the ports version (mail/dovecot2). > > > > It runs just fine out of the box. If you need help, ping me. > > > > > > On Fri, Mar 25, 2016 at 11:20 AM, S?ren Andersen wrote: > > I'm experiencing the same problem as mentioned earlier in the mailing > list. - Is there some kind of workaround for this issue? > > http://dovecot.org/pipermail/dovecot/2015-April/100549.html > > > /S?ren > > > > > > -- > > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com > US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 From aki.tuomi at dovecot.fi Fri Mar 25 18:41:02 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Fri, 25 Mar 2016 20:41:02 +0200 (EET) Subject: Need help solving issue In-Reply-To: <1199314360.5382711.1458924517308.JavaMail.yahoo@mail.yahoo.com> References: <1199314360.5382711.1458924517308.JavaMail.yahoo.ref@mail.yahoo.com> <1199314360.5382711.1458924517308.JavaMail.yahoo@mail.yahoo.com> Message-ID: <128780316.16727.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> > On March 25, 2016 at 6:48 PM MARIA jamieson wrote: > > > Hi, I am using Dovecot 2.2.18 ?and have migrated from a 1.x versions. After > this migration I had several errors and obsolete errors in logs. I fixed them > and after all that I finally was able to run postfix and dovecot again. > The problem I have facing right now is that in the mail logs and in the > dovecot logs. I am getting auth errors. > In mail log the postfix is spitting out: "?fatal: no SASL authentication > mechanisms" > Dovecot is spitting this out?"imap-login?:?Auth process broken (disconnected > before auth was ready, waited 0 secs): ,user<>, the shows client ip, my server > ip and then the 0 seconds connection?etc. > Error: auth: environment corrupt; missing value for DOVECOT_" > > That is what it spits out. ?I asked for help and many threads.I am using > freebsd 10.2. ?I do use mysql for database. I need someone to explain what the > error means and how I can fix it?? > Thank you for your time! Hi! Can you provide your postconf -n and doveconf -n output? This sounds like configuration error. Aki Tuomi Dovecot Oy From larryrtx at gmail.com Fri Mar 25 18:46:18 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Fri, 25 Mar 2016 13:46:18 -0500 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: I'll take a look when I get home > Hi Larry, I?m getting this error: cat /var/log/maillog Mar 25 19:39:56 beastie dovecot: auth: Error: auth: environment corrupt; missing value for DOVECOT_ Mar 25 19:39:56 beastie dovecot: auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Mar 25 19:39:56 beastie dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs cat /var/log/dovecot-info.log Mar 25 19:39:41 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:41 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:41 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= Mar 25 19:39:49 master: Info: Dovecot v2.2.22 (fe789d2) starting up for imap, lmtp Mar 25 19:39:56 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:56 auth: Debug: Wrote new auth token secret to /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:56 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= I?m running mariadb100-server-10.0.23, and I tried to recompile every dependencies for dovecot, postfix, mariadb-server without any luck. /S?ren From jtam.home at gmail.com Fri Mar 25 21:22:23 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Fri, 25 Mar 2016 14:22:23 -0700 (PDT) Subject: IMAP Idle In-Reply-To: References: Message-ID: Joy wrote: > We have implement imap idle in web mail built by us to have > push mail feature. IMAP idle working perfectly with browser notification > and we are happy with it but having one issue with users who close the > browser directly and never logout in that case there are number of idle > connection which are not in use and users are unable to login once IP wise > connection limit is reached. > > Dovecot is not closing connection which are not in use, is there any > setting available which can help me to resolve this issue. I had much the same situation where a user signed up with a roaming wireless carrier that assigned a new IP to the client whenever it got passed from one access point to another. Good fun when this person took a bus ride through the city, leaving orphaned connections in its wake. The IDLE disconnection timeout is hardwired in the Dovecot code http://wiki.dovecot.org/Timeouts It's set to the RFC minimum of 30min. You'll have to recompile Dovecot to lower this to a non-RFC compliant value. I'm not sure how this this will affect clients, but 30min seems to be overly generous. Joseph Tam From simonpie at cs.mcgill.ca Fri Mar 25 23:26:11 2016 From: simonpie at cs.mcgill.ca (Simon Pierre Desrosiers) Date: Fri, 25 Mar 2016 19:26:11 -0400 Subject: State for dsync not working. Message-ID: Hello, Since replication does not seem to work on Mac OSX, I will run doveadm sync by hand every few minutes. In order to improve efficiency, I would like to use state. I have tried a few ways, but I always get the following error doveadm(user): Error: Saved sync state is invalid, falling back to full sync: Invalid base64 data KBtMOd0181bQ/wAAoQsxE90181YBAAAAAQAAAAAAAAAAAAAAAAAAABtI+mg= Here is the code I use to sync : for user in $userlist ; do doveadm sync -u $user -s "/Users/_dovecot/.bin/syncStates/syncstate$user" tcp:xxx.xxx.xxx.xxx > "/Users/_dovecot/.bin/syncStates/syncstate$user" done Any idea on how I can correct the encoding error ? Thank you From noel.butler at ausics.net Sat Mar 26 03:30:03 2016 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 26 Mar 2016 13:30:03 +1000 Subject: NetApp NFS vs. ZFS and NFS for Maildir In-Reply-To: <20160319091131.2a24b0e6.skraw@ithnet.com> References: <56E2D497.9030109@skye.it> <56E2DCF8.1090204@inti.gob.ar> <20160311161750.a4750629.skraw@ithnet.com> <56E536A2.7070808@xdrv.co.uk> <20160313114723.fae88c6c.skraw@ithnet.com> <20160314005937.989a9f2e.skraw@ithnet.com> <20160314094946.a5d95f0a.skraw@ithnet.com> <20160319091131.2a24b0e6.skraw@ithnet.com> Message-ID: <79e7f44d74014b5c83d370d74e02205b@ausics.net> It seems its troll time again on this list, ohh maybe its Harry in disguise... So I will play along, for today anyway :) On 19/03/2016 18:11, Stephan von Krawczynski wrote: > On Sat, 19 Mar 2016 17:37:04 +1000 > Noel Butler wrote: > >> On 14/03/2016 18:49, Stephan von Krawczynski wrote: >> > >> >> >> >> and you've never seen these cause problems with FS? then you must be >> >> a >> >> newbie, in over 25 years I've seen it happen several times - yes even >> >> after an apparent controlled shutdown. >> > >> > Maybe you're doing something wrong then. because in my last 21 years >> > working >> > exactly in this business I've not seen a single deadly fs-crash because >> > of a >> > power-outage. Not one. And we had of course several, all backed by UPS. >> >> Consider yourself lucky, Most network admins whove been around large >> busy ISP DC's have seen this in their lifetime, to not have seen one >> is >> rare, go buy yourself a lotto ticket :) >> >> > >> > If your servers get drowned with water during a fire your fs is >> > probably the >> > least of your worries. You don't really plan to re-enable servers with >> > water- or fire-damage, do you? That's probably why there shouldn't be a >> > fireman pouring water in the first place. >> >> This shows you dont understand structural engineering, the fire does >> not >> have to be on your floor, it can be far away as two or so levels >> above, >> with the high pressure water used - equating to a shitload of water, >> there are ducts, shafts, other risers and so on that with a shit-tone >> of >> water can easily penetrate fireblocks of floors below - dont take my >> work, go ask a fireman, or maybe watch the nightly news sometime >> (building fire - many levels water affected blah blah blah)... so >> keeping those boxes on via UPS's is asking for lots of charcoaled >> boards >> and fried drives. IOW, total stupidity. >> >> Should those machines be depowered as required by our building codes, >> well, might take a few days of drying out but at least they will power >> back up without error - yes, done it in risk assessments. > > Obviously you must work for people that have not the slightest idea > about > using hardware in a correct way and don't know when the time has come > to throw > it away. Man, there is no way to let a drowned box survive. It is not > back to Wow, how long did you allege to have been in network/sys admin? 20 years? Really? I think you made a typo and and it should have read 20 minutes, ya know I have refrained from posting no here for a long time (apart from fact I rarely read the list), and I was not going to feed the trolls, but sometimes the smart mouthed know nothing, need to bitch slap upside the head so thats why I am devoting about 60 seconds to you. Of course there is, networks dont throw away many hundreds of servers valued $7K to $10K, nor $100K+ storage systems, or $40K routers, LB's or switches, just because they got drenched - with power isolated. > normal when it is dry. If you don't get that I am pretty happy to be no > customer. This can only be an idea born in the sick mind of a > controller who You will never be a customer _or_employee_ of mine, trust me on that one! > didn't want to pay insurance in the first place. We are talking about > serious Got nothing to with insurance, it might take 2 days to dry out and get back up and running, it will take an awful lot longer to get offsite backups and restore every last one of them. I hope your employer reads this list, because he/she should be seeing alarm bells from your comments. > corrosion effects here let alone that you have a hard time even > knowning when yep, you sure did fail basic engineering > your boxes are really dry. Your fireman on the other hand seem to be > stuck in > the 80ths. Today there are solar panels almost everywhere _which you > cannot > turn off_. Wow, you really are clutching the fantasy straws arnt you, perhaps your country lacks modernisation, I can go to the side of my house and isolate the panels with a flick of a switch, strangely enough and I guess in your eyes horrifyingly called "solar isolator" that stops the panels providing power to my electrical circuits, yes, there might be power from panels to it, but thats not going to affect my power circuits or equipment -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From noel.butler at ausics.net Sat Mar 26 03:34:34 2016 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 26 Mar 2016 13:34:34 +1000 Subject: Email hosting provider In-Reply-To: References: Message-ID: <2b1abc9c94e3f1322753d7547cb991e4@ausics.net> On 21/03/2016 17:06, Andre Rodier wrote: > Hello, > > Sorry if I am off topic a little. > > I am looking for an email host provider that supports dovecot, sieve > and manage sieve. Ideally with the roundcube webmail and managesieve > plugin > > Better if it is in Europe or switzerland. I don't mind paying a little. > > Thanks, > Andr?. Hi Andre, see www.webhostingtalk.com There are a number of reliable and reasonable priced hosts in Germany (best place if you value your privacy) and Netherlands. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From pj.netfilter at gmail.com Sat Mar 26 05:22:33 2016 From: pj.netfilter at gmail.com (Joy) Date: Sat, 26 Mar 2016 10:52:33 +0530 Subject: IMAP Idle In-Reply-To: References: Message-ID: I am ok if connection is closed automatically after 30 min if client is not responding but connection is not being closed even after 2 days. On Sat, Mar 26, 2016 at 2:52 AM, Joseph Tam wrote: > Joy wrote: > > We have implement imap idle in web mail built by us to have >> push mail feature. IMAP idle working perfectly with browser notification >> and we are happy with it but having one issue with users who close the >> browser directly and never logout in that case there are number of idle >> connection which are not in use and users are unable to login once IP wise >> connection limit is reached. >> >> Dovecot is not closing connection which are not in use, is there any >> setting available which can help me to resolve this issue. >> > > I had much the same situation where a user signed up with a roaming > wireless carrier that assigned a new IP to the client whenever it got > passed from one access point to another. Good fun when this person > took a bus ride through the city, leaving orphaned connections in > its wake. > > The IDLE disconnection timeout is hardwired in the Dovecot code > > http://wiki.dovecot.org/Timeouts > > It's set to the RFC minimum of 30min. You'll have to recompile Dovecot > to lower this to a non-RFC compliant value. I'm not sure how this this > will affect clients, but 30min seems to be overly generous. > > Joseph Tam > From skraw at ithnet.com Sat Mar 26 07:04:33 2016 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Sat, 26 Mar 2016 08:04:33 +0100 Subject: Email hosting provider In-Reply-To: <2b1abc9c94e3f1322753d7547cb991e4@ausics.net> References: <2b1abc9c94e3f1322753d7547cb991e4@ausics.net> Message-ID: <20160326080433.07fcf216.skraw@ithnet.com> On Sat, 26 Mar 2016 13:34:34 +1000 Noel Butler wrote: > On 21/03/2016 17:06, Andre Rodier wrote: > > Hello, > > > > Sorry if I am off topic a little. > > > > I am looking for an email host provider that supports dovecot, sieve > > and manage sieve. Ideally with the roundcube webmail and managesieve > > plugin > > > > Better if it is in Europe or switzerland. I don't mind paying a little. > > > > Thanks, > > Andr?. > > Hi Andre, > > see www.webhostingtalk.com > > There are a number of reliable and reasonable priced hosts in Germany > (best place if you value your privacy) and Netherlands. You mean "best place if you have no idea of the german laws and whats really going on" ... -- Regards, Stephan From mick.crane at gmail.com Sat Mar 26 10:48:47 2016 From: mick.crane at gmail.com (michael crane) Date: Sat, 26 Mar 2016 10:48:47 +0000 Subject: mailbox prefix Message-ID: dovecot version 2.2.13 hello, I try to make a new server just for me after having old one working for ages with Dovecot, Fetchmail, Squirrelmail, Procmail making new one with above plus Postfix using Maildir structure. I am having a bit of trouble understanding exactly what the namespace and prefix are. Is the "private/" prefix an internal thing with Dovecot ? Or is it supposed to be a real directory ? I'm not quite sure how to properly address the INBOX in Procmail, Squirrelmail, Postfix config. for example am I supposed to say inbox is ".private/.INBOX" cheers zemlik From Ron at Cleven.com Sat Mar 26 10:52:44 2016 From: Ron at Cleven.com (Ron Cleven) Date: Sat, 26 Mar 2016 05:52:44 -0500 (CDT) Subject: Reappearing emails - IMAP trace In-Reply-To: References: Message-ID: <56F66A05.60603@Cleven.com> >> > >> >A few days back, I sent an overview of this problem, but received no responses. Since then, I have run dozens of traces to isolate the problem, difficult because there are timing issues involved. I have finally nailed it down. If this is not the proper place to report such bugs or if someone knows that this bug has been fixed, please let me know. As I noted in my earlier post, we have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. >> > >> >Recently we received a report that emails could reappear in the INBOX after being deleted. After running a pile of traces, I determined that the problem was strangely related to replications. For the purposes of this discussion, I will refer to the two symmetric replicating servers as A and B. Further, let us assume that during "normal" operation, all the emails are delivered to A via SMTP and are replicated to B. Under those assumptions, if the IMAP user connects to A (where the messages were originally delivered), there is no problem, at least no problem I was able to find. The problem I am describing only arises if the IMAP user connects to B. Connecting to B has never presented any other problems that I am aware of. >> > >> >The test for which I have provided the trace starts with a test mailbox containing only 3 unread messages in the INBOX. Moving 1 of the unread messages to Trash is all that is needed to reproduce the problem. Remember this is ONLY a problem if the IMAP sessions do not connect to the server to which the messages were originally delivered. Also, I found that there is a timing window. The critical IMAP commands are: >> > >> > UID STORE xxx +FLAGS.SILENT (\Seen) >> > UID MOVE xxx Trash >> > >> >If you introduce a large enough delay (I arbitrarily chose 5 seconds) between those two commands, there is no problem. Presumably this has to do with the two boxes syncing up some critical data structure. > What mailbox format do you use? Are you able to reproduce this by running doveadm sync commands manually instead of letting replication do it? For example: > > - doveadm sync -s "" -d -u user at domain > state > - Run the UID STORE & UID MOVE > - doveadm sync -s "`cat state`" -d -u user at domain > > There have been some fixes, especially recentlyhttps://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 sounds a bit similar although I don't really see how it would apply here. Would be a good idea to try anyway with v2.2.22.rc1 (which seems to be stable enough that I'll make v2.2.22 release soon). > > Anyway, I attempted a few times to reproduce it with your test but wasn't able to. I was out when you were kind enough to reply. To answer your question, we are using Maildir format. The trace I provided was based upon IMAP interactions with Roundcube (though the problem was reproducable with several mail clients). I left in a few more steps to make the trace look less contrived. However, I reduced it further to just a couple of connection sessions. What I found in that exercise that was not apparent to me in my prior posting was that the "STATUS INBOX" command that ultimately reveals the problem (it shows the message reappearing) only becomes "wrong" when it is done in a subsequent session. That is, even if I inject an artificially large delay after the "UID STORE" / "UID MOVE" commands before the "STATUS INBOX" command in the same session, that result is never "wrong". But, as soon as I open a subsequent IMAP session, the "STATUS INBOX" command then shows the problematic results. I have never dug into the Dovecot code base, but I assume this relates to how the session data is cached and how the replications update it. None of this is relevant if the problem has already been fixed, so I will endeavor to set up a couple of test boxes with the current version to verify. The link you provided does look quite hopeful. Thanks so much. From alec at alec.pl Sat Mar 26 12:20:10 2016 From: alec at alec.pl (A.L.E.C) Date: Sat, 26 Mar 2016 13:20:10 +0100 Subject: Email hosting provider In-Reply-To: References: Message-ID: <56F67E7A.3010105@alec.pl> On 03/21/2016 08:06 AM, Andre Rodier wrote: > Sorry if I am off topic a little. > > I am looking for an email host provider that supports dovecot, sieve and > manage sieve. Ideally with the roundcube webmail and managesieve plugin > > Better if it is in Europe or switzerland. I don't mind paying a little. Why dovecot? I mean, I know it's great, but if you're looking for a hosted service, why do you require specific software? Do you need some specific sieve features? There's a great swiss service https://kolabnow.com. It does not use dovecot, but is 100% open source and it uses Roundcube with managesieve. -- Aleksander 'A.L.E.C' Machniak Kolab Groupware Developer [http://kolab.org] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From andrzej.filip at gmail.com Sat Mar 26 15:50:50 2016 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Sat, 26 Mar 2016 16:50:50 +0100 Subject: sieve: filtering based on default destination/folder [closed] In-Reply-To: <56F44AB5.2060105@rename-it.nl> (Stephan Bosch's message of "Thu, 24 Mar 2016 21:14:45 +0100") References: <56F44AB5.2060105@rename-it.nl> Message-ID: Stephan Bosch wrote: > Op 3/24/2016 om 4:45 PM schreef Andrzej A. Filip: >> Is it possible to make sieve filter based on default destination/folder? >> >> How to trigger special processing/filtering rules when deliver has been executed as >> 'deliver -m archive ...' ? >> > Not in any standard way. > > Dovecot has a vendor-specific extension for this: > > https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/rfc/spec-bosch-sieve-dovecot-environment.txt > > But only for fairly recent versions. > > You need to enable this extension using the sieve_extensions setting (or > sieve_global_extensions). Thank you! It DOES work with my precompiled dovecot package provided by my linux distribution. [I had to "mistype something" in sieve_extensions config option during previous tests] -- A. Filip From jamieson.maria at yahoo.com Sat Mar 26 17:25:05 2016 From: jamieson.maria at yahoo.com (MARIA jamieson) Date: Sat, 26 Mar 2016 17:25:05 +0000 (UTC) Subject: Need help solving issue In-Reply-To: <128780316.16727.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> References: <128780316.16727.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> Message-ID: <1753093414.211865.1459013105975.JavaMail.yahoo@mail.yahoo.com> So, is the config correct? Am I missing something in the configs?? On Friday, March 25, 2016 2:41 PM, "aki.tuomi at dovecot.fi" wrote: > On March 25, 2016 at 6:48 PM MARIA jamieson wrote: > > > Hi, I am using Dovecot 2.2.18 ?and have migrated from a 1.x versions. After > this migration I had several errors and obsolete errors in logs. I fixed them > and after all that I finally was able to run postfix and dovecot again. > The problem I have facing right now is that in the mail logs and in the > dovecot logs. I am getting auth errors. > In mail log the postfix is spitting out: "?fatal: no SASL authentication > mechanisms" > Dovecot is spitting this out?"imap-login?:?Auth process broken (disconnected > before auth was ready, waited 0 secs): ,user<>, the shows client ip, my server > ip and then the 0 seconds connection?etc. > Error: auth: environment corrupt; missing value for DOVECOT_" > > That is what it spits out. ?I asked for help and many threads.I am using > freebsd 10.2. ?I do use mysql for database. I need someone to explain what the > error means and how I can fix it?? > Thank you for your time! Hi! Can you provide your postconf -n and doveconf -n output?? This sounds like configuration error. Aki Tuomi Dovecot Oy From jamieson.maria at yahoo.com Sat Mar 26 17:27:28 2016 From: jamieson.maria at yahoo.com (MARIA jamieson) Date: Sat, 26 Mar 2016 17:27:28 +0000 (UTC) Subject: VS: Re: Need help solving issue In-Reply-To: References: Message-ID: <1034365628.256858.1459013248383.JavaMail.yahoo@mail.yahoo.com> On Saturday, March 26, 2016 2:40 AM, Aki Tuomi wrote: You should reply to list and not just me. Did you try over SSL? ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: MARIA jamieson P?iv?m??r?: 26.3.2016 6.28 (GMT+02:00) Saaja: aki.tuomi at dovecot.fi Aihe: Re: Need help solving issue doveconf -n output: doveconf -n # 2.2.18: /local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: FreeBSD 10.2-RELEASE amd64 ufs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes default_login_user = dovecot dict { quota = mysql:/local/etc/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/local/virt/%d/%n/ mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate passdb { args = /local/etc/dovecot/dovecot-sql.conf driver = sql name = sql } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = mode = 0600 user = } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl = required ssl_cert = wrote: > On March 25, 2016 at 6:48 PM MARIA jamieson wrote: > > > Hi, I am using Dovecot 2.2.18 ?and have migrated from a 1.x versions. After > this migration I had several errors and obsolete errors in logs. I fixed them > and after all that I finally was able to run postfix and dovecot again. > The problem I have facing right now is that in the mail logs and in the > dovecot logs. I am getting auth errors. > In mail log the postfix is spitting out: "?fatal: no SASL authentication > mechanisms" > Dovecot is spitting this out?"imap-login?:?Auth process broken (disconnected > before auth was ready, waited 0 secs): ,user<>, the shows client ip, my server > ip and then the 0 seconds connection?etc. > Error: auth: environment corrupt; missing value for DOVECOT_" > > That is what it spits out. ?I asked for help and many threads.I am using > freebsd 10.2. ?I do use mysql for database. I need someone to explain what the > error means and how I can fix it?? > Thank you for your time! Hi! Can you provide your postconf -n and doveconf -n output?? This sounds like configuration error. Aki Tuomi Dovecot Oy From jamieson.maria at yahoo.com Sat Mar 26 17:28:29 2016 From: jamieson.maria at yahoo.com (MARIA jamieson) Date: Sat, 26 Mar 2016 17:28:29 +0000 (UTC) Subject: Fw: VS: Re: Need help solving issue In-Reply-To: <737000798.294301.1459011849070.JavaMail.yahoo@mail.yahoo.com> References: <737000798.294301.1459011849070.JavaMail.yahoo@mail.yahoo.com> Message-ID: <1290408728.244547.1459013309110.JavaMail.yahoo@mail.yahoo.com> On Saturday, March 26, 2016 1:04 PM, MARIA jamieson wrote: Yes, I am trying it over ssl. Everything works as in I can connect to my mail server and establish an ssl connection. There's no error with SSL. ?It's just auth mechanism having a environment corruption error. I am not the only one. You can google around and find many run into this situation and no one could help. Most just delete the dovecot and postfix and start over again. However, I cannot afford that because it took me at least 3 months to setup dovecot correctly with postfix to use virtual users. I don't have the time to spend another 3 months to set it up. The problem lies with auth and I ?think this is the only issue and it has to be that something is missing either in the configs or a file was deleted or link to it was broken. I am sure after fixing this issue. I will have a working mail system again.? On Saturday, March 26, 2016 2:40 AM, Aki Tuomi wrote: You should reply to list and not just me. Did you try over SSL? ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: MARIA jamieson P?iv?m??r?: 26.3.2016 6.28 (GMT+02:00) Saaja: aki.tuomi at dovecot.fi Aihe: Re: Need help solving issue doveconf -n output: doveconf -n # 2.2.18: /local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: FreeBSD 10.2-RELEASE amd64 ufs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes default_login_user = dovecot dict { quota = mysql:/local/etc/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/local/virt/%d/%n/ mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate passdb { args = /local/etc/dovecot/dovecot-sql.conf driver = sql name = sql } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = mode = 0600 user = } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl = required ssl_cert = wrote: > On March 25, 2016 at 6:48 PM MARIA jamieson wrote: > > > Hi, I am using Dovecot 2.2.18 ?and have migrated from a 1.x versions. After > this migration I had several errors and obsolete errors in logs. I fixed them > and after all that I finally was able to run postfix and dovecot again. > The problem I have facing right now is that in the mail logs and in the > dovecot logs. I am getting auth errors. > In mail log the postfix is spitting out: "?fatal: no SASL authentication > mechanisms" > Dovecot is spitting this out?"imap-login?:?Auth process broken (disconnected > before auth was ready, waited 0 secs): ,user<>, the shows client ip, my server > ip and then the 0 seconds connection?etc. > Error: auth: environment corrupt; missing value for DOVECOT_" > > That is what it spits out. ?I asked for help and many threads.I am using > freebsd 10.2. ?I do use mysql for database. I need someone to explain what the > error means and how I can fix it?? > Thank you for your time! Hi! Can you provide your postconf -n and doveconf -n output?? This sounds like configuration error. Aki Tuomi Dovecot Oy From edgar at pettijohn-web.com Sat Mar 26 19:06:37 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sat, 26 Mar 2016 14:06:37 -0500 Subject: VS: Re: Need help solving issue In-Reply-To: <1034365628.256858.1459013248383.JavaMail.yahoo@mail.yahoo.com> References: <1034365628.256858.1459013248383.JavaMail.yahoo@mail.yahoo.com> Message-ID: Sent from my iPhone > On Mar 26, 2016, at 12:27 PM, MARIA jamieson wrote: > > > > On Saturday, March 26, 2016 2:40 AM, Aki Tuomi wrote: > > > You should reply to list and not just me. Did you try over SSL? > ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: MARIA jamieson P?iv?m??r?: 26.3.2016 6.28 (GMT+02:00) Saaja: aki.tuomi at dovecot.fi Aihe: Re: Need help solving issue > doveconf -n output: > doveconf -n > # 2.2.18: /local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.8 (0c4ae064f307+) > # OS: FreeBSD 10.2-RELEASE amd64 ufs > auth_debug = yes > auth_debug_passwords = yes > auth_mechanisms = plain login > auth_verbose = yes > default_login_user = dovecot > dict { > quota = mysql:/local/etc/dovecot-dict-quota.conf > } > disable_plaintext_auth = no > first_valid_gid = 125 > first_valid_uid = 125 > info_log_path = /var/log/dovecot.log > log_path = /var/log/dovecot.log > mail_debug = yes > mail_location = maildir:/local/virt/%d/%n/ > mail_privileged_group = mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate > passdb { > args = /local/etc/dovecot/dovecot-sql.conf This looks odd. Should it be /usr/local/etc/...? It looks like that pathos everywhere so maybe it's right. > driver = sql > name = sql > } > protocols = imap > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-master { > group = > mode = 0600 > user = > } > } > service imap-login { > inet_listener imaps { > port = 993 > ssl = yes > } > } > ssl = required > ssl_cert = ssl_cipher_list = ALL:!LOW:!SSLv2:!SSLV3 > ssl_key = ssl_protocols = !SSLv3 !SSLv2 > userdb { > args = /local/etc/dovecot/dovecot-sql.conf Same here. > driver = sql > name = sql > } > verbose_proctitle = yes > verbose_ssl = yes > protocol lda { > postmaster_address = postmaster at mydomain.com > sendmail_path = /usr/sbin/sendmail > } > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > mail_plugins = quota imap_quota > } > protocol pop3 { > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > local [ipaddress3] { > protocol imap { > ssl_cert = ssl_key = } > } > local [ipaddress4] { > protocol imap { > ssl_cert = ssl_key = } > }Below is output of postconf -npostconf -n > broken_sasl_auth_clients = yes > command_directory = /local/sbin > config_directory = /local/etc/postfix Same here. > daemon_directory = /local/libexec/postfix > data_directory = /var/db/postfix > debug_peer_list = mydomain.com > debugger_command = PATH=/bin:/usr/bin:/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 > disable_vrfy_command = yes > html_directory = /local/share/doc/postfix > inet_interfaces = [all my ip addresses here],localhost,127.0.0.1 > inet_protocols = all > local_recipient_maps = $virtual_mailbox_maps > mail_owner = postfix > mailq_path = /local/bin/mailq > manpage_directory = /local/man > mydestination = $myhostname, localhost.$mydomain, localhost, mail.$mydomain, mail2.$mydomain > mydomain = localhost > myhostname = $mydomain > mynetworks = [my own ip addresses here], localhost, 127.0.0.1, localhost.localhost > mynetworks_style = host > newaliases_path = /local/bin/newaliases > proxy_read_maps = $smtpd_sender_login_maps $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $virtual_mailbox_limit_maps > queue_directory = /var/spool/postfix > readme_directory = /local/share/doc/postfix > sample_directory = /local/etc/postfix > sendmail_path = /local/sbin/sendmail > setgid_group = maildrop > smtp_sasl_auth_enable = yes > smtp_sasl_password_maps = proxy:mysql:/local/etc/postfix/mysql_virtual_mailbox_maps.cf > smtp_tls_mandatory_protocols = !SSLv2,!SSLv3 > smtp_tls_note_starttls_offer = yes > smtp_tls_protocols = !SSLv2,!SSLv3 > smtp_use_tls = yes > smtpd_recipient_restrictions = permit_mynetworks permit_sasl_authenticated reject_non_fqdn_hostname reject_non_fqdn_sender reject_non_fqdn_recipient reject_unauth_pipelining reject_invalid_hostname reject_rbl_client list.dsbl.org reject_rbl_client bl.spamcop.net reject_rbl_client sbl-xbl.spamhaus.org reject_unknown_reverse_client_hostname reject_unknown_client reject_unauth_destination > smtpd_relay_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination > smtpd_sasl_auth_enable = yes > smtpd_sasl_authenticated_header = yes > smtpd_sasl_local_domain = $myhostname > smtpd_sasl_path = private/auth > smtpd_sasl_type = dovecot > smtpd_sender_login_maps = proxy:mysql:/local/etc/postfix/mysql_virtual_mailbox_maps.cf > smtpd_sender_restrictions = permit_sasl_authenticated, permit_mynetworks > smtpd_timeout = 300s > smtpd_tls_auth_only = yes > smtpd_tls_cert_file = /etc/ssl/postfix/mail.mydomain.crt > smtpd_tls_key_file = /etc/ssl/postfix/mail.mydomain.pem > smtpd_tls_loglevel = 1 > smtpd_tls_mandatory_protocols = !SSLv2,!SSLv3,TLSv1,TLSv1.1,TLSv1.2 > smtpd_tls_protocols = !SSLv2,TLSv1,TLSv1.1,!SSLv3,TLSv1.2 > smtpd_tls_received_header = yes > smtpd_tls_security_level = encrypt > smtpd_tls_session_cache_timeout = 3600s > soft_bounce = no > tls_random_source = dev:/dev/urandom > unknown_local_recipient_reject_code = 550 > virtual_alias_maps = proxy:mysql:/local/etc/postfix/mysql_virtual_alias_maps.cf > virtual_gid_maps = static:125 > virtual_mailbox_base = /local/virtual/ > virtual_mailbox_domains = proxy:mysql:/local/etc/postfix/mysql_virtual_domains_maps.cf > virtual_mailbox_limit = 51200000 > virtual_mailbox_limit_maps = proxy:mysql:/local/etc/postfix/mysql_virtual_mailbox_limit_maps.cf > virtual_mailbox_maps = proxy:mysql:/local/etc/postfix/mysql_virtual_mailbox_maps.cf > virtual_minimum_uid = 125 > virtual_transport = virtual > virtual_uid_maps = static:125 > postconf: warning: /local/etc/postfix/main.cf: unused parameter: smtpd_sasl_password_maps=proxy:mysql:/local/etc/postfix/mysql_virtual_mailbox_maps.cf > postconf: warning: /local/etc/postfix/main.cf: unused parameter: anonymousbroken_sasl_auth_clients=yes > postconf: warning: /local/etc/postfix/main.cf: unused parameter: virtual_maildir_limit_message="Sorry, this user has overdrawn their diskspace quota. Please try again later." > postconf: warning: /local/etc/postfix/main.cf: unused parameter: virtual_mailbox_limit_override=yes > postconf: warning: /local/etc/postfix/main.cf: unused parameter: virtual_overquota_bounce=yes > postconf: warning: /local/etc/postfix/main.cf: unused parameter: virtual_create_maildirsize=yes > postconf: warning: /local/etc/postfix/main.cf: unused parameter: virtual_mailbox_extended=yes > > On Friday, March 25, 2016 2:41 PM, "aki.tuomi at dovecot.fi" wrote: > > > >> On March 25, 2016 at 6:48 PM MARIA jamieson wrote: >> >> >> Hi, I am using Dovecot 2.2.18 and have migrated from a 1.x versions. After >> this migration I had several errors and obsolete errors in logs. I fixed them >> and after all that I finally was able to run postfix and dovecot again. >> The problem I have facing right now is that in the mail logs and in the >> dovecot logs. I am getting auth errors. >> In mail log the postfix is spitting out: " fatal: no SASL authentication >> mechanisms" >> Dovecot is spitting this out "imap-login : Auth process broken (disconnected >> before auth was ready, waited 0 secs): ,user<>, the shows client ip, my server >> ip and then the 0 seconds connection etc. >> Error: auth: environment corrupt; missing value for DOVECOT_" >> >> That is what it spits out. I asked for help and many threads.I am using >> freebsd 10.2. I do use mysql for database. I need someone to explain what the >> error means and how I can fix it? >> Thank you for your time! > > Hi! > > Can you provide your postconf -n and doveconf -n output? This sounds like > configuration error. > > Aki Tuomi > Dovecot Oy > > > > From jerry at seibercom.net Sat Mar 26 19:14:02 2016 From: jerry at seibercom.net (Jerry) Date: Sat, 26 Mar 2016 15:14:02 -0400 Subject: Need help solving issue In-Reply-To: <1290408728.244547.1459013309110.JavaMail.yahoo@mail.yahoo.com> References: <737000798.294301.1459011849070.JavaMail.yahoo@mail.yahoo.com> <1290408728.244547.1459013309110.JavaMail.yahoo@mail.yahoo.com> Message-ID: <20160326151402.00005a6c@seibercom.net> On Sat, 26 Mar 2016 17:28:29 +0000 (UTC), MARIA jamieson stated: >Yes, I am trying it over ssl. Everything works as in I can connect to >my mail server and establish an ssl connection. There's no error with >SSL. ?It's just auth mechanism having a environment corruption error. >I am not the only one. You can google around and find many run into >this situation and no one could help. Most just delete the dovecot and >postfix and start over again. However, I cannot afford that because it >took me at least 3 months to setup dovecot correctly with postfix to >use virtual users. I don't have the time to spend another 3 months to >set it up. The problem lies with auth and I ?think this is the only >issue and it has to be that something is missing either in the configs >or a file was deleted or link to it was broken. I am sure after fixing >this issue. I will have a working mail system again.? Postfix offers excellent debugging strategies. . Have you read it? Pay particular attention to: . Note item #8, "If the problem is SASL related, consider including the output from the saslfinger tool. This can be found at http://postfix.state-of-mind.de/patrick.koetter/saslfinger/." Give that a shot then report back the results. -- Jerry From jtam.home at gmail.com Sat Mar 26 21:05:15 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Sat, 26 Mar 2016 14:05:15 -0700 (PDT) Subject: IMAP Idle In-Reply-To: References: Message-ID: >> The IDLE disconnection timeout is hardwired in the Dovecot code >> >> http://wiki.dovecot.org/Timeouts >> >> It's set to the RFC minimum of 30min. > > I am ok if connection is closed automatically after 30 min if client is not > responding but connection is not being closed even after 2 days. Hmm. I can't think of why dovecot wouldn't time out. I think maybe the problem is with your webmail system -- it's not detecting when a client connection goes away and releasing all the resources associated with that user. This is not a typical problem though -- most webmail software do not keep persistent IMAP connections open during a session unless they use some IMAP proxy. Are your IMAP connections connected to the webmail server or an IMAP proxy, and is that connection active (despite webmail user disappearing)? Joseph Tam From SOAN at stofa.dk Sat Mar 26 21:11:59 2016 From: SOAN at stofa.dk (=?utf-8?B?U8O4cmVuIEFuZGVyc2Vu?=) Date: Sat, 26 Mar 2016 21:11:59 +0000 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: Cool! I tried to use truss -p $pidof dovecot process, and I got the following. - (Complete trace here: http://pastebin.com/pwL5EU3q) For me it doesn't seem right. - Have you guys seen anything like this before? read(55,"\0",64) = 1 (0x1) sigprocmask(SIG_SETMASK,0x0,0x0) = 0 (0x0) wait4(-1,{ EXITED,val=89 },WNOHANG,0x0) = 19061 (0x4a75) write(59,"28 19061 DEFAULT-FATAL service(a"...,84) = 84 (0x54) write(13,"KILL\t19061\n",11) = 11 (0xb) write(59,"28 19061 BYE\n",13) = 13 (0xd) sendto(6,"<19>Mar 26 22:05:15 dovecot: mas"...,105,0x0,NULL,0x0) = 105 (0x69) accept(45,{ AF_UNIX "" },0x7fffffff983c) = 156 (0x9c) close(156) = 0 (0x0) accept(45,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(46,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(47,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(48,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(49,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(50,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(51,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' wait4(-1,{ SIGNALED,sig=SIGINT },WNOHANG,0x0) = 0 (0x0) kevent(57,0x0,0,0x801464000,64,{31.999741000 }) ERR#4 'Interrupted system call' SIGNAL 20 (SIGCHLD) write(56,"\0",1) = 1 (0x1) ? /S?ren -----Original Message----- From: Larry Rosenman [mailto:larryrtx at gmail.com] Sent: 25. marts 2016 19:46 To: S?ren Andersen Cc: dovecot Subject: Dovecot on FreeBSD 10.1 I'll take a look when I get home > Hi Larry, I?m getting this error: cat /var/log/maillog Mar 25 19:39:56 beastie dovecot: auth: Error: auth: environment corrupt; missing value for DOVECOT_ Mar 25 19:39:56 beastie dovecot: auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Mar 25 19:39:56 beastie dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs cat /var/log/dovecot-info.log Mar 25 19:39:41 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:41 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:41 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= Mar 25 19:39:49 master: Info: Dovecot v2.2.22 (fe789d2) starting up for imap, lmtp Mar 25 19:39:56 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:56 auth: Debug: Wrote new auth token secret to /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:56 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= I?m running mariadb100-server-10.0.23, and I tried to recompile every dependencies for dovecot, postfix, mariadb-server without any luck. /S?ren From larryrtx at gmail.com Sat Mar 26 21:14:25 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Sat, 26 Mar 2016 21:14:25 +0000 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: Do you have virtual box installed? On Sat, Mar 26, 2016, 4:11 PM S?ren Andersen wrote: > Cool! > > I tried to use truss -p $pidof dovecot process, and I got the following. - > (Complete trace here: http://pastebin.com/pwL5EU3q) > > For me it doesn't seem right. - Have you guys seen anything like this > before? > > read(55,"\0",64) = 1 (0x1) > sigprocmask(SIG_SETMASK,0x0,0x0) = 0 (0x0) > wait4(-1,{ EXITED,val=89 },WNOHANG,0x0) = 19061 (0x4a75) > write(59,"28 19061 DEFAULT-FATAL service(a"...,84) = 84 (0x54) > write(13,"KILL\t19061\n",11) = 11 (0xb) > write(59,"28 19061 BYE\n",13) = 13 (0xd) > sendto(6,"<19>Mar 26 22:05:15 dovecot: mas"...,105,0x0,NULL,0x0) = 105 > (0x69) > accept(45,{ AF_UNIX "" },0x7fffffff983c) = 156 (0x9c) > close(156) = 0 (0x0) > accept(45,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(46,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(47,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(48,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(49,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(50,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(51,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > wait4(-1,{ SIGNALED,sig=SIGINT },WNOHANG,0x0) = 0 (0x0) > kevent(57,0x0,0,0x801464000,64,{31.999741000 }) ERR#4 'Interrupted system > call' > SIGNAL 20 (SIGCHLD) > write(56,"\0",1) = 1 (0x1) > > > > /S?ren > > -----Original Message----- > From: Larry Rosenman [mailto:larryrtx at gmail.com] > Sent: 25. marts 2016 19:46 > To: S?ren Andersen > Cc: dovecot > Subject: Dovecot on FreeBSD 10.1 > > I'll take a look when I get home > > > Hi Larry, I?m getting this error: cat /var/log/maillog Mar 25 19:39:56 > beastie dovecot: auth: Error: auth: environment corrupt; missing value for > DOVECOT_ Mar 25 19:39:56 beastie dovecot: auth: Fatal: > unsetenv(RESTRICT_SETUID) failed: Bad address Mar 25 19:39:56 beastie > dovecot: master: Error: service(auth): command startup failed, throttling > for 2 secs cat /var/log/dovecot-info.log Mar 25 19:39:41 auth: Debug: > Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:41 > auth: Debug: Read auth token secret from > /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:41 imap-login: Info: > Disconnected: Auth process broken (disconnected before auth was ready, > waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= Mar 25 > 19:39:49 master: Info: Dovecot v2.2.22 (fe789d2) starting up for imap, lmtp > Mar 25 19:39:56 auth: Debug: Loading modules from directory: > /usr/local/lib/dovecot/auth Mar 25 19:39:56 auth: Debug: Wrote new auth > token secret to /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:56 > imap-login: Info: Disconnected: Auth process broken (disconnected before > auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, > session= I?m running mariadb100-server-10.0.23, and I tried to recompile > every dependencies for dovecot, postfix, mariadb-server without any luck. > /S?ren > From SOAN at stofa.dk Sun Mar 27 00:26:40 2016 From: SOAN at stofa.dk (=?utf-8?B?U8O4cmVuIEFuZGVyc2Vu?=) Date: Sun, 27 Mar 2016 00:26:40 +0000 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: Hi Larry, Nope. Does it matter? /S?ren From: Larry Rosenman [mailto:larryrtx at gmail.com] Sent: 26. marts 2016 22:14 To: S?ren Andersen Cc: dovecot Subject: Re: Dovecot on FreeBSD 10.1 Do you have virtual box installed? On Sat, Mar 26, 2016, 4:11 PM S?ren Andersen > wrote: Cool! I tried to use truss -p $pidof dovecot process, and I got the following. - (Complete trace here: http://pastebin.com/pwL5EU3q) For me it doesn't seem right. - Have you guys seen anything like this before? read(55,"\0",64) = 1 (0x1) sigprocmask(SIG_SETMASK,0x0,0x0) = 0 (0x0) wait4(-1,{ EXITED,val=89 },WNOHANG,0x0) = 19061 (0x4a75) write(59,"28 19061 DEFAULT-FATAL service(a"...,84) = 84 (0x54) write(13,"KILL\t19061\n",11) = 11 (0xb) write(59,"28 19061 BYE\n",13) = 13 (0xd) sendto(6,"<19>Mar 26 22:05:15 dovecot: mas"...,105,0x0,NULL,0x0) = 105 (0x69) accept(45,{ AF_UNIX "" },0x7fffffff983c) = 156 (0x9c) close(156) = 0 (0x0) accept(45,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(46,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(47,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(48,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(49,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(50,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' accept(51,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource temporarily unavailable' wait4(-1,{ SIGNALED,sig=SIGINT },WNOHANG,0x0) = 0 (0x0) kevent(57,0x0,0,0x801464000,64,{31.999741000 }) ERR#4 'Interrupted system call' SIGNAL 20 (SIGCHLD) write(56,"\0",1) = 1 (0x1) /S?ren -----Original Message----- From: Larry Rosenman [mailto:larryrtx at gmail.com] Sent: 25. marts 2016 19:46 To: S?ren Andersen > Cc: dovecot > Subject: Dovecot on FreeBSD 10.1 I'll take a look when I get home > Hi Larry, I?m getting this error: cat /var/log/maillog Mar 25 19:39:56 beastie dovecot: auth: Error: auth: environment corrupt; missing value for DOVECOT_ Mar 25 19:39:56 beastie dovecot: auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Mar 25 19:39:56 beastie dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs cat /var/log/dovecot-info.log Mar 25 19:39:41 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:41 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:41 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= Mar 25 19:39:49 master: Info: Dovecot v2.2.22 (fe789d2) starting up for imap, lmtp Mar 25 19:39:56 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:56 auth: Debug: Wrote new auth token secret to /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:56 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= I?m running mariadb100-server-10.0.23, and I tried to recompile every dependencies for dovecot, postfix, mariadb-server without any luck. /S?ren From dovecot at knutejohnson.com Sun Mar 27 00:54:17 2016 From: dovecot at knutejohnson.com (Knute Johnson) Date: Sat, 26 Mar 2016 17:54:17 -0700 Subject: Setting up replication? In-Reply-To: <56F40DC7.7000309@knutejohnson.com> References: <56F309FD.6030704@knutejohnson.com> <56F40DC7.7000309@knutejohnson.com> Message-ID: <56F72F39.6090402@knutejohnson.com> On 3/24/2016 08:54, Knute Johnson wrote: > > I've got it working more or less. I had to change the mode of > replicator-doveadm to 0666. I'm still getting errors for 'nobody' but > that doesn't seem to cause it to not work, just annoying. > > Can anybody explain the significance of the mode? > > I'm syncing between a 2.2.9 and 2.2.13 system. Any thing I should > look for? > > Thanks, > Well it worked fine until yesterday and then it started creating duplicates by the hundreds. Errors about EOF for two valid users on the secondary system. This is a sample of the errors in the log: [0x7efecd2c9de8] -> dovecot/doveadm-server(+0x1a189) [0x7efecda6e189] -> dovecot/doveadm-server(+0xebeb) [0x7efecda62beb] -> dovecot/doveadm-server(+0x184d3) [0x7efecda6c4d3] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7efecd2ca247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7efecd2cafd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7efecd2c9de8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7efecd27ac93] -> dovecot/doveadm-server(main+0x11b) [0x7efecda6294b]: 1 Time(s) dovecot: dsync-server(knute): Error: Sync failed for mbox file /var/mail/knute: UID inserted in the middle of mailbox (709931 > 709911, seq=105, idx_msgs=144): 2 Time(s) dovecot: dsync-server(knute): Error: Sync failed for mbox file /var/mail/knute: UID inserted in the middle of mailbox (710924 > 710923, seq=310, idx_msgs=437): 2 Time(s) dovecot: dsync-server(knute): Error: read(knute5.frazmtn.com) failed: EOF: 165 Time(s) dovecot: dsync-server(knute): Fatal: master: service(doveadm): child 6940 killed with signal 6 (core dumped): 1 Time(s) dovecot: dsync-server(knute): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK): 1 Time(s) dovecot: dsync-server(penny): Error: read(knute5.frazmtn.com) failed: EOF: 263 Time(s) I disabled replication and don't really know where to go from here. Can anybody give me a hand? Thanks, -- Knute Johnson From noel.butler at ausics.net Sun Mar 27 04:14:01 2016 From: noel.butler at ausics.net (Noel Butler) Date: Sun, 27 Mar 2016 14:14:01 +1000 Subject: Email hosting provider In-Reply-To: <20160326080433.07fcf216.skraw@ithnet.com> References: <2b1abc9c94e3f1322753d7547cb991e4@ausics.net> <20160326080433.07fcf216.skraw@ithnet.com> Message-ID: <662ba2d004eae63b52423a09a506e5af@ausics.net> On 26/03/2016 17:04, Stephan von Krawczynski wrote: > On Sat, 26 Mar 2016 13:34:34 +1000 > Noel Butler wrote: > >> On 21/03/2016 17:06, Andre Rodier wrote: >> > Hello, >> > >> > Sorry if I am off topic a little. >> > >> > I am looking for an email host provider that supports dovecot, sieve >> > and manage sieve. Ideally with the roundcube webmail and managesieve >> > plugin >> > >> > Better if it is in Europe or switzerland. I don't mind paying a little. >> > >> > Thanks, >> > Andr?. >> >> Hi Andre, >> >> see www.webhostingtalk.com >> >> There are a number of reliable and reasonable priced hosts in Germany >> (best place if you value your privacy) and Netherlands. > > You mean "best place if you have no idea of the german laws and whats > really > going on" ... I don't need to understand German law, thats what my Frankfurt lawyers do, I'd trust our data privacy far more in our Frankfurt site, then I would ever trust US or UK, or AU. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From larryrtx at gmail.com Sun Mar 27 15:08:05 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Sun, 27 Mar 2016 10:08:05 -0500 Subject: Dovecot on FreeBSD 10.1 In-Reply-To: References: Message-ID: no -- there is a netgraph setting for when it IS. Are there any other messages from the kernel? On Sat, Mar 26, 2016 at 7:26 PM, S?ren Andersen wrote: > Hi Larry, > > > > Nope. Does it matter? > > > > /S?ren > > > > *From:* Larry Rosenman [mailto:larryrtx at gmail.com] > *Sent:* 26. marts 2016 22:14 > *To:* S?ren Andersen > *Cc:* dovecot > *Subject:* Re: Dovecot on FreeBSD 10.1 > > > > Do you have virtual box installed? > > > > On Sat, Mar 26, 2016, 4:11 PM S?ren Andersen wrote: > > Cool! > > I tried to use truss -p $pidof dovecot process, and I got the following. - > (Complete trace here: http://pastebin.com/pwL5EU3q) > > For me it doesn't seem right. - Have you guys seen anything like this > before? > > read(55,"\0",64) = 1 (0x1) > sigprocmask(SIG_SETMASK,0x0,0x0) = 0 (0x0) > wait4(-1,{ EXITED,val=89 },WNOHANG,0x0) = 19061 (0x4a75) > write(59,"28 19061 DEFAULT-FATAL service(a"...,84) = 84 (0x54) > write(13,"KILL\t19061\n",11) = 11 (0xb) > write(59,"28 19061 BYE\n",13) = 13 (0xd) > sendto(6,"<19>Mar 26 22:05:15 dovecot: mas"...,105,0x0,NULL,0x0) = 105 > (0x69) > accept(45,{ AF_UNIX "" },0x7fffffff983c) = 156 (0x9c) > close(156) = 0 (0x0) > accept(45,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(46,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(47,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(48,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(49,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(50,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > accept(51,0x7fffffff9840,0x7fffffff983c) ERR#35 'Resource > temporarily unavailable' > wait4(-1,{ SIGNALED,sig=SIGINT },WNOHANG,0x0) = 0 (0x0) > kevent(57,0x0,0,0x801464000,64,{31.999741000 }) ERR#4 'Interrupted system > call' > SIGNAL 20 (SIGCHLD) > write(56,"\0",1) = 1 (0x1) > > > > /S?ren > > -----Original Message----- > From: Larry Rosenman [mailto:larryrtx at gmail.com] > Sent: 25. marts 2016 19:46 > To: S?ren Andersen > Cc: dovecot > Subject: Dovecot on FreeBSD 10.1 > > I'll take a look when I get home > > > Hi Larry, I?m getting this error: cat /var/log/maillog Mar 25 19:39:56 > beastie dovecot: auth: Error: auth: environment corrupt; missing value for > DOVECOT_ Mar 25 19:39:56 beastie dovecot: auth: Fatal: > unsetenv(RESTRICT_SETUID) failed: Bad address Mar 25 19:39:56 beastie > dovecot: master: Error: service(auth): command startup failed, throttling > for 2 secs cat /var/log/dovecot-info.log Mar 25 19:39:41 auth: Debug: > Loading modules from directory: /usr/local/lib/dovecot/auth Mar 25 19:39:41 > auth: Debug: Read auth token secret from > /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:41 imap-login: Info: > Disconnected: Auth process broken (disconnected before auth was ready, > waited 0 secs): user=<>, rip=::1, lip=::1, secured, session= Mar 25 > 19:39:49 master: Info: Dovecot v2.2.22 (fe789d2) starting up for imap, lmtp > Mar 25 19:39:56 auth: Debug: Loading modules from directory: > /usr/local/lib/dovecot/auth Mar 25 19:39:56 auth: Debug: Wrote new auth > token secret to /var/run/dovecot/auth-token-secret.dat Mar 25 19:39:56 > imap-login: Info: Disconnected: Auth process broken (disconnected before > auth was ready, waited 0 secs): user=<>, rip=::1, lip=::1, secured, > session= I?m running mariadb100-server-10.0.23, and I tried to recompile > every dependencies for dovecot, postfix, mariadb-server without any luck. > /S?ren > > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 From andrew.mcglashan at affinityvision.com.au Sun Mar 27 15:09:43 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Mon, 28 Mar 2016 02:09:43 +1100 Subject: Email hosting provider In-Reply-To: <662ba2d004eae63b52423a09a506e5af@ausics.net> References: <2b1abc9c94e3f1322753d7547cb991e4@ausics.net> <20160326080433.07fcf216.skraw@ithnet.com> <662ba2d004eae63b52423a09a506e5af@ausics.net> Message-ID: <56F7F7B7.1080903@affinityvision.com.au> I love this on your about page: On 27/03/2016 3:14 PM, Noel Butler wrote: > I don't need to understand German law, thats what my Frankfurt lawyers > do, I'd trust our data privacy far more in our Frankfurt site, then I > would ever trust US or UK, or AU. "Ausics.* services are purely free and non commercial offerings, run and funded by Brisbanite Noel Butler as a hobbyist service, it remains separate from any commercial services, hosting or otherwise, and is maintained by only a small group of people who may or may not have a life, so just in case, please be patient if you need to contact us. " .. but "All key services are in-house in Brisbane .... " I was wondering about your preference for German servers / services. ? Cheers A. From jamieson.maria at yahoo.com Sun Mar 27 19:32:01 2016 From: jamieson.maria at yahoo.com (MARIA jamieson) Date: Sun, 27 Mar 2016 19:32:01 +0000 (UTC) Subject: Need help solving issue In-Reply-To: <20160326151402.00005a6c@seibercom.net> References: <20160326151402.00005a6c@seibercom.net> Message-ID: <8238932.569069.1459107121263.JavaMail.yahoo@mail.yahoo.com> what's the difference between sasl and auth mech in dovecot? ?Postfix points to a sasl problem and dovecot points to a auth mechanism saying it's corrupted. ? I did looked at the links you provided. I don't have the tools and don't have time right now to fiddle with them and run them to get a result at this time. On Saturday, March 26, 2016 4:32 PM, Jerry wrote: On Sat, 26 Mar 2016 17:28:29 +0000 (UTC), MARIA jamieson stated: >Yes, I am trying it over ssl. Everything works as in I can connect to >my mail server and establish an ssl connection. There's no error with >SSL. ?It's just auth mechanism having a environment corruption error. >I am not the only one. You can google around and find many run into >this situation and no one could help. Most just delete the dovecot and >postfix and start over again. However, I cannot afford that because it >took me at least 3 months to setup dovecot correctly with postfix to >use virtual users. I don't have the time to spend another 3 months to >set it up. The problem lies with auth and I ?think this is the only >issue and it has to be that something is missing either in the configs >or a file was deleted or link to it was broken. I am sure after fixing >this issue. I will have a working mail system again.? Postfix offers excellent debugging strategies. . Have you read it? Pay particular attention to: . Note item #8, "If the problem is SASL related, consider including the output from the saslfinger tool. This can be found at http://postfix.state-of-mind.de/patrick.koetter/saslfinger/." Give that a shot then report back the results. -- Jerry From kepa at oceanvoyages.com Sun Mar 27 20:25:58 2016 From: kepa at oceanvoyages.com (kepa) Date: Sun, 27 Mar 2016 14:25:58 -0600 Subject: Enabling tcpwrappers Message-ID: <56F841D6.4030107@oceanvoyages.com> Hi all, I would like use Dovecot with tcpwrappers enabled to control remote access using hosts.deny and hosts.allow. A google search gave this response from the listserve, but it is several years ago: http://www.dovecot.org/list/dovecot/2013-April/089455.html Are these instructions for configuring the conf files still valid? Mainly: /etc/dovecot/dovecot.conf login_access_sockets = tcpwrap conf.d/10-master.conf: service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } Also: Which version of Dovecot at least is needed to enable tcpwrappers? Does the tcpwrap option need to be enabled during configure and build or is it already (and enabled in any distro binary repositories)? And is it dovecot, imap, or imaps in the hosts.allow/deny file as the service name? Thanks! Kepa From sca at andreasschulze.de Sun Mar 27 22:06:43 2016 From: sca at andreasschulze.de (A. Schulze) Date: Mon, 28 Mar 2016 00:06:43 +0200 Subject: Enabling tcpwrappers In-Reply-To: <56F841D6.4030107@oceanvoyages.com> Message-ID: <20160328000643.Horde.dNDw9LYIVC162jsd54Dvq53@andreasschulze.de> kepa: > I would like use Dovecot with tcpwrappers enabled to control remote > access using hosts.deny and hosts.allow. I followed http://wiki2.dovecot.org/LoginProcess#TCP_wrappers_support and "man 5 hosts.deny" - to allow all clients and deny a specific address /etc/hosts.deny imap: 192.0.2.143 - to deny all clients and allow a specific address /etc/hosts.deny imap: * /etc/hosts.allow imap: 192.0.2.143 Andreas From noel.butler at ausics.net Mon Mar 28 01:14:12 2016 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 28 Mar 2016 11:14:12 +1000 Subject: Email hosting provider In-Reply-To: <56F7F7B7.1080903@affinityvision.com.au> References: <2b1abc9c94e3f1322753d7547cb991e4@ausics.net> <20160326080433.07fcf216.skraw@ithnet.com> <662ba2d004eae63b52423a09a506e5af@ausics.net> <56F7F7B7.1080903@affinityvision.com.au> Message-ID: <8dd69f710c93351b44e49f0aa372ae96@ausics.net> On 28/03/2016 01:09, Andrew McGlashan wrote: > I love this on your about page: > > On 27/03/2016 3:14 PM, Noel Butler wrote: >> I don't need to understand German law, thats what my Frankfurt lawyers >> do, I'd trust our data privacy far more in our Frankfurt site, then I >> would ever trust US or UK, or AU. > > > "Ausics.* services are purely free and non commercial offerings, run > and > funded by Brisbanite Noel Butler as a hobbyist service, it remains > separate from any commercial services, hosting or otherwise, and is > maintained by only a small group of people who may or may not have a > life, so just in case, please be patient if you need to contact us. " > > .. but "All key services are in-house in Brisbane .... " > > I was wondering about your preference for German servers / services. ? > No problems, my reference to Frankfurt storage refers to a "commercial operation" certainly not the hobby one :) > Cheers > A. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From phil at dunlop-lello.uk Mon Mar 28 14:43:14 2016 From: phil at dunlop-lello.uk (Phil Lello) Date: Mon, 28 Mar 2016 15:43:14 +0100 Subject: Migrating to dovecot from gmail apps Message-ID: Hi, I'm considering migrating away from gmail for my (one-man) company, and I'm trying to decide if dovecot is the right option (I'm committed to self-hosting). I'm a developer, so happy to do my own tooling if needed. *Is there currently a good webmail interface to dovecot, or work-in progress?* If not, would a web interface be out-of-scope for dovecot? I want to use SAML for authentication, so a solution that relies on POP/IMAP doesn't meet my needs - unless I add Kerberos into the mix, which is an additional learning curve, and possibly not widely supported. *Is there currently a good web admin interface to dovecot, or work-in-progress?* If not, would a web interface be out-of-scope? Since I prefer using password-protected SSH keys for shell access, and don't want to tie myself to a laptop (and would hate to use vim on a 3G/4G tablet), I'd like to be able to add/remove aliases and play with SIEVE and ACLs through any available browser. *How's the work on sharing messages between folders progressing?* Finally, and I hope you don't mind me asking, are you aware of a good JAVA based alternative to dovecot? I quite like the idea of using lucene indexing on mailboxes, so reducing the number of dependencies has a certain appeal. Best wishes, Phil Lello From aki.tuomi at dovecot.fi Mon Mar 28 15:05:51 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 28 Mar 2016 18:05:51 +0300 (EEST) Subject: Migrating to dovecot from gmail apps In-Reply-To: References: Message-ID: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> > On March 28, 2016 at 5:43 PM Phil Lello wrote: > > > Hi, > > I'm considering migrating away from gmail for my (one-man) company, and I'm > trying to decide if dovecot is the right option (I'm committed to > self-hosting). I'm a developer, so happy to do my own tooling if needed. > > *Is there currently a good webmail interface to dovecot, or work-in > progress?* If not, would a web interface be out-of-scope for dovecot? I > want to use SAML for authentication, so a solution that relies on POP/IMAP > doesn't meet my needs - unless I add Kerberos into the mix, which is an > additional learning curve, and possibly not widely supported. > Open-Xchage appsuite might fit your needs. > *Is there currently a good web admin interface to dovecot, or > work-in-progress?* If not, would a web interface be out-of-scope? Since I > prefer using password-protected SSH keys for shell access, and don't want > to tie myself to a laptop (and would hate to use vim on a 3G/4G tablet), > I'd like to be able to add/remove aliases and play with SIEVE and ACLs > through any available browser. > There is an HTTP API for doveadm in v2.2.22 which might suite your needs. Sieve is supported via ManageSieve. Appsuite has plugin for Managesieve. > *How's the work on sharing messages between folders progressing?* > > Finally, and I hope you don't mind me asking, are you aware of a good JAVA > based alternative to dovecot? I quite like the idea of using lucene > indexing on mailboxes, so reducing the number of dependencies has a certain > appeal. > Dovecot has Lucene support, if it's not compiled in you can enable it yourself. > Best wishes, > > Phil Lello Aki Tuomi Dovecot Oy From lists at merit.unu.edu Mon Mar 28 15:13:59 2016 From: lists at merit.unu.edu (mj) Date: Mon, 28 Mar 2016 17:13:59 +0200 Subject: Migrating to dovecot from gmail apps In-Reply-To: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> References: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> Message-ID: <56F94A37.3030100@merit.unu.edu> On 03/28/2016 05:05 PM, aki.tuomi at dovecot.fi wrote: > >> On March 28, 2016 at 5:43 PM Phil Lello wrote: >> >> >> Hi, >> >> I'm considering migrating away from gmail for my (one-man) company, and I'm >> trying to decide if dovecot is the right option (I'm committed to >> self-hosting). I'm a developer, so happy to do my own tooling if needed. >> >> *Is there currently a good webmail interface to dovecot, or work-in >> progress?* If not, would a web interface be out-of-scope for dovecot? I >> want to use SAML for authentication, so a solution that relies on POP/IMAP >> doesn't meet my needs - unless I add Kerberos into the mix, which is an >> additional learning curve, and possibly not widely supported. >> > > Open-Xchage appsuite might fit your needs. Or you could take a look at SOGo: http://sogo.nu/ MJ From sergey.schwartz at bgoperator.com Mon Mar 28 15:46:27 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Mon, 28 Mar 2016 18:46:27 +0300 Subject: Migrating to dovecot from gmail apps In-Reply-To: <56F94A37.3030100@merit.unu.edu> References: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> <56F94A37.3030100@merit.unu.edu> Message-ID: <56F951D3.1080303@bgoperator.com> Phil, Try https://roundcube.net/ - really nice web app if all you need is email with sieve filtering and address book. I would recommend OX if you want support for mobile devices or other great stuff it has. RC doesn't play well with phones. Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com 28.03.2016 18:13, mj ?????: > > > On 03/28/2016 05:05 PM, aki.tuomi at dovecot.fi wrote: >> >>> On March 28, 2016 at 5:43 PM Phil Lello wrote: >>> >>> >>> Hi, >>> >>> I'm considering migrating away from gmail for my (one-man) company, >>> and I'm >>> trying to decide if dovecot is the right option (I'm committed to >>> self-hosting). I'm a developer, so happy to do my own tooling if >>> needed. >>> >>> *Is there currently a good webmail interface to dovecot, or work-in >>> progress?* If not, would a web interface be out-of-scope for dovecot? I >>> want to use SAML for authentication, so a solution that relies on >>> POP/IMAP >>> doesn't meet my needs - unless I add Kerberos into the mix, which is an >>> additional learning curve, and possibly not widely supported. >>> >> >> Open-Xchage appsuite might fit your needs. > > Or you could take a look at SOGo: http://sogo.nu/ > > MJ From mick.crane at gmail.com Mon Mar 28 15:59:11 2016 From: mick.crane at gmail.com (mick.crane) Date: Mon, 28 Mar 2016 16:59:11 +0100 Subject: Migrating to dovecot from gmail apps In-Reply-To: <56F94A37.3030100@merit.unu.edu> References: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> <56F94A37.3030100@merit.unu.edu> Message-ID: <66611f8d6f351db5342d325c8cf7a1db.squirrel@rapunzel.local> On Mon, March 28, 2016 4:13 pm, mj wrote: > >>> *Is there currently a good webmail interface to dovecot, squirrelmail -- key ID: 0x4BFEBB31 From sven at svenhartge.de Mon Mar 28 16:14:26 2016 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 28 Mar 2016 18:14:26 +0200 Subject: Migrating to dovecot from gmail apps References: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> <56F94A37.3030100@merit.unu.edu> <66611f8d6f351db5342d325c8cf7a1db.squirrel@rapunzel.local> Message-ID: <3ceea69ctnv8@mids.svenhartge.de> mick.crane wrote: > On Mon, March 28, 2016 4:13 pm, mj wrote: >>>> *Is there currently a good webmail interface to dovecot, > squirrelmail Squirrelmail is dead. S! -- Sigmentation fault. Core dumped. From phil at dunlop-lello.uk Mon Mar 28 16:34:59 2016 From: phil at dunlop-lello.uk (Phil Lello) Date: Mon, 28 Mar 2016 17:34:59 +0100 Subject: Migrating to dovecot from gmail apps In-Reply-To: <3ceea69ctnv8@mids.svenhartge.de> References: <1905201422.18097.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> <56F94A37.3030100@merit.unu.edu> <66611f8d6f351db5342d325c8cf7a1db.squirrel@rapunzel.local> <3ceea69ctnv8@mids.svenhartge.de> Message-ID: Many thanks for the replies, I'm going to take a look at OX. Out of curiousity, does anyone know if Open-Xchange is primarily German or American? I'm trying to favour European projects/products as I've realised too much the tech I use is reliant on the US. Phil On Mon, Mar 28, 2016 at 5:14 PM, Sven Hartge wrote: > mick.crane wrote: > > On Mon, March 28, 2016 4:13 pm, mj wrote: > > >>>> *Is there currently a good webmail interface to dovecot, > > > squirrelmail > > Squirrelmail is dead. > > S! > > -- > Sigmentation fault. Core dumped. > From lev at serebryakov.spb.ru Mon Mar 28 16:48:29 2016 From: lev at serebryakov.spb.ru (Lev Serebryakov) Date: Mon, 28 Mar 2016 19:48:29 +0300 Subject: Migrating to dovecot from gmail apps In-Reply-To: References: Message-ID: <56F9605D.1010101@serebryakov.spb.ru> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 28.03.2016 17:43, Phil Lello wrote: > *Is there currently a good webmail interface to dovecot, or > work-in progress?* If not, would a web interface be out-of-scope > for dovecot? I want to use SAML for authentication, so a solution > that relies on POP/IMAP doesn't meet my needs - unless I add > Kerberos into the mix, which is an additional learning curve, and > possibly not widely supported. roundcube is nice and lightweight, with "perosnal" featureset (but they add PGP support in latest beta, including client-side one with browser extension!). Horde is more "professional" and more like big groupware, and works better on mobile devices, but needs more effort to setup & configure. - -- // Black Lion AKA Lev Serebryakov -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQJ8BAEBCgBmBQJW+WBdXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePCvkP/0rwtCcGfjEtOCZTU9N+Yvcn io+tFQ4EYRN8xCLUSdckqOO1P03DGwHp2yqoTpU/uMWk3vX9jqlGs04fk30uq8TW 2bSTOo+x3EUkzj0wtIgUM25QGq8sII2Su1q20C1iqMyYofnOjmsJ1SoeSOD5xzCh h/LJYNpZjdLmnbesMAitkDFYAlfB0DSdXviP45j4QPL/P+CxwEb1bAbXLbN6Fuir CamjB+3y5Zf2dJGu1lknUfrATgaKz1jScSFx4S8eSxGXhYx0sLY1G3ovxItWFctS O+nhhUrxvfslt4TR6X01DLxZgqHE0ZXi+GD17puRQfRXwOzHv116DjpfayhngsI7 6wTM+QIC8/f9y6J0gpY8VE2UvEwLzcbPeVzhVYG0wulasChBBAqBYBF8lwUY/Nza cFcydxOjCPFnMehmhUHgVWL4IHkN7Seb8jXp1VSEk4Aet9EjO7xf+awI6s8vmClQ 2WcwQNuR6yPjD+N6e5IA8nxQr7tDbuxe4MPsvmdx3K639Fr6HhM8RDLPIsuCU+Jf CW/vYViw1K4jm9C7CoRL8VEssEWxiEmERwMdpibdaaWc3PdbmMDOWPqJRHVmYGY4 gO/ACGmH1ceB5uWGJrLokRVuGSfcCLW9DphnDJsJaUkGyNn33OIRPog7B3eIJp4k BzHNadWcGAmbgDWvlBH5 =Lzsh -----END PGP SIGNATURE----- From aki.tuomi at dovecot.fi Mon Mar 28 16:51:01 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 28 Mar 2016 19:51:01 +0300 Subject: VS: Re: Migrating to dovecot from gmail apps Message-ID: <42829gnp235coq28oecdbarl.1459183861209@email.android.com> Primarily german? ---Aki TuomiDovecot oy-------- Alkuper?inen viesti --------L?hett?j?: Phil Lello P?iv?m??r?: 28.3.2016 19.34 (GMT+02:00) Saaja: Sven Hartge Kopio: dovecot at dovecot.org Aihe: Re: Migrating to dovecot from gmail apps Many thanks for the replies, I'm going to take a look at OX. Out of curiousity, does anyone know if Open-Xchange is primarily German or American? I'm trying to favour European projects/products as I've realised too much the tech I use is reliant on the US. Phil On Mon, Mar 28, 2016 at 5:14 PM, Sven Hartge wrote: > mick.crane wrote: > > On Mon, March 28, 2016 4:13 pm, mj wrote: > > >>>> *Is there currently a good webmail interface to dovecot, > > > squirrelmail > > Squirrelmail is dead. > > S! > > -- > Sigmentation fault. Core dumped. > From pruimj at gmail.com Tue Mar 29 01:58:44 2016 From: pruimj at gmail.com (Jason Pruim) Date: Mon, 28 Mar 2016 21:58:44 -0400 Subject: First dovecot install Message-ID: Hey Everyone, I am trying to get postfix and dovecot to talk to each other? postfix is up and running, dovecot allows me to telnet into it both locally and remotely, but when I try to do: ?a login ?username? ?password? I get an authentication failed error? Here is my dovecot -n: [ec2-user at ip-172-31-24-2 dovecot]$ dovecot -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 auth_debug_passwords = yes auth_mechanisms = plain login first_valid_uid = 200 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes mail_gid = 12 mail_home = /mnt/vmail/%d/%n mail_location = maildir:~ mail_uid = 200 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Junk autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Junk sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve sieve_max_script_size = 1M } protocols = imap lmtp sieve pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = ec2-user } unix_listener auth-userdb { group = mail mode = 0600 user = mailreader } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = required ssl_cert = References: Message-ID: <324914276.19428.5a680e95-35ce-4eaf-ad81-db48cd73dae4.open-xchange@appsuite.open-xchange.com> > On March 29, 2016 at 4:58 AM Jason Pruim wrote: > > > Hey Everyone, > > I am trying to get postfix and dovecot to talk to each other? postfix is up > and running, dovecot allows me to telnet into it both locally and remotely, > but when I try to do: ?a login ?username? ?password? I get an authentication > failed error? Here is my dovecot -n: > Did you check mail logs? Also, I assume you did not include quotes in your login attempt? Also, remotely telnetting will not work without SSL or non-plaintext authentication mechanism. Try openssl s_client -connect or telnet to localhost. > > I?m planning to use user accounts for it to connect to? I?m guessing I?m > missing something simple, but I don?t know where to look? Any pointers? > > Thanks in advance! > > Jason Pruim > pruimj at gmail.com Aki Tuomi Dovecot Oy From skdovecot at smail.inf.fh-brs.de Tue Mar 29 06:19:48 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 29 Mar 2016 08:19:48 +0200 (CEST) Subject: Some mails seen only via POP3 but not via IMAP In-Reply-To: <56F51EB0.10703@noa.gr> References: <56F51EB0.10703@noa.gr> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 25 Mar 2016, Nikolaos Milas wrote: > There is a usercomplaining that some incoming mails never show up in webmail > (we are using squirrelmail - the user is checking for mail regularly and is > not ignorant) and can only be seen/downloaded through a mail client via POP3 > (the user uses "Leave on Server" option). > > Has anyone seen such a behavior? Can you suggest some troubleshooting steps > or solution? > > What may cause some mails to not show in webmail - (or in general to mails > accessed via IMAP, as I interpret it)? did you verified that the messages are not visible via IMAP - apart from your web mail environment? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVvoehHz1H7kL/d9rAQK3KAf/d0N3kWx2MfRRCFmS6LEf8fStr1jpvBml AU9j7hUUdUbTEXmHSaSLSrSJnBiw7oCPlyeHeJmtXNYkjlxvvDEadouL3vsTfB7u ux8hEluZApN+Coy4A/IoRS2vBTO9sFnBFPYG77pQDar1BssH/fERwuWkynqGY0xW BLdE4uAonmaXW5S/pcWJpy+VrgoHvWP3sSRSe1aKETbe/7OZzQPnDCRcl4sYvZ4o dykXD9lgetPcwZ9CKq6Tin26+yMC70kJlFUFyY2+EG892MiWWMBFIO33YSTPLBJ5 nBktg4bHzuxGDRLrkQbXGGVbdBLGhMxoGdxU0DsvLCvwgXFEBaNqcA== =ZkvI -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Mar 29 06:25:01 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 29 Mar 2016 08:25:01 +0200 (CEST) Subject: mailbox prefix In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, 26 Mar 2016, michael crane wrote: > I try to make a new server just for me after having old one working for > ages with Dovecot, Fetchmail, Squirrelmail, Procmail > making new one with above plus Postfix using Maildir structure. > I am having a bit of trouble understanding exactly what the namespace and > prefix are. The prefix identifies a namespace. All mailboxes are located at the mail_location you have configured for the namespace. > Is the "private/" prefix an internal thing with Dovecot ? Or is it supposed > to be a real directory ? > I'm not quite sure how to properly address the INBOX in Procmail, > Squirrelmail, Postfix config. > > > for example am I supposed to say inbox is ".private/.INBOX" - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVvofvXz1H7kL/d9rAQJXHgf+LJ5no4e7LYKt/NCTdyBOZ0geEYSdmWMt XKtUHC+neHslzy8VPBwyBGEcG/1mMPYzT2SkEP6llNoZFE5ElQ1PwTpL8MpQRmli WaZTeLbh/vhYvqaj6INHhFN5M2zqDzpy4DNrAbsWS4x5VOh9YYdbJtXAVn+kuLuB 8CatpIz3Z+KlhSNmyreqKh4kHL/hv8gSlbTcbLjX6lm4HAwrSJDXdLsmdyXKwnMq YwUORSHavtRFPixK8EJE1VV6bHV+NJidkGlY6Nsx8Rwum820EbL2Qyzi9rMglQYC ZYs/ErT1VZDDO1PhhWLN1MsVkR4MHrrj88FsfQZpQBkzA9uW6e/Rkg== =StJ8 -----END PGP SIGNATURE----- From nerijus at users.sourceforge.net Tue Mar 29 14:09:06 2016 From: nerijus at users.sourceforge.net (Nerijus Baliunas) Date: Tue, 29 Mar 2016 17:09:06 +0300 Subject: crash Message-ID: Hello, dovecot-2.2.22-1.fc23.x86_64 from Fedora. I have some old messages, and when I try to open them, dovecot dies: Mar 29 15:29:33 nerijus dovecot: imap(nerijus): Error: Maildir filename has wrong S value, renamed the file from /ho me/nerijus/Maildir/.Linux_old.fetchmail/cur/1038402635.13668_0.nerijus,S=11015:2,FS to /home/nerijus/Maildir/.Linux_ old.fetchmail/cur/1038402635.13668_0.nerijus,S=10955:2,FS Mar 29 15:29:33 nerijus dovecot: imap(nerijus): Error: Corrupted index cache file /home/nerijus/Maildir/.Linux_old.f etchmail/dovecot.index.cache: Broken physical size for mail UID 49 in mailbox Linux_old.fetchmail: read(/home/neriju s/Maildir/.Linux_old.fetchmail/cur/1038402635.13668_0.nerijus,S=11015:2,FS) failed: Cached message size larger than expected (11015 > 10955, box=Linux_old.fetchmail, UID=49, cached Message-Id=<20021127125617.GB26938 at mcdonald.bombay. retortsoft.com>) Mar 29 15:29:33 nerijus dovecot: imap(nerijus): Panic: file istream.c: line 163 (i_stream_read): assertion failed: (old_size <= _stream->pos - _stream->skip) Attaching backtrace1. Mar 29 16:03:16 nerijus dovecot: imap(nerijus): Error: Maildir filename has wrong S value, renamed the file from /ho me/nerijus/Maildir/.Linux_old.FLTK/cur/1033767038.6490_0.nerijus,S=4712:2,S to /home/nerijus/Maildir/.Linux_old.FLTK /cur/1033767038.6490_0.nerijus,S=4665:2,S Mar 29 16:03:16 nerijus dovecot: imap(nerijus): Error: Corrupted index cache file /home/nerijus/Maildir/.Linux_old.F LTK/dovecot.index.cache: Broken physical size for mail UID 109 in mailbox Linux_old.FLTK: read(/home/nerijus/Maildir /.Linux_old.FLTK/cur/1033767038.6490_0.nerijus,S=4712:2,S) failed: Cached message size larger than expected (4712 > 4665, box=Linux_old.FLTK, UID=109, cached Message-Id=<3D9E04B0.2070105 at easysw.com>) Mar 29 16:03:16 nerijus dovecot: imap(nerijus): Panic: file istream.c: line 163 (i_stream_read): assertion failed: ( old_size <= _stream->pos - _stream->skip) Attaching backtrace2. Regards, Nerijus -------------- next part -------------- A non-text attachment was scrubbed... Name: backtrace1 Type: application/octet-stream Size: 21208 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: backtrace2 Type: application/octet-stream Size: 18463 bytes Desc: not available URL: From tss at iki.fi Tue Mar 29 17:27:41 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 29 Mar 2016 20:27:41 +0300 Subject: plugin can't be loaded in imap proxy mode In-Reply-To: References: Message-ID: <9246404B-7C85-42A1-A2F5-A2AED69A324E@iki.fi> On 23 Mar 2016, at 07:28, Zhong, Xun wrote: > > Hi, All > > I tested [last-login] plugin, when I directly logined by pam way, the last-login plugin can load and run, but when I logined by proxy way(Dovecot forward my imap request to another imap server), the last-login plugin did not load and run. > > Thanks > > > From: Zhong, Xun > Sent: Wednesday, March 23, 2016 11:47 AM > To: 'dovecot at dovecot.org' > Subject: plugin can't be loaded in imap proxy mode > > When dovecot v2.2.21 work in IMAP proxy mode, plugin can not be loaded and work, so my question is: plugins do not work in proxy mode? > Anyone can help me ? Thanks a lot. Proxying doesn't support any plugins. From tss at iki.fi Tue Mar 29 17:31:03 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 29 Mar 2016 20:31:03 +0300 Subject: Crash when setting quota = count:User quota In-Reply-To: <9da1dcec4437b97c58fc0bd7348a2d0e@tomsommer.dk> References: <9da1dcec4437b97c58fc0bd7348a2d0e@tomsommer.dk> Message-ID: On 19 Mar 2016, at 17:56, Tom Sommer wrote: > > Mar 19 16:54:37 lmtp(xxxx at xxx.xxx): Panic: file file-lock.c: line 269: unreached > Mar 19 16:54:37 lmtp(xxxx at xxx.xxx): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x35f647e07a] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647e0e6] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647d4ac] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f6481edf] -> /usr/lib/dovecot/libdovecot.so.0(file_wait_lock_error+0x3a) [0x35f648205a] -> /usr/lib/dovecot/libdovecot.so.0(file_try_lock_error+0x13) [0x35f6482123] -> /usr/lib/dovecot/libdovecot.so.0(file_create_locked+0x284) [0x35f647f7a4] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f6068ec4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_vsize_update_wait_lock+0xe) [0x35f6068f2e] -> /usr/lib/dovecot/libdovecot- I guess you have lock_method=dotlock. Looks like this isn't supported right now in this code. Do you have some reason for using that setting? From tss at iki.fi Tue Mar 29 17:41:01 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 29 Mar 2016 20:41:01 +0300 Subject: imapc tries to fetch uid 0 In-Reply-To: <56C730D1.30703@fsn.hu> References: <56C730D1.30703@fsn.hu> Message-ID: <8027A134-42DA-4704-966E-7A7B3A88B2BB@iki.fi> > On 19 Feb 2016, at 17:12, Nagy, Attila wrote: > > Hi, > > This is a capture from an imapc client session (which is triggered by a message, received via LMTP): > * OK [CAPABILITY IMAP4rev1 NAMESPACE] Ready > 2 LOGIN "uid" "pass" > 2 OK LOGIN succeeded > 1 LIST "" "" > * LIST (\Noselect) "/" "" > 1 OK LIST completed > 3 APPEND "INBOX" {568} > + Ready for 568 octets of data > [...] > 3 OK APPEND complete > 4 EXAMINE "INBOX" > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) > * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. > * 4 EXISTS > * 0 RECENT > * OK [UIDVALIDITY 1455885804] > * OK [UIDNEXT 5] > 4 OK [READ-ONLY] EXAMINE successful > 5 UID FETCH 0 (RFC822.SIZE BODY.PEEK[HEADER.FIELDS (Message-ID)]) > 5 BAD Illegal syntax: Bad message number 0 > > Dovecot 2.2.21 > > I don't see any problems with the conversation otherwise. Is it safe to assume this is a bug in imapc? doveconf -n would be helpful. I guess you have mail_log plugin enabled? And imapc isn't used with any index directory? So Dovecot attempts to log Message-ID and size after saving a mail, but those aren't in cache (because indexes are disabled) and the transaction isn't committed yet either so the mail has no UID. So the only fix for now that I can do is to just not send the FETCH command and instead fail it immediately: https://github.com/dovecot/core/commit/969f57f722570982a5febbaab2462b692aa68733 Any further fixing would become difficult. From tss at iki.fi Tue Mar 29 17:43:38 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 29 Mar 2016 20:43:38 +0300 Subject: Dumb question: dovecot include file In-Reply-To: <20160318095014.000046ea@seibercom.net> References: <20160318095014.000046ea@seibercom.net> Message-ID: <0A0835E6-454F-4E44-9AAD-BE635773B24F@iki.fi> On 18 Mar 2016, at 15:50, Jerry wrote: > > Dovecot has an include file option. What I am not sure of is why those > files use both a *.conf and *.conf.ext extension. I assume both types > are included by using the !include .conf or !include > .conf.ext syntax. http://wiki2.dovecot.org/ConfigFile#External_config_files From tss at iki.fi Tue Mar 29 17:46:46 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 29 Mar 2016 20:46:46 +0300 Subject: talloc access after free error ntlmssp_server.c:457 In-Reply-To: References: Message-ID: <7D57FF91-B157-4E7A-A2D1-E902CFF2B0F4@iki.fi> On 16 Mar 2016, at 22:38, J Landwehr wrote: > > Our new/fresh dovecot imap installation on CentOS (latest from yum repository, which is 2.2.10) is locking up with a panic on a consistent basis and denying service to subsequent clients. The behavior is repeatable. Have spent weeks debugging and trying different configurations with no success. > > Specific /var/log/maillog error messages are: > > 12:06:54 dovecot: auth: Error: talloc: access after free error - first free may be at ../auth/ntlmssp/ntlmssp_server.c:457 > 12:06:54 dovecot: auth: Error: Bad talloc magic value - access after free > 12:06:54 dovecot: auth: Error: PANIC (pid 2570): Bad talloc magic value - access after free Looks like a bug in the winbind code. From mail at tomsommer.dk Tue Mar 29 18:04:09 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Tue, 29 Mar 2016 20:04:09 +0200 Subject: Crash when setting quota = count:User quota In-Reply-To: References: <9da1dcec4437b97c58fc0bd7348a2d0e@tomsommer.dk> Message-ID: <47BE7635-9EAD-4919-880F-297734628525@tomsommer.dk> > On 29. mar. 2016, at 19.31, Timo Sirainen wrote: > >> On 19 Mar 2016, at 17:56, Tom Sommer wrote: >> >> Mar 19 16:54:37 lmtp(xxxx at xxx.xxx): Panic: file file-lock.c: line 269: unreached >> Mar 19 16:54:37 lmtp(xxxx at xxx.xxx): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x35f647e07a] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647e0e6] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f647d4ac] -> /usr/lib/dovecot/libdovecot.so.0 [0x35f6481edf] -> /usr/lib/dovecot/libdovecot.so.0(file_wait_lock_error+0x3a) [0x35f648205a] -> /usr/lib/dovecot/libdovecot.so.0(file_try_lock_error+0x13) [0x35f6482123] -> /usr/lib/dovecot/libdovecot.so.0(file_create_locked+0x284) [0x35f647f7a4] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x35f6068ec4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_vsize_update_wait_lock+0xe) [0x35f6068f2e] -> /usr/lib/dovecot/libdovecot- > > I guess you have lock_method=dotlock. Looks like this isn't supported right now in this code. Do you have some reason for using that setting? > Yea. All other locking-methods give errors on my NFS box. From Ralf.Hildebrandt at charite.de Wed Mar 30 08:51:38 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Wed, 30 Mar 2016 10:51:38 +0200 Subject: crash after out of memory? Message-ID: <20160330085138.GC24440@charite.de> We're encountering a crash when proxying to an Exchange server: Mar 30 10:40:47 mproxy dovecot: imap-login: Login: user=, method=PLAIN, rip=10.39.76.71, lip=141.42.206.11, mpid=18556, TLS, session= Mar 30 10:40:49 mproxy dovecot: imap(xxxbxxx): Fatal: block_alloc(134217728): Out of memory Mar 30 10:40:49 mproxy dovecot: imap(xxxbxxx): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x85afe) [0x7fb0b829eafe] -> /usr/lib/dovecot/libdovecot.so.0(+0x85bec) [0x7fb0b829ebec] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7fb0b824373a] -> /usr/lib/dovecot/libdovecot.so.0(+0x9f284) [0x7fb0b82b8284] -> /usr/lib/dovecot/libdovecot.so.0(+0x9f2c3) [0x7fb0b82b82c3] -> /usr/lib/dovecot/libdovecot.so.0(+0x9f357) [0x7fb0b82b8357] -> /usr/lib/dovecot/libdovecot.so.0(+0x81a6d) [0x7fb0b829aa6d] -> /usr/lib/dovecot/libdovecot.so.0(buffer_write+0x6c) [0x7fb0b829acdc] -> /usr/lib/dovecot/libdovecot.so.0(+0x6ea54) [0x7fb0b8287a54] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7fb0b82a8ee3] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_copy_from_parent+0x118) [0x7fb0b82a96a8] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xc00ba) [0x7fb0b85e10ba] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7fb0b82a8ee3] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7fb0b82a991d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7fb0b828d2a2] -> /usr/lib/dovecot/libdovecot.so.0(+0x6e919) [0x7fb0b8287919] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7fb0b82a8ee3] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7fb0b82a991d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7fb0b828d2a2] -> /usr/lib/dovecot/libdovecot.so.0(+0x6e919) [0x7fb0b8287919] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7fb0b82a8ee3] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7fb0b82a991d] -> /usr/lib/dovecot/libdovecot.so.0(message_get_header_size+0x74) [0x7fb0b8290e34] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x317) [0x7fb0b8609f37] -> dovecot/imap [xxxbxxx 10.39.76.71 UID fetch](+0x1f1de) [0x7fb0b8a9a1de] -> dovecot/imap [xxxbxxx 10.39.76.71 UID fetch](+0x1d60c) [0x7fb0b8a9860c] -> dovecot/imap [xxxbxxx 10.39.76.71 UID fetch](imap_fetch_more+0x3a) [0x7fb0b8a9970a] -> dovecot/imap [xxxbxxx 10.39.76.71 UID fetch](cmd_fetch+0x354) [0x7fb0b8a8b954] Mar 30 10:40:49 mproxy dovecot: imap(xxxbxxx): Fatal: master: service(imap): child 18556 returned error 83 (Out of memory (service imap { vsz_limit=256 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) It happens for this user ONLY. Using the automatic bosch build: 2.2.21-1~auto+152 -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From jlandwehr at icloud.com Wed Mar 30 12:04:27 2016 From: jlandwehr at icloud.com (J Landwehr) Date: Wed, 30 Mar 2016 08:04:27 -0400 Subject: talloc access after free error ntlmssp_server.c:457 In-Reply-To: <7D57FF91-B157-4E7A-A2D1-E902CFF2B0F4@iki.fi> References: <7D57FF91-B157-4E7A-A2D1-E902CFF2B0F4@iki.fi> Message-ID: Do you think it?s a bug in the dovecot code that calls winbind? Or in the samba based winbind code? We have a fully patched CentOS system. This case is definitely triggered as follows: Connect with Outlook Outlook brings in any new mail After maybe 30 seconds there are IMAP disconnect messages in maillog Then send a message to yourself. The message is sent and received, but the dovecot server crashes/panics Appears to be related to the CONT command And receiving NT_STATUS_WRONG_PASSWORD / NT_STATUS_LOGON_FAILURE What I can?t figure out is that ntlm_auth always works from the command line, and IMAP is otherwise working to bring in new mail (so authenticating is working) - but it?s like a certain condition of sync?ing perhaps the Sent folder with the Inbox folder having two authentication events simultaneously is the issue, and the second one fails? auth client connected auth client conencted client in: AUTH client in: AUTH client passdb out: CONT#0111 client passdb out: CONT#0111 client in: CONT Got 'YR ..." from squid (length: 59). Starting GENSEC mechanism ntlmssp Starting GENSEC mechanism ntlmssp Login for user [domain]\[user]@[workstation] failed due to [Wrong Password] ../auth/ntlmssp/ntlmssp_server.c:455: checking NTLMSSP password for domain/user failed: NT_STATUS_WRONG_PASSWORD GENSEC login failed: NT_STATUS_LOGON_FAILURE winbind(?,IP,<...>): user not authenticated: NT_STATUS_LOGON_FAILURE client in: CONT got 'KK ......' from squid . talloc: access after free error - first free may be at ../auth/ntlmssp/ntlmssp_server.c:457 Bad talloc magic value - access after free PANIC (pid ....): Bad talloc magic value - access after free Definitely welcome any debugging ideas and workarounds, because we have had to shut off IMAP and only use POP. > On Mar 29, 2016, at 1:46 PM, Timo Sirainen wrote: > > On 16 Mar 2016, at 22:38, J Landwehr wrote: >> >> Our new/fresh dovecot imap installation on CentOS (latest from yum repository, which is 2.2.10) is locking up with a panic on a consistent basis and denying service to subsequent clients. The behavior is repeatable. Have spent weeks debugging and trying different configurations with no success. >> >> Specific /var/log/maillog error messages are: >> >> 12:06:54 dovecot: auth: Error: talloc: access after free error - first free may be at ../auth/ntlmssp/ntlmssp_server.c:457 >> 12:06:54 dovecot: auth: Error: Bad talloc magic value - access after free >> 12:06:54 dovecot: auth: Error: PANIC (pid 2570): Bad talloc magic value - access after free > > Looks like a bug in the winbind code. > From jlandwehr at icloud.com Wed Mar 30 12:22:42 2016 From: jlandwehr at icloud.com (J Landwehr) Date: Wed, 30 Mar 2016 08:22:42 -0400 Subject: CentOS RPM updates? Message-ID: Has CentOS stopped distributing dovecot updates via yum? The current version there is 2.2.10 - which is now over two years old. The link on: http://dovecot.org/download.html to ?RPMs for Fedora and RHEL/CentOS? http://packages.atrpms.net/dist/el6/dovecot/ is also broken. Would be great if someone could please point me to alternative locations for authentic RPMs From tss at iki.fi Wed Mar 30 12:30:13 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 30 Mar 2016 15:30:13 +0300 Subject: crash after out of memory? In-Reply-To: <20160330085138.GC24440@charite.de> References: <20160330085138.GC24440@charite.de> Message-ID: <04B647B0-B845-420B-A112-E254D01E7401@iki.fi> On 30 Mar 2016, at 11:51, Ralf Hildebrandt wrote: > > We're encountering a crash when proxying to an Exchange server: > > Mar 30 10:40:47 mproxy dovecot: imap-login: Login: user=, method=PLAIN, rip=10.39.76.71, lip=141.42.206.11, mpid=18556, TLS, session= > Mar 30 10:40:49 mproxy dovecot: imap(xxxbxxx): Fatal: block_alloc(134217728): Out of memory > Mar 30 10:40:49 mproxy dovecot: imap(xxxbxxx): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7fb0b828d2a2] -> > /usr/lib/dovecot/libdovecot.so.0(+0x6e919) [0x7fb0b8287919] -> > /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7fb0b82a8ee3] -> > /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7fb0b82a991d] -> > /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7fb0b828d2a2] -> The user has an email that contains a huge >100MB header line? I think there's something in here that could use fixing. It shouldn't be that easy to make Dovecot use up that much memory. Some istream buffer size limit is missing somewhere I think.. The attached patch might help? -------------- next part -------------- A non-text attachment was scrubbed... Name: imapc-memory-limit.diff Type: application/octet-stream Size: 1228 bytes Desc: not available URL: -------------- next part -------------- From Ralf.Hildebrandt at charite.de Wed Mar 30 12:41:09 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Wed, 30 Mar 2016 14:41:09 +0200 Subject: crash after out of memory? In-Reply-To: <04B647B0-B845-420B-A112-E254D01E7401@iki.fi> References: <20160330085138.GC24440@charite.de> <04B647B0-B845-420B-A112-E254D01E7401@iki.fi> Message-ID: <20160330124109.GH24440@charite.de> * Timo Sirainen : > The user has an email that contains a huge >100MB header line? I hope not :) I "solved" the problem by setting the vsz_limit_default to 1G > I think there's something in here that could use fixing. It shouldn't be > that easy to make Dovecot use up that much memory. Some istream buffer > size limit is missing somewhere I think.. The attached patch might help? Is it in the official tree? I'm using the autobuilds nowadays. Could tell you tomorrow! -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From tss at iki.fi Wed Mar 30 12:48:04 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 30 Mar 2016 15:48:04 +0300 Subject: v2.2.23 released Message-ID: http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig This is a bugfix-only release with various important fixes on top of v2.2.22. - Various fixes to doveadm. Especially running commands via doveadm-server was broken. - director: Fixed user weakness getting stuck in some situations - director: Fixed a situation where directors keep re-sending different states to each others and never becoming synced. - director: Fixed assert-crash related to a slow "user killed" reply - Fixed assert-crash related to istream-concat, which could have been triggered at least by a Sieve script. From bra at fsn.hu Wed Mar 30 13:08:11 2016 From: bra at fsn.hu (Nagy, Attila) Date: Wed, 30 Mar 2016 15:08:11 +0200 Subject: imapc tries to fetch uid 0 In-Reply-To: <8027A134-42DA-4704-966E-7A7B3A88B2BB@iki.fi> References: <56C730D1.30703@fsn.hu> <8027A134-42DA-4704-966E-7A7B3A88B2BB@iki.fi> Message-ID: <56FBCFBB.9000504@fsn.hu> On 03/29/16 19:41, Timo Sirainen wrote: >> On 19 Feb 2016, at 17:12, Nagy, Attila wrote: >> >> Hi, >> >> This is a capture from an imapc client session (which is triggered by a message, received via LMTP): >> * OK [CAPABILITY IMAP4rev1 NAMESPACE] Ready >> 2 LOGIN "uid" "pass" >> 2 OK LOGIN succeeded >> 1 LIST "" "" >> * LIST (\Noselect) "/" "" >> 1 OK LIST completed >> 3 APPEND "INBOX" {568} >> + Ready for 568 octets of data >> [...] >> 3 OK APPEND complete >> 4 EXAMINE "INBOX" >> * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) >> * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. >> * 4 EXISTS >> * 0 RECENT >> * OK [UIDVALIDITY 1455885804] >> * OK [UIDNEXT 5] >> 4 OK [READ-ONLY] EXAMINE successful >> 5 UID FETCH 0 (RFC822.SIZE BODY.PEEK[HEADER.FIELDS (Message-ID)]) >> 5 BAD Illegal syntax: Bad message number 0 >> >> Dovecot 2.2.21 >> >> I don't see any problems with the conversation otherwise. Is it safe to assume this is a bug in imapc? > doveconf -n would be helpful. I guess you have mail_log plugin enabled? And imapc isn't used with any index directory? So Dovecot attempts to log Message-ID and size after saving a mail, but those aren't in cache (because indexes are disabled) and the transaction isn't committed yet either so the mail has no UID. > > So the only fix for now that I can do is to just not send the FETCH command and instead fail it immediately: > https://github.com/dovecot/core/commit/969f57f722570982a5febbaab2462b692aa68733 > > Any further fixing would become difficult. > I don't have mail_log enabled (currently, but will be) and indexes aren't disabled. Here's the actual config: # 2.2.22 (fe789d2): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: FreeBSD 10.3-PRERELEASE amd64 auth_mechanisms = plain login disable_plaintext_auth = no imapc_features = rfc822.size fetch-headers imapc_host = 127.0.0.1 imapc_port = 1430 lmtp_proxy = yes mail_gid = imapproxy mail_home = /usr/home/imapproxy/%2.256Nu/%u mail_location = imapc:~/imapc mail_prefetch_count = 100 mail_uid = imapproxy managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-dict-auth.conf.ext driver = dict } postmaster_address = postmaster service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = no userdb { driver = prefetch } userdb { args = /usr/local/etc/dovecot/dovecot-dict-auth.conf.ext driver = dict } protocol lmtp { mail_plugins = " sieve" } The user home contains a dovecot.index.cache and a .log file. During the LMTP delivery (which turns into an IMAP APPEND, maybe this is where the bug lies? It's not too typical to do this I guess), they aren't changed. From michael.seevogel at ddnetservice.de Wed Mar 30 15:22:55 2016 From: michael.seevogel at ddnetservice.de (Michael Seevogel) Date: Wed, 30 Mar 2016 17:22:55 +0200 Subject: CentOS RPM updates? In-Reply-To: References: Message-ID: <56FBEF4F.6070800@ddnetservice.de> Am 30.03.2016 um 14:22 schrieb J Landwehr: > Has CentOS stopped distributing dovecot updates via yum? > > The current version there is 2.2.10 - which is now over two years old. > > The link on: http://dovecot.org/download.html to ?RPMs for Fedora and RHEL/CentOS? http://packages.atrpms.net/dist/el6/dovecot/ is also broken. > > Would be great if someone could please point me to alternative locations for authentic RPMs There are no "authentic" RedHat RPMs (for RedHat Linux) with versions newer than 2.2.10 available. Red Hat Linux (or if you use CentOS) releases most packages with Long Term Support in mind. This implies that mostly no new, or bleeding edge versions of, for example Dovecot will be released. So if you want "very authentic" and newer versions of Dovecot as RPM package then you should get a subscription from Dovecot Oy or check this recent conversation for "authentic" CentOS 5/6/7 RPMs out: https://www.mail-archive.com/dovecot at dovecot.org/msg64887.html Best regards Michael Seevogel From jcblanco at fi.upm.es Wed Mar 30 15:34:17 2016 From: jcblanco at fi.upm.es (Juan C. Blanco) Date: Wed, 30 Mar 2016 17:34:17 +0200 Subject: Pigeonhole 0.4.13 does not compile against dovecot 2.2.23 Message-ID: <56FBF1F9.5080507@fi.upm.es> Hello, I supose that a new version of pigeonhole is on the way because version 0.4.13 does not compile against dovecot 2.2.23 This is the error that I get gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../.. -I../../../src/lib-sieve -I../../../src/lib-sieve/util -I../../../src/lib-sieve/plugins/environment -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/imap -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-lda -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lda -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23 -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dict -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dns -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-http -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-mail -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-fs -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-charset -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-auth -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-master -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-ssl-iostream -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-compression -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-settings -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-test -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-sasl -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-stats -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-index -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/list -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index/raw -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap-storage -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/plugins/quota -DPKG_RUNDIR=\"\" -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/kerberos/include -I../../.. -MT imap-sieve-storage.lo -MD -MP -MF .deps/imap-sieve-storage.Tpo -c imap-sieve-storage.c -fPIC -DPIC -o .libs/imap-sieve-storage.o imap-sieve-storage.c: In function 'imap_sieve_mailbox_transaction_run': imap-sieve-storage.c:595: error: 'struct client' has no member named 'lda_set' make[4]: *** [imap-sieve-storage.lo] Error 1 Regards. Juan C. Blanco > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig > > This is a bugfix-only release with various important fixes on top of v2.2.22. > > - Various fixes to doveadm. Especially running commands via > doveadm-server was broken. > - director: Fixed user weakness getting stuck in some situations > - director: Fixed a situation where directors keep re-sending > different states to each others and never becoming synced. > - director: Fixed assert-crash related to a slow "user killed" reply > - Fixed assert-crash related to istream-concat, which could have > been triggered at least by a Sieve script. -- +-------------------------------------------------------------------+ | Juan C. Blanco | | | | Centro de Calculo | | | E.T.S. Ingenieros Inform?ticos | E-mail: jcblanco at fi.upm.es | | Universidad Polit?cnica de Madrid | | | Campus de Montegancedo | | | Boadilla del Monte | Tel.: (+34) 91 336 7466 | | 28660 MADRID (Spain) | Fax : (+34) 91 336 6913 | +-------------------------------------------------------------------+ From gsue-dvctnews at gameduell.de Wed Mar 30 15:45:41 2016 From: gsue-dvctnews at gameduell.de (Georg Schuetze) Date: Wed, 30 Mar 2016 17:45:41 +0200 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <56EA4533.1080505@gameduell.de> References: <52DA80D4.3000900@gekmihesg.de> <56E9795C.2040003@gameduell.de> <56EA4533.1080505@gameduell.de> Message-ID: <56FBF4A5.8000103@gameduell.de> Nobody? Should i provide more info or did i something wrong? On 03/17/2016 06:48 AM, Georg Schuetze wrote: > In my setup i can reproduce this issue with only one message in a shared > folder: > Everytime when the (new) replication client is started for the first > time, the initial replication takes place and there the message in the > shared folder gets duplicated thousands of times. From stephan at rename-it.nl Wed Mar 30 16:06:19 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 30 Mar 2016 18:06:19 +0200 Subject: Pigeonhole 0.4.13 does not compile against dovecot 2.2.23 In-Reply-To: <56FBF1F9.5080507@fi.upm.es> References: <56FBF1F9.5080507@fi.upm.es> Message-ID: <56FBF97B.1040601@rename-it.nl> Hi, Op 3/30/2016 om 5:34 PM schreef Juan C. Blanco: > Hello, I supose that a new version of pigeonhole is on the way because > version 0.4.13 does not compile against dovecot 2.2.23 > > This is the error that I get > > gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../.. > -I../../../src/lib-sieve -I../../../src/lib-sieve/util > -I../../../src/lib-sieve/plugins/environment > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/imap > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-lda > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lda > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23 > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dict > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dns > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-http > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-mail > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-fs > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-charset > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-auth > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-master > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-ssl-iostream > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-compression > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-settings > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-test > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-sasl > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-stats > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-index > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/list > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index/raw > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap-storage > -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/plugins/quota > -DPKG_RUNDIR=\"\" -std=gnu99 -O2 -g -pipe -Wall > -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector > --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W > -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith > -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime > -Wstrict-aliasing=2 -I/usr/kerberos/include -I../../.. -MT > imap-sieve-storage.lo -MD -MP -MF .deps/imap-sieve-storage.Tpo -c > imap-sieve-storage.c -fPIC -DPIC -o .libs/imap-sieve-storage.o > imap-sieve-storage.c: In function 'imap_sieve_mailbox_transaction_run': > imap-sieve-storage.c:595: error: 'struct client' has no member named > 'lda_set' > make[4]: *** [imap-sieve-storage.lo] Error 1 I don't know what that is, but it is definitely not Pigeonhole 0.4.13. The code it is failing on is a recently added feature (https://tools.ietf.org/html/rfc6785) that currently only lives in git master. Regards, Stephan. > > Regards. > Juan C. Blanco > > >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >> >> This is a bugfix-only release with various important fixes on top of >> v2.2.22. >> >> - Various fixes to doveadm. Especially running commands via >> doveadm-server was broken. >> - director: Fixed user weakness getting stuck in some situations >> - director: Fixed a situation where directors keep re-sending >> different states to each others and never becoming synced. >> - director: Fixed assert-crash related to a slow "user killed" reply >> - Fixed assert-crash related to istream-concat, which could have >> been triggered at least by a Sieve script. > > From dieterknopf at gmail.com Wed Mar 30 16:09:02 2016 From: dieterknopf at gmail.com (Dieter Knopf) Date: Wed, 30 Mar 2016 18:09:02 +0200 Subject: Multiple IMAP Mailboxes and one collection folder Message-ID: Hello, we use many IMAP folders and now we are searching for a way to display all mails inside this folders in one collecting folder. The advantage for us would be the possibility to view all new incoming mails in one folder. It would be possible to use the standard MAIL App on the iOS without problems. I could simply make a copy of all mails in one folder with Sieve, but then the Per-user Seen Flag would be useless, because the mail inside the folder is still unread. Is there a way to show some way of collecting folder for every user? Thanks Dieter From jcblanco at fi.upm.es Wed Mar 30 16:21:02 2016 From: jcblanco at fi.upm.es (Juan C. Blanco) Date: Wed, 30 Mar 2016 18:21:02 +0200 Subject: Pigeonhole 0.4.13 does not compile against dovecot 2.2.23 In-Reply-To: <56FBF97B.1040601@rename-it.nl> References: <56FBF1F9.5080507@fi.upm.es> <56FBF97B.1040601@rename-it.nl> Message-ID: <56FBFCEE.80508@fi.upm.es> Sorry for the noise, I forgot I've been testing 0.4.13+git patches. I'll try again with a clean pigeonhole 0.4.13. Seems that this feature is using a field in imap client struct that was removed in the last release of dovecot. Thanks. Juan C. Blanco On 30/03/2016 18:06, Stephan Bosch wrote: > Hi, > > Op 3/30/2016 om 5:34 PM schreef Juan C. Blanco: >> Hello, I supose that a new version of pigeonhole is on the way because >> version 0.4.13 does not compile against dovecot 2.2.23 >> >> This is the error that I get >> >> gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../.. >> -I../../../src/lib-sieve -I../../../src/lib-sieve/util >> -I../../../src/lib-sieve/plugins/environment >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/imap >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-lda >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lda >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23 >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dict >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dns >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-http >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-mail >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-fs >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-charset >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-auth >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-master >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-ssl-iostream >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-compression >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-settings >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-test >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-sasl >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-stats >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-index >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/list >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index/raw >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap-storage >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/plugins/quota >> -DPKG_RUNDIR=\"\" -std=gnu99 -O2 -g -pipe -Wall >> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector >> --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W >> -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >> -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime >> -Wstrict-aliasing=2 -I/usr/kerberos/include -I../../.. -MT >> imap-sieve-storage.lo -MD -MP -MF .deps/imap-sieve-storage.Tpo -c >> imap-sieve-storage.c -fPIC -DPIC -o .libs/imap-sieve-storage.o >> imap-sieve-storage.c: In function 'imap_sieve_mailbox_transaction_run': >> imap-sieve-storage.c:595: error: 'struct client' has no member named >> 'lda_set' >> make[4]: *** [imap-sieve-storage.lo] Error 1 > > I don't know what that is, but it is definitely not Pigeonhole 0.4.13. > The code it is failing on is a recently added feature > (https://tools.ietf.org/html/rfc6785) that currently only lives in git > master. > > Regards, > > Stephan. > > >> >> Regards. >> Juan C. Blanco >> >> >>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >>> >>> This is a bugfix-only release with various important fixes on top of >>> v2.2.22. >>> >>> - Various fixes to doveadm. Especially running commands via >>> doveadm-server was broken. >>> - director: Fixed user weakness getting stuck in some situations >>> - director: Fixed a situation where directors keep re-sending >>> different states to each others and never becoming synced. >>> - director: Fixed assert-crash related to a slow "user killed" reply >>> - Fixed assert-crash related to istream-concat, which could have >>> been triggered at least by a Sieve script. >> >> -- +-------------------------------------------------------------------+ | Juan C. Blanco | | | | Centro de Calculo | | | E.T.S. Ingenieros Inform?ticos | E-mail: jcblanco at fi.upm.es | | Universidad Polit?cnica de Madrid | | | Campus de Montegancedo | | | Boadilla del Monte | Tel.: (+34) 91 336 7466 | | 28660 MADRID (Spain) | Fax : (+34) 91 336 6913 | +-------------------------------------------------------------------+ From ml+dovecot at valo.at Wed Mar 30 17:33:50 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Wed, 30 Mar 2016 19:33:50 +0200 Subject: Multiple IMAP Mailboxes and one collection folder In-Reply-To: References: Message-ID: On 2016-03-30 18:09, Dieter Knopf wrote: > Hello, > > we use many IMAP folders and now we are searching for a way to display > all mails inside this folders in one collecting folder. > > The advantage for us would be the possibility to view all new incoming > mails in one folder. It would be possible to use the standard MAIL App > on the iOS without problems. > > I could simply make a copy of all mails in one folder with Sieve, but > then the Per-user Seen Flag would be useless, because the mail inside > the folder is still unread. Maybe something for the virtual plugin http://wiki2.dovecot.org/Plugins/Virtual > Is there a way to show some way of collecting folder for every user? > > Thanks > > Dieter -- Christian Kivalo From niols at niols.fr Wed Mar 30 19:45:24 2016 From: niols at niols.fr (Niols) Date: Wed, 30 Mar 2016 21:45:24 +0200 Subject: Dovecot-LMTP and LDAP: passdb doesn't support credential lookups Message-ID: <56FC2CD4.6000308@niols.fr> Hello, Sorry, this might be a newbish question, but I really can't get the answer by myself. I'm trying to setup a mail server using LDAP to authenticate users, and I keep receiving the errors: passdb doesn't support credential lookups passdb doesn't support lookups, can't verify user's existence when I send test mails to (existing) users. I'm already using the LDAP server for other purposes, and it's working fine. I can't (or I don't want to) give read access to the userPassword attribute, so I want to use a authentication bind: http://wiki.dovecot.org/AuthDatabase/LDAP/AuthBinds I've already managed to have postfix working with this LDAP server, the users (and their aliases) are correctly recognized. Postfix then sends the mails to Dovecot (2.2.13, Debian Jessie's version) with dovecot-lmtp. Here is my /etc/dovecot/conf.d/auth-ldap.conf.ext. I use the static driver for userdb, and the LDAP driver for passdb. passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = static args = uid=mail gid=mail home=/var/mail/%u } Here is my /etc/dovecot/dovecot-ldap.conf.ext file. hosts = localhost ldap_version = 3 dn = cn=dovecot,ou=services,dc=niols,dc=fr dnpass = a-random-password auth_bind = yes base = ou=people,dc=niols,dc=fr pass_filter = (&(objectClass=inetOrgPerson)(mail=%u)) I haven't set the user_filter and user_attrs values, since I thought these would only be usefull for userdb. I haven't set the pass_attrs value, since I don't see why it would be needed (I just need to be able to bind my user, right?). I can't auth_bind_userdn since the e-mail address aren't necessarily related in any way to the user dn. I assumed %u was going to be replaced by the user's full e-mail address. I tried to play a bit with these values to find a working configuration, without success. I tried to search myself on the LDAP server, using the provided dn and dnpass, and I succeeded. I tried to activate debug logs, but that didn't give me much more information (full debug log at the end of this e-mail). I think the problem is that passdb cannot find the user on the LDAP server, but I don't know why. I believe the problem is lying in my non-comprehension of what userdb and passdb actually do. I tried to find out by myself, and I'm here because I didn't manage to do so. I'm sorry if this post looks stupid. Any help and any comments of any kind would be greatly appreciated. Regards, Niols PS: Here is the full debug log that I get after sending a test message to test at niols.net (.net vs. .fr: this is not a mistake, I use my .net domain for testing purposes while I use my .fr domain for eveyday life) with swaks: lmtp(3208): Connect from local auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat auth: Debug: LDAP initialization took 0 msecs auth: Debug: master in: USER 1 test at niols.net service=lmtp auth: Debug: ldap(test at niols.net): passdb doesn't support credential lookups auth: Error: static(test at niols.net): passdb doesn't support lookups, can't verify user's existence auth: Debug: userdb out: FAIL 1 lmtp(3208): Error: user test at niols.net: Auth USER lookup failed lmtp(3208): Disconnect from local: Successful quit From sven at svenhartge.de Wed Mar 30 20:00:58 2016 From: sven at svenhartge.de (Sven Hartge) Date: Wed, 30 Mar 2016 22:00:58 +0200 Subject: Dovecot-LMTP and LDAP: passdb doesn't support credential lookups References: <56FC2CD4.6000308@niols.fr> Message-ID: <3cejvve9gtv8@mids.svenhartge.de> Niols wrote: > Here is my /etc/dovecot/conf.d/auth-ldap.conf.ext. I use the static > driver for userdb, and the LDAP driver for passdb. > passdb { > driver = ldap > args = /etc/dovecot/dovecot-ldap.conf.ext > } > userdb { > driver = static > args = uid=mail gid=mail home=/var/mail/%u > } My config: passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=virtmail gid=virtmail home=/srv/mail/%2NLn/%2.256NLn/%Ln/ quota_rule2=Trash:ignore driver = ldap } I also use ldap for the userdb, because I need to lookup the quota from LDAP. > Here is my /etc/dovecot/dovecot-ldap.conf.ext file. > hosts = localhost > ldap_version = 3 > dn = cn=dovecot,ou=services,dc=niols,dc=fr > dnpass = a-random-password > auth_bind = yes > base = ou=people,dc=niols,dc=fr > pass_filter = (&(objectClass=inetOrgPerson)(mail=%u)) Here is my ldap.conf.ext, there is some elaborate filtering going on, but you should get the idea: hosts = ldap.somedomain.de dn = cn=mailsystem,ou=systemuser,dc=somedomain,dc=de dnpass = verySecurePassword tls = yes auth_bind = yes ldap_version = 3 base = dc=somedomain,dc=de deref = always scope = subtree user_attrs = =quota_rule=*:bytes=%{ldap:gifb-mailquota} user_filter = (&(objectClass=gifb-mailperson)(ou=SomeLocation)(uid=%Ln)(!(objectClass=gifb-role))) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=gifb-mailperson)(ou=SomeLocation)(gifb-status=1)(uid=%n)(!(objectClass=gifb-role))) iterate_attrs = uid=user iterate_filter = (&(objectClass=gifb-mailperson)(ou=SomeLocation)) Gr??e, Sven. -- Sigmentation fault. Core dumped. From noel.butler at ausics.net Wed Mar 30 23:14:47 2016 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 31 Mar 2016 09:14:47 +1000 Subject: Pigeonhole 0.4.13 does not compile against dovecot 2.2.23 In-Reply-To: <56FBF97B.1040601@rename-it.nl> References: <56FBF1F9.5080507@fi.upm.es> <56FBF97B.1040601@rename-it.nl> Message-ID: <0678d261286c4f1ae1888f894bcca595@ausics.net> On 31/03/2016 02:06, Stephan Bosch wrote: > Hi, > > Op 3/30/2016 om 5:34 PM schreef Juan C. Blanco: >> Hello, I supose that a new version of pigeonhole is on the way because >> version 0.4.13 does not compile against dovecot 2.2.23 >> >> This is the error that I get >> >> gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../.. >> -I../../../src/lib-sieve -I../../../src/lib-sieve/util >> -I../../../src/lib-sieve/plugins/environment >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/imap >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-lda >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lda >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23 >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dict >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dns >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-http >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-mail >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-fs >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-charset >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-auth >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-master >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-ssl-iostream >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-compression >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-settings >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-test >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-sasl >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-stats >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-index >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/list >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index/raw >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap-storage >> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/plugins/quota >> -DPKG_RUNDIR=\"\" -std=gnu99 -O2 -g -pipe -Wall >> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector >> --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W >> -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >> -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime >> -Wstrict-aliasing=2 -I/usr/kerberos/include -I../../.. -MT >> imap-sieve-storage.lo -MD -MP -MF .deps/imap-sieve-storage.Tpo -c >> imap-sieve-storage.c -fPIC -DPIC -o .libs/imap-sieve-storage.o >> imap-sieve-storage.c: In function >> 'imap_sieve_mailbox_transaction_run': >> imap-sieve-storage.c:595: error: 'struct client' has no member named >> 'lda_set' >> make[4]: *** [imap-sieve-storage.lo] Error 1 > > I don't know what that is, but it is definitely not Pigeonhole 0.4.13. > The code it is failing on is a recently added feature > (https://tools.ietf.org/html/rfc6785) that currently only lives in git > master. > > Regards, > > Stephan. > > >> >> Regards. >> Juan C. Blanco >> >> >>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >>> >>> This is a bugfix-only release with various important fixes on top of >>> v2.2.22. >>> >>> - Various fixes to doveadm. Especially running commands via >>> doveadm-server was broken. >>> - director: Fixed user weakness getting stuck in some situations >>> - director: Fixed a situation where directors keep re-sending >>> different states to each others and never becoming synced. >>> - director: Fixed assert-crash related to a slow "user killed" reply >>> - Fixed assert-crash related to istream-concat, which could have >>> been triggered at least by a Sieve script. >> >> Starting dovecot POP3/IMAP daemon... doveconf: Error: Couldn't load plugin /usr/lib/dovecot/settings/libmanagesieve_login_settings.so: Module is for different ABI version 2.2.ABIv22(2.2.22) (we have 2.2.ABIv23(2.2.23)) doveconf: Error: Couldn't load plugin /usr/lib/dovecot/settings/libmanagesieve_settings.so: Module is for different ABI version 2.2.ABIv22(2.2.22) (we have 2.2.ABIv23(2.2.23)) doveconf: Error: Couldn't load plugin /usr/lib/dovecot/settings/libpigeonhole_settings.so: Module is for different ABI version 2.2.ABIv22(2.2.22) (we have 2.2.ABIv23(2.2.23)) doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 232: Unknown setting: managesieve_logout_format Failed. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From stephan at rename-it.nl Thu Mar 31 01:09:32 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 31 Mar 2016 03:09:32 +0200 Subject: Pigeonhole 0.4.13 does not compile against dovecot 2.2.23 In-Reply-To: <0678d261286c4f1ae1888f894bcca595@ausics.net> References: <56FBF1F9.5080507@fi.upm.es> <56FBF97B.1040601@rename-it.nl> <0678d261286c4f1ae1888f894bcca595@ausics.net> Message-ID: <56FC78CC.4030501@rename-it.nl> Op 3/31/2016 om 1:14 AM schreef Noel Butler: > On 31/03/2016 02:06, Stephan Bosch wrote: >> Hi, >> >> Op 3/30/2016 om 5:34 PM schreef Juan C. Blanco: >>> Hello, I supose that a new version of pigeonhole is on the way because >>> version 0.4.13 does not compile against dovecot 2.2.23 >>> >>> This is the error that I get >>> >>> gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../.. >>> -I../../../src/lib-sieve -I../../../src/lib-sieve/util >>> -I../../../src/lib-sieve/plugins/environment >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/imap >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-lda >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lda >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23 >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dict >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-dns >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-http >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-mail >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-fs >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-charset >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-auth >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-master >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-ssl-iostream >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-compression >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-settings >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-test >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-sasl >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-stats >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-index >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/list >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-storage/index/raw >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/lib-imap-storage >>> -I/home/jc/rpmbuild/BUILD/dovecot-2.2.23/src/plugins/quota >>> -DPKG_RUNDIR=\"\" -std=gnu99 -O2 -g -pipe -Wall >>> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector >>> --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W >>> -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >>> -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime >>> -Wstrict-aliasing=2 -I/usr/kerberos/include -I../../.. -MT >>> imap-sieve-storage.lo -MD -MP -MF .deps/imap-sieve-storage.Tpo -c >>> imap-sieve-storage.c -fPIC -DPIC -o .libs/imap-sieve-storage.o >>> imap-sieve-storage.c: In function 'imap_sieve_mailbox_transaction_run': >>> imap-sieve-storage.c:595: error: 'struct client' has no member named >>> 'lda_set' >>> make[4]: *** [imap-sieve-storage.lo] Error 1 >> >> I don't know what that is, but it is definitely not Pigeonhole 0.4.13. >> The code it is failing on is a recently added feature >> (https://tools.ietf.org/html/rfc6785) that currently only lives in git >> master. >> >> Regards, >> >> Stephan. >> >> >>> >>> Regards. >>> Juan C. Blanco >>> >>> >>>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >>>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >>>> >>>> This is a bugfix-only release with various important fixes on top of >>>> v2.2.22. >>>> >>>> - Various fixes to doveadm. Especially running commands via >>>> doveadm-server was broken. >>>> - director: Fixed user weakness getting stuck in some situations >>>> - director: Fixed a situation where directors keep re-sending >>>> different states to each others and never becoming synced. >>>> - director: Fixed assert-crash related to a slow "user killed" reply >>>> - Fixed assert-crash related to istream-concat, which could have >>>> been triggered at least by a Sieve script. >>> >>> > > Starting dovecot POP3/IMAP daemon... doveconf: Error: Couldn't load > plugin /usr/lib/dovecot/settings/libmanagesieve_login_settings.so: > Module is for different ABI version 2.2.ABIv22(2.2.22) (we have > 2.2.ABIv23(2.2.23)) > doveconf: Error: Couldn't load plugin > /usr/lib/dovecot/settings/libmanagesieve_settings.so: Module is for > different ABI version 2.2.ABIv22(2.2.22) (we have 2.2.ABIv23(2.2.23)) > doveconf: Error: Couldn't load plugin > /usr/lib/dovecot/settings/libpigeonhole_settings.so: Module is for > different ABI version 2.2.ABIv22(2.2.22) (we have 2.2.ABIv23(2.2.23)) > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf > line 232: Unknown setting: managesieve_logout_format > Failed. Pigeonhole needs to be recompiled. Regards, Stephan. From qmail at top-consulting.net Thu Mar 31 06:26:54 2016 From: qmail at top-consulting.net (qmail at top-consulting.net) Date: Thu, 31 Mar 2016 06:26:54 +0000 Subject: Dovecot plugin pthread issue Message-ID: <0c9f62bbdde7eada478e0154145c24d2@al.emailarray.com> I am using FreeBSD 10.1 and Dovecot 2.2.22 with the Openchange plugin - https://github.com/openchange/openchange/tree/master/mapiproxy/services/plugins/dovecot (https://github.com/openchange/openchange/tree/master/mapiproxy/services/plugins/dovecot) The plugin compiles just fine and works up until when it tries to create a socket using nanomsg, which uses a pthread_create() call. At that point dovecot-lda just hangs indefinitely. I've read that -pthread must be included in all the components that might end up using it. So checking with ldd: nanomsg does include libthr ( pthread equivalent in FreeBSD ) openchange plugin also includes libthr dovecot-lda doesn't include libthr Would dovecot-lda also need to be compiled with -pthread ? Is it safe ? How can it be done ? Thank you! From sergey.schwartz at bgoperator.com Thu Mar 31 09:08:58 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Thu, 31 Mar 2016 12:08:58 +0300 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <56FBF4A5.8000103@gameduell.de> References: <52DA80D4.3000900@gekmihesg.de> <56E9795C.2040003@gameduell.de> <56EA4533.1080505@gameduell.de> <56FBF4A5.8000103@gameduell.de> Message-ID: <56FCE92A.9000700@bgoperator.com> Georg, I've got the same problem with my setup. There is a workaround - limit replication scope with INBOX namespace only. Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com 30.03.2016 18:45, Georg Schuetze ?????: > Nobody? Should i provide more info or did i something wrong? > > > On 03/17/2016 06:48 AM, Georg Schuetze wrote: >> In my setup i can reproduce this issue with only one message in a shared >> folder: >> Everytime when the (new) replication client is started for the first >> time, the initial replication takes place and there the message in the >> shared folder gets duplicated thousands of times. From dieterknopf at gmail.com Thu Mar 31 09:54:24 2016 From: dieterknopf at gmail.com (Dieter Knopf) Date: Thu, 31 Mar 2016 11:54:24 +0200 Subject: Multiple IMAP Mailboxes and one collection folder In-Reply-To: References: Message-ID: Hello Christian, thanks for the info. This works fine except the Per-user seen flag. I have multiple public namespaces, like: # prefix: FOO # location = maildir:/home/vmail/foo.eu/info/MAILDIR:INBOX=/home/vmail/foo.eu/info/MAILDIR/.INBOX:INDEX=/home/vmail/foo.eu/info/S_INDEX:INDEXPVT=/home/vmail/foo.eu/info/S_INDEXPVT/%u Now i added a virtual folder with this config in the dovecot-virtual: # FOO/* # unseen But all messages are unread, because the INDEXPVT is private. Thanks 2016-03-30 19:33 GMT+02:00 Christian Kivalo : > On 2016-03-30 18:09, Dieter Knopf wrote: >> >> Hello, >> >> we use many IMAP folders and now we are searching for a way to display >> all mails inside this folders in one collecting folder. >> >> The advantage for us would be the possibility to view all new incoming >> mails in one folder. It would be possible to use the standard MAIL App >> on the iOS without problems. >> >> I could simply make a copy of all mails in one folder with Sieve, but >> then the Per-user Seen Flag would be useless, because the mail inside >> the folder is still unread. > > > Maybe something for the virtual plugin > http://wiki2.dovecot.org/Plugins/Virtual > > >> Is there a way to show some way of collecting folder for every user? >> >> Thanks >> >> Dieter > > > -- > Christian Kivalo From dovecot at paulkoppen.com Wed Mar 30 23:15:26 2016 From: dovecot at paulkoppen.com (dovecot at paulkoppen.com) Date: Thu, 31 Mar 2016 01:15:26 +0200 Subject: help with sieve Message-ID: <05e460dc32514b8690ff0ce5ea01abfc@paulkoppen.com> Dear Dovecot / Pigeonhole community, I have a very specific issue, but trying to solve this for a full day, I am now getting so bold from pulling my hairs out, I thought it was time I asked for help. I hope this is a good place for that. At my hosting provider, who have been extremely helpful by the way but are not specifically skilled in Sieve, I have a catch-all address set up: *@domain.org (where * is literal), with a sieve script to control how messages are forwarded. Currently my rules are of the form: if address :localpart :is ["To","Cc","Bcc"] ["name1", "name2", ...] { ... } This works most of the time, but sometimes the messages are not directly addressed to me and so they slip through the filters. I figured that using envelope would solve this, so I require envelope and then do: if envelope :localpart :is "To" ["name1", "name2", ...] { ... } But this fails. After endlessly trying different combinations I figured out that the reason for failure is that the envelope believes the "To" is actually "*@domain.org", so it is never going to match any of the names. However, the following test succeeds: if header :contains "Envelope-To" "name1@" { ... } From this I deduce that a previous script has already done the conversion from name1 to *, and at the point where my sieve script is run the envelope picks up the *@domain.org address, leaving the Envelope-To header for what it is. But I am new to this. Is that likely to be the case? Is it a common sieve set-up? And most importantly, is there a better way around the issue than testing header :contains? With kind regards, Paul From useexperience at gmail.com Thu Mar 31 07:58:50 2016 From: useexperience at gmail.com (use experience) Date: Thu, 31 Mar 2016 13:28:50 +0530 Subject: Dovecot mail-filter execution error. Message-ID: Hello, While using mail-filter plugin, I am getting following error. Please help me. Mar 31 07:48:31 ip-172-31-29-173 dovecot: lda: Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Connection refused Mar 31 07:48:31 ip-172-31-29-173 dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. From noel.butler at ausics.net Thu Mar 31 10:38:20 2016 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 31 Mar 2016 20:38:20 +1000 Subject: Pigeonhole 0.4.13 does not compile against dovecot 2.2.23 In-Reply-To: <56FC78CC.4030501@rename-it.nl> References: <56FBF1F9.5080507@fi.upm.es> <56FBF97B.1040601@rename-it.nl> <0678d261286c4f1ae1888f894bcca595@ausics.net> <56FC78CC.4030501@rename-it.nl> Message-ID: <128a18d9f80cf37760143595e1629709@ausics.net> On 31/03/2016 11:09, Stephan Bosch wrote: > > Pigeonhole needs to be recompiled. > > Regards, > > Stephan. hrmm it was, but process was ampersands so maybe somthing prior failed and it did not complete make install, its late so ill look at it again tomorrow. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From jerry at seibercom.net Thu Mar 31 11:03:59 2016 From: jerry at seibercom.net (Jerry) Date: Thu, 31 Mar 2016 07:03:59 -0400 Subject: Dovecot mail-filter execution error. In-Reply-To: References: Message-ID: <20160331070359.00003ad0@seibercom.net> On Thu, 31 Mar 2016 13:28:50 +0530, use experience stated: >Hello, > > >While using mail-filter plugin, I am getting following error. Please >help me. > > >Mar 31 07:48:31 ip-172-31-29-173 dovecot: lda: Error: userdb lookup: >connect(/var/run/dovecot/auth-userdb) failed: Connection refused > >Mar 31 07:48:31 ip-172-31-29-173 dovecot: lda: Fatal: Internal error >occurred. Refer to server log for more information. Including the output of "dovecot -n" would aid us in diagnosing your problem. -- Jerry From hf at spg.tu-darmstadt.de Thu Mar 31 13:18:06 2016 From: hf at spg.tu-darmstadt.de (Hauke Fath) Date: Thu, 31 Mar 2016 15:18:06 +0200 Subject: v2.2.23 released In-Reply-To: References: Message-ID: <56FD238E.8010805@spg.tu-darmstadt.de> On 03/30/16 14:48, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig > > This is a bugfix-only release with various important fixes on top of v2.2.22. ... the build breaks on NetBSD with [...] libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-test -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT quota-fs.lo -MD -MP -MF .deps/quota-fs.Tpo -c quota-fs.c -fPIC -DPIC -o .libs/quota-fs.o libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-test -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT rquota_xdr.lo -MD -MP -MF .deps/rquota_xdr.Tpo -c rquota_xdr.c -fPIC -DPIC -o .libs/rquota_xdr.o libtool: link: ar cru .libs/lib10_doveadm_quota_plugin.a doveadm-quota.o libtool: link: ranlib .libs/lib10_doveadm_quota_plugin.a libtool: link: ( cd ".libs" && rm -f "lib10_doveadm_quota_plugin.la" && ln -s "../lib10_doveadm_quota_plugin.la" "lib10_doveadm_quota_plugin.la" ) quota-fs.c: In function 'fs_quota_get_netbsd': quota-fs.c:695:7: error: 'i' undeclared (first use in this function) quota-fs.c:695:7: note: each undeclared identifier is reported only once for each function it appears in Makefile:726: recipe for target 'quota-fs.lo' failed gmake[4]: *** [quota-fs.lo] Error 1 gmake[4]: *** Waiting for unfinished jobs.... libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-test -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT rquota_xdr.lo -MD -MP -MF .deps/rquota_xdr.Tpo -c rquota_xdr.c -o rquota_xdr.o >/dev/null 2>&1 mv -f .deps/quota-storage.Tpo .deps/quota-storage.Plo mv -f .deps/rquota_xdr.Tpo .deps/rquota_xdr.Plo gmake[4]: Leaving directory '/var/obj/pkgsrc/mail/dovecot2/work/dovecot-2.2.23/src/plugins/quota' Makefile:456: recipe for target 'all-recursive' failed gmake[3]: *** [all-recursive] Error 1 Cheerio, hauke -- The ASCII Ribbon Campaign Hauke Fath () No HTML/RTF in email Institut f?r Nachrichtentechnik /\ No Word docs in email TU Darmstadt Respect for open standards Ruf +49-6151-16-3281 From leon at f-m.fm Thu Mar 31 13:44:51 2016 From: leon at f-m.fm (Leon Kyneur) Date: Fri, 1 Apr 2016 00:44:51 +1100 Subject: v2.2.23 released In-Reply-To: References: Message-ID: <56FD29D3.1010207@f-m.fm> 2.2.23 seems to have broken doveadm backup, was previously working fine on 2.2.22 [root at S613 lkyneur]# doveadm -v backup -u em.mck ... doveadm(root): Error: User doesn't exist [root at S613 lkyneur]# doveadm user em.mck field value uid vmail gid vmail home /srv/vmail/eftel/xxx.com/20032218/em.mck mail mdbox:/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox:ALT=/altstorage/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox quota_rule *:bytes=500M On 30/03/16 23:48, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig > > This is a bugfix-only release with various important fixes on top of v2.2.22. > > - Various fixes to doveadm. Especially running commands via > doveadm-server was broken. > - director: Fixed user weakness getting stuck in some situations > - director: Fixed a situation where directors keep re-sending > different states to each others and never becoming synced. > - director: Fixed assert-crash related to a slow "user killed" reply > - Fixed assert-crash related to istream-concat, which could have > been triggered at least by a Sieve script. From useexperience at gmail.com Thu Mar 31 14:26:04 2016 From: useexperience at gmail.com (use experience) Date: Thu, 31 Mar 2016 19:56:04 +0530 Subject: mail filter plugin script doesn't effective Message-ID: output of *dovecot --version*: Dovecot version : 2.2.9 ----- output of *doveconf -n:* auth_debug = yes > > auth_mechanisms = plain login > > auth_verbose = yes > > disable_plaintext_auth = no > > mail_debug = yes > > mail_location = > maildir:/var/mail/vhosts/%d/%n:LAYOUT=fs:DIRNAME=dovecot_maildir > > mail_plugins = " mail_log notify mail_filter" > > mail_privileged_group = mail > > namespace inbox { > > inbox = yes > > location = > > mailbox Drafts { > > auto = subscribe > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > auto = subscribe > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > auto = no > > special_use = \Sent > > } > > mailbox Spam { > > auto = create > > special_use = \Junk > > } > > mailbox Trash { > > auto = no > > special_use = \Trash > > } > > mailbox virtual/All { > > auto = no > > special_use = \All > > } > > prefix = > > } > > passdb { > > args = /etc/dovecot/dovecot-sql.conf.ext > > driver = sql > > } > > plugin { > > autocreate = Trash > > autocreate2 = Spam > > mail_filter = santhosh-filter %u > > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename flag_change save mailbox_create > > mail_log_fields = uid box msgid size flags vsize from subject > > } > > protocols = " imap lmtp pop3" > > service auth-worker { > > user = vmail > > } > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0777 > > user = postfix > > } > > unix_listener auth-userdb { > > mode = 0777 > > } > > user = dovecot > > } > > service imap-login { > > executable = imap-login -R rawlogs > > } > > service imap-postlogin { > > executable = script-login /usr/local/bin/postlogin.sh > /etc/dovecot/script/echo.sh > > user = vmail > > } > > service imap { > > executable = imap imap-postlogin > > } > > service lmtp { > > unix_listener /var/spool/postfix/private/dovecot-lmtp { > > group = postfix > > mode = 0600 > > user = postfix > > } > > } > > service santhosh-filter-out { > > executable = script /usr/local/bin/mail-filter-out.sh > > unix_listener santhosh-filter-out { > > mode = 0777 > > user = vmail > > } > > user = dovecot > > } > > service santhosh-filter { > > executable = script /usr/local/bin/mail-filter.sh > > unix_listener santhosh-filter { > > mode = 0777 > > user = vmail > > } > > } > > ssl_cert = > ssl_key = > userdb { > > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > > driver = static > > } > > protocol imap { > > mail_plugins = " autocreate" > > } > > From useexperience at gmail.com Thu Mar 31 14:30:08 2016 From: useexperience at gmail.com (use experience) Date: Thu, 31 Mar 2016 20:00:08 +0530 Subject: mail filter plugin script doesn't effective In-Reply-To: References: Message-ID: Hello Team, I am using script to create a database (Testing, so that I can use it for further my feature) service santhosh-filter { executable = script /usr/local/bin/mail-filter.sh unix_listener santhosh-filter { mode = 0777 user = vmail } } mail-filter.sh contains mysql -uroot -proot -e "create database temp5;" > exec "$@" Please help me. On Thu, Mar 31, 2016 at 7:56 PM, use experience wrote: > output of *dovecot --version*: > Dovecot version : 2.2.9 > ----- > output of *doveconf -n:* > > auth_debug = yes >> >> auth_mechanisms = plain login >> >> auth_verbose = yes >> >> disable_plaintext_auth = no >> >> mail_debug = yes >> >> mail_location = >> maildir:/var/mail/vhosts/%d/%n:LAYOUT=fs:DIRNAME=dovecot_maildir >> >> mail_plugins = " mail_log notify mail_filter" >> >> mail_privileged_group = mail >> >> namespace inbox { >> >> inbox = yes >> >> location = >> >> mailbox Drafts { >> >> auto = subscribe >> >> special_use = \Drafts >> >> } >> >> mailbox Junk { >> >> special_use = \Junk >> >> } >> >> mailbox Sent { >> >> auto = subscribe >> >> special_use = \Sent >> >> } >> >> mailbox "Sent Messages" { >> >> auto = no >> >> special_use = \Sent >> >> } >> >> mailbox Spam { >> >> auto = create >> >> special_use = \Junk >> >> } >> >> mailbox Trash { >> >> auto = no >> >> special_use = \Trash >> >> } >> >> mailbox virtual/All { >> >> auto = no >> >> special_use = \All >> >> } >> >> prefix = >> >> } >> >> passdb { >> >> args = /etc/dovecot/dovecot-sql.conf.ext >> >> driver = sql >> >> } >> >> plugin { >> >> autocreate = Trash >> >> autocreate2 = Spam >> >> mail_filter = santhosh-filter %u >> >> mail_log_events = delete undelete expunge copy mailbox_delete >> mailbox_rename flag_change save mailbox_create >> >> mail_log_fields = uid box msgid size flags vsize from subject >> >> } >> >> protocols = " imap lmtp pop3" >> >> service auth-worker { >> >> user = vmail >> >> } >> >> service auth { >> >> unix_listener /var/spool/postfix/private/auth { >> >> group = postfix >> >> mode = 0777 >> >> user = postfix >> >> } >> >> unix_listener auth-userdb { >> >> mode = 0777 >> >> } >> >> user = dovecot >> >> } >> >> service imap-login { >> >> executable = imap-login -R rawlogs >> >> } >> >> service imap-postlogin { >> >> executable = script-login /usr/local/bin/postlogin.sh >> /etc/dovecot/script/echo.sh >> >> user = vmail >> >> } >> >> service imap { >> >> executable = imap imap-postlogin >> >> } >> >> service lmtp { >> >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> >> group = postfix >> >> mode = 0600 >> >> user = postfix >> >> } >> >> } >> >> service santhosh-filter-out { >> >> executable = script /usr/local/bin/mail-filter-out.sh >> >> unix_listener santhosh-filter-out { >> >> mode = 0777 >> >> user = vmail >> >> } >> >> user = dovecot >> >> } >> >> service santhosh-filter { >> >> executable = script /usr/local/bin/mail-filter.sh >> >> unix_listener santhosh-filter { >> >> mode = 0777 >> >> user = vmail >> >> } >> >> } >> >> ssl_cert = > >> ssl_key = > >> userdb { >> >> args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n >> >> driver = static >> >> } >> >> protocol imap { >> >> mail_plugins = " autocreate" >> >> } >> >> > > From jerry at seibercom.net Thu Mar 31 14:49:38 2016 From: jerry at seibercom.net (Jerry) Date: Thu, 31 Mar 2016 10:49:38 -0400 Subject: mail filter plugin script doesn't effective In-Reply-To: References: Message-ID: <20160331104938.00004a72@seibercom.net> On Thu, 31 Mar 2016 19:56:04 +0530, use experience stated: >> unix_listener auth-userdb { >> >> mode = 0777 >> >> } Try adding: user = vmail group = vmail Why are you using mode = 0777? I never use more than 0666. Usually just 0660 and all works well. Try to include the "group" in your definitions. Restart dovecot and see what happens. From useexperience at gmail.com Thu Mar 31 14:52:43 2016 From: useexperience at gmail.com (use experience) Date: Thu, 31 Mar 2016 20:22:43 +0530 Subject: Dovecot mail-filter execution error. In-Reply-To: References: Message-ID: Thanks for approving mail. BTW in log, I got wrong error. This issue is corrected by removing duplicate unix listener. But my problem with the script I included in plugin is not effective. I raised the same in http://dovecot.org/pipermail/dovecot/2016-March/103787.html. Can you please help to resolve this. On Thu, Mar 31, 2016 at 1:28 PM, use experience wrote: > Hello, > > > While using mail-filter plugin, I am getting following error. Please help > me. > > > Mar 31 07:48:31 ip-172-31-29-173 dovecot: lda: Error: userdb lookup: > connect(/var/run/dovecot/auth-userdb) failed: Connection refused > > Mar 31 07:48:31 ip-172-31-29-173 dovecot: lda: Fatal: Internal error > occurred. Refer to server log for more information. > From useexperience at gmail.com Thu Mar 31 15:02:57 2016 From: useexperience at gmail.com (use experience) Date: Thu, 31 Mar 2016 20:32:57 +0530 Subject: mail filter plugin script doesn't effective In-Reply-To: References: Message-ID: Thanks Jerry, BTW, I have tried modifying as follows, but still I script doesn't effective. Also I gave full permission for script execution. unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } service santhosh-filter-out { executable = script /usr/local/bin/mail-filter-out.sh unix_listener santhosh-filter-out { group = vmail mode = 0666 user = vmail } user = dovecot } service santhosh-filter { executable = script /usr/local/bin/mail-filter.sh unix_listener santhosh-filter { group = vmail mode = 0666 user = vmail } } On Thu, Mar 31, 2016 at 8:00 PM, use experience wrote: > Hello Team, > > I am using script to create a database (Testing, so that I can use it for > further my feature) > > service santhosh-filter { > > executable = script /usr/local/bin/mail-filter.sh > > unix_listener santhosh-filter { > > mode = 0777 > > user = vmail > > } > > } > > > mail-filter.sh contains > > > mysql -uroot -proot -e "create database temp5;" >> exec "$@" > > > Please help me. > > On Thu, Mar 31, 2016 at 7:56 PM, use experience > wrote: > >> output of *dovecot --version*: >> Dovecot version : 2.2.9 >> ----- >> output of *doveconf -n:* >> >> auth_debug = yes >>> >>> auth_mechanisms = plain login >>> >>> auth_verbose = yes >>> >>> disable_plaintext_auth = no >>> >>> mail_debug = yes >>> >>> mail_location = >>> maildir:/var/mail/vhosts/%d/%n:LAYOUT=fs:DIRNAME=dovecot_maildir >>> >>> mail_plugins = " mail_log notify mail_filter" >>> >>> mail_privileged_group = mail >>> >>> namespace inbox { >>> >>> inbox = yes >>> >>> location = >>> >>> mailbox Drafts { >>> >>> auto = subscribe >>> >>> special_use = \Drafts >>> >>> } >>> >>> mailbox Junk { >>> >>> special_use = \Junk >>> >>> } >>> >>> mailbox Sent { >>> >>> auto = subscribe >>> >>> special_use = \Sent >>> >>> } >>> >>> mailbox "Sent Messages" { >>> >>> auto = no >>> >>> special_use = \Sent >>> >>> } >>> >>> mailbox Spam { >>> >>> auto = create >>> >>> special_use = \Junk >>> >>> } >>> >>> mailbox Trash { >>> >>> auto = no >>> >>> special_use = \Trash >>> >>> } >>> >>> mailbox virtual/All { >>> >>> auto = no >>> >>> special_use = \All >>> >>> } >>> >>> prefix = >>> >>> } >>> >>> passdb { >>> >>> args = /etc/dovecot/dovecot-sql.conf.ext >>> >>> driver = sql >>> >>> } >>> >>> plugin { >>> >>> autocreate = Trash >>> >>> autocreate2 = Spam >>> >>> mail_filter = santhosh-filter %u >>> >>> mail_log_events = delete undelete expunge copy mailbox_delete >>> mailbox_rename flag_change save mailbox_create >>> >>> mail_log_fields = uid box msgid size flags vsize from subject >>> >>> } >>> >>> protocols = " imap lmtp pop3" >>> >>> service auth-worker { >>> >>> user = vmail >>> >>> } >>> >>> service auth { >>> >>> unix_listener /var/spool/postfix/private/auth { >>> >>> group = postfix >>> >>> mode = 0777 >>> >>> user = postfix >>> >>> } >>> >>> unix_listener auth-userdb { >>> >>> mode = 0777 >>> >>> } >>> >>> user = dovecot >>> >>> } >>> >>> service imap-login { >>> >>> executable = imap-login -R rawlogs >>> >>> } >>> >>> service imap-postlogin { >>> >>> executable = script-login /usr/local/bin/postlogin.sh >>> /etc/dovecot/script/echo.sh >>> >>> user = vmail >>> >>> } >>> >>> service imap { >>> >>> executable = imap imap-postlogin >>> >>> } >>> >>> service lmtp { >>> >>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>> >>> group = postfix >>> >>> mode = 0600 >>> >>> user = postfix >>> >>> } >>> >>> } >>> >>> service santhosh-filter-out { >>> >>> executable = script /usr/local/bin/mail-filter-out.sh >>> >>> unix_listener santhosh-filter-out { >>> >>> mode = 0777 >>> >>> user = vmail >>> >>> } >>> >>> user = dovecot >>> >>> } >>> >>> service santhosh-filter { >>> >>> executable = script /usr/local/bin/mail-filter.sh >>> >>> unix_listener santhosh-filter { >>> >>> mode = 0777 >>> >>> user = vmail >>> >>> } >>> >>> } >>> >>> ssl_cert = >> >>> ssl_key = >> >>> userdb { >>> >>> args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n >>> >>> driver = static >>> >>> } >>> >>> protocol imap { >>> >>> mail_plugins = " autocreate" >>> >>> } >>> >>> >> >> > > From ebroch at whitehorsetc.com Thu Mar 31 15:05:29 2016 From: ebroch at whitehorsetc.com (Eric) Date: Thu, 31 Mar 2016 09:05:29 -0600 Subject: v2.2.23 released In-Reply-To: <56FD29D3.1010207@f-m.fm> References: <56FD29D3.1010207@f-m.fm> Message-ID: <56FD3CB9.8000409@whitehorsetc.com> Yes. I concur. On 3/31/2016 7:44 AM, Leon Kyneur wrote: > 2.2.23 seems to have broken doveadm backup, was previously working > fine on 2.2.22 > > [root at S613 lkyneur]# doveadm -v backup -u em.mck ... > doveadm(root): Error: User doesn't exist > > > [root at S613 lkyneur]# doveadm user em.mck > field value > uid vmail > gid vmail > home /srv/vmail/eftel/xxx.com/20032218/em.mck > mail > mdbox:/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox:ALT=/altstorage/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox > quota_rule *:bytes=500M > > > On 30/03/16 23:48, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >> >> This is a bugfix-only release with various important fixes on top of >> v2.2.22. >> >> - Various fixes to doveadm. Especially running commands via >> doveadm-server was broken. >> - director: Fixed user weakness getting stuck in some situations >> - director: Fixed a situation where directors keep re-sending >> different states to each others and never becoming synced. >> - director: Fixed assert-crash related to a slow "user killed" reply >> - Fixed assert-crash related to istream-concat, which could have >> been triggered at least by a Sieve script. From aki.tuomi at dovecot.fi Thu Mar 31 15:13:13 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 31 Mar 2016 18:13:13 +0300 Subject: VS: Re: v2.2.23 released Message-ID: It's fixed in head. Sorry. ---Aki TuomiDovecot oy -------- Alkuper?inen viesti --------L?hett?j?: Eric P?iv?m??r?: 31.3.2016 18.05 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: v2.2.23 released Yes. I concur. On 3/31/2016 7:44 AM, Leon Kyneur wrote: > 2.2.23 seems to have broken doveadm backup, was previously working > fine on 2.2.22 > > [root at S613 lkyneur]# doveadm -v backup -u em.mck ... > doveadm(root): Error: User doesn't exist > > > [root at S613 lkyneur]# doveadm user em.mck > field?? value > uid???? vmail > gid???? vmail > home??? /srv/vmail/eftel/xxx.com/20032218/em.mck > mail > mdbox:/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox:ALT=/altstorage/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox > quota_rule????? *:bytes=500M > > > On 30/03/16 23:48, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >> >> This is a bugfix-only release with various important fixes on top of >> v2.2.22. >> >>?? - Various fixes to doveadm. Especially running commands via >>???? doveadm-server was broken. >>?? - director: Fixed user weakness getting stuck in some situations >>?? - director: Fixed a situation where directors keep re-sending >>???? different states to each others and never becoming synced. >>?? - director: Fixed assert-crash related to a slow "user killed" reply >>?? - Fixed assert-crash related to istream-concat, which could have >>???? been triggered at least by a Sieve script. From useexperience at gmail.com Thu Mar 31 15:23:55 2016 From: useexperience at gmail.com (use experience) Date: Thu, 31 Mar 2016 20:53:55 +0530 Subject: Reply to : http://dovecot.org/pipermail/dovecot/2016-March/103789.html Message-ID: I dint get reply as mail to my mailed, so pasting here the link http://dovecot.org/pipermail/dovecot/2016-March/103791.html From ebroch at whitehorsetc.com Thu Mar 31 15:47:54 2016 From: ebroch at whitehorsetc.com (Eric) Date: Thu, 31 Mar 2016 09:47:54 -0600 Subject: VS: Re: v2.2.23 released In-Reply-To: References: Message-ID: <56FD46AA.1060808@whitehorsetc.com> I'm not sure what "It's fixed in head" means??? On 3/31/2016 9:13 AM, Aki Tuomi wrote: > It's fixed in head. Sorry. > ---Aki TuomiDovecot oy > -------- Alkuper?inen viesti --------L?hett?j?: Eric P?iv?m??r?: 31.3.2016 18.05 (GMT+02:00) Saaja: dovecot at dovecot.org Aihe: Re: v2.2.23 released > Yes. I concur. > > On 3/31/2016 7:44 AM, Leon Kyneur wrote: >> 2.2.23 seems to have broken doveadm backup, was previously working >> fine on 2.2.22 >> >> [root at S613 lkyneur]# doveadm -v backup -u em.mck ... >> doveadm(root): Error: User doesn't exist >> >> >> [root at S613 lkyneur]# doveadm user em.mck >> field value >> uid vmail >> gid vmail >> home /srv/vmail/eftel/xxx.com/20032218/em.mck >> mail >> mdbox:/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox:ALT=/altstorage/srv/vmail/eftel/xxx.com/20032218/em.mck/mdbox >> quota_rule *:bytes=500M >> >> >> On 30/03/16 23:48, Timo Sirainen wrote: >>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >>> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >>> >>> This is a bugfix-only release with various important fixes on top of >>> v2.2.22. >>> >>> - Various fixes to doveadm. Especially running commands via >>> doveadm-server was broken. >>> - director: Fixed user weakness getting stuck in some situations >>> - director: Fixed a situation where directors keep re-sending >>> different states to each others and never becoming synced. >>> - director: Fixed assert-crash related to a slow "user killed" reply >>> - Fixed assert-crash related to istream-concat, which could have >>> been triggered at least by a Sieve script. From michael.seevogel at ddnetservice.de Thu Mar 31 15:52:21 2016 From: michael.seevogel at ddnetservice.de (Michael Seevogel) Date: Thu, 31 Mar 2016 17:52:21 +0200 Subject: VS: Re: v2.2.23 released In-Reply-To: <56FD46AA.1060808@whitehorsetc.com> References: <56FD46AA.1060808@whitehorsetc.com> Message-ID: <56FD47B5.4030209@ddnetservice.de> Am 31.03.2016 um 17:47 schrieb Eric: > I'm not sure what "It's fixed in head" means??? > > On 3/31/2016 9:13 AM, Aki Tuomi wrote: >> It's fixed in head. Sorry. >> ---Aki TuomiDovecot oy It does mean that it is fixed in git master branch: https://github.com/dovecot/core/commit/9ba5c4965ca244efeeb525229f1293ef52a4bf3a Patch: https://github.com/dovecot/core/commit/9ba5c4965ca244efeeb525229f1293ef52a4bf3a.patch Best regards Michael Seevogel From jerry at seibercom.net Thu Mar 31 20:10:07 2016 From: jerry at seibercom.net (Jerry) Date: Thu, 31 Mar 2016 16:10:07 -0400 Subject: mail filter plugin script doesn't effective In-Reply-To: References: Message-ID: <20160331161007.0000233e@seibercom.net> On Thu, 31 Mar 2016 20:32:57 +0530, use experience stated: >BTW, I have tried modifying as follows, but still I script doesn't >effective. Please stop top-posting. It is really annoying. Also, why are your posts all double spaced? Anyway, I found two URLs that might be of interest to you. http://wiki.dovecot.org/PostLoginScripting http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms Good luck -- Jerry From joerg at backschues.de Thu Mar 31 20:15:28 2016 From: joerg at backschues.de (=?UTF-8?Q?J=c3=b6rg_Backschues?=) Date: Thu, 31 Mar 2016 22:15:28 +0200 Subject: multiple recipient_delimiter Message-ID: <56FD8560.1020003@backschues.de> Hello, does the recipient_delimiter option accepts multiple delimiter by now? -- Regards J?rg Backschues From nerijus at users.sourceforge.net Thu Mar 31 23:12:17 2016 From: nerijus at users.sourceforge.net (Nerijus Baliunas) Date: Fri, 1 Apr 2016 02:12:17 +0300 Subject: default namespace Message-ID: Hello, With no namespace settings and dovecot 2.0.9 I get the following listing: a LIST "" "*" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "INBOX" a OK List completed. Then I add the namespaces: namespace inbox { separator = . prefix = inbox = yes hidden = no list = yes subscriptions = yes } namespace compat { separator = . prefix = INBOX. inbox = no hidden = yes list = no alias_for = } Then list output changes: a LIST "" "*" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasChildren) "." "INBOX" a OK List completed. INBOX now has \HasChildren, while before it had \HasNoChildren. How can I make it \HasNoChildren? Regards, Nerijus