April 2015 - dovecot - dovecot.org

pop3 retr responses too large lines - Fails with current python's poplib
by Guillermo M. Narvaja 10 Apr '15

10 Apr '15

Since December 2014, clients using the Python poplib library (getmail in my case) started to limit the line length of RETR and other command responses sent from the server to 2048 bytes: See https://bugs.python.org/issue16041 (Included at least in Python-2.7.9) Dovecot doesn't have line split in the POP3 module, so Python fails to retrieve messages with long lines. RFC 1939 says: " Responses in the POP3 consist of a status indicator and a keyword possibly followed by additional information. All responses are terminated by a CRLF pair. Responses may be up to 512 characters long, including the terminating CRLF. " I think dovecot-pop3 should split it's output in lines of at least 512 characters. Or at least it should have a "pop3_max_line_length" setting (like "imap_max_line_length"). Server side: # dovecot --version 2.2.13 Client side: # python --version Python 2.7.9 # getmail --version getmail 4.47.0 Temporary workaround (on client-side): --- poplib.py.orig 2015-04-08 18:46:48.280879211 -0300 +++ poplib.py 2015-04-08 18:26:01.288556028 -0300 @@ -36,7 +36,7 @@ # reading arbitrary length lines. RFC 1939 limits POP3 line length to # 512 characters, including CRLF. We have selected 2048 just to be on # the safe side. -_MAXLINE = 2048 +_MAXLINE = 2048*100 class POP3: Thanks in advance. -- Guillermo M. Narvaja Lambda Sistemas S.R.L. www.fierro-soft.com.ar - radiocut.fm Tel: (5411) 3220-1520 (rotativas) y 4857-6662 Cel: (5411) 15-6783-4435 Email: guillermo.narvaja(a)fierro-soft.com.ar MSN: guillermo_narvaja(a)hotmail.com Skype: guillermonarvaja Lavalleja 519 1er Piso - Ciudad de Buenos Aires - Argentina

2 4

FYI: Some 'fun' unlinks with random memory space references
by Jeroen Massar 10 Apr '15

10 Apr '15

Hola, Dovecot: 2.2.16 (6bde7868cffd) That is the rename-it 2:2.2.16-1~auto+43 edition. In the beginning of syncing it caused scary things like: Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10672) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(ox/mailboxes/INBOX/dbox-Mails/u.10927) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10839) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10656) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(11147) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10637) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(OX/dbox-Mails/u.10807) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(<80><A5><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(<B0><A6><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(<E0><A7><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(#020<A9><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(@<AA><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(p<AB><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(<A0><AC><C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink(Э<C8>) failed: No such file or directory Apr 9 16:24:08 mail dovecot: dsync-server(username): Error: unlink() failed: No such file or directory Might want to put a check before that unlink that nothing dirty is in the buffer... I would not be surprised if this was related to a broken index, as the other side effect I saw during this sync was an ever-expanding maildir (read: sdbox), multiplying itself during sync, keeping large amounts of the the .temp.<xxxx> in the dir, never moving them to a final directory. That was resolved by stopping dovecot, then deleting the broken sdbox (backups++) and performing a 'dovecot force-resync -u user Folder' on the source. Maybe there was a race somewhere while syncing the large amount of data over; seems that everything is okay now though. Greets, Jeroen

1 0

sa-learn with remote Dovecot folders
by Andreas Kasenides 10 Apr '15

10 Apr '15

Hi all! The set-up I have is a classic one: 1. one or more Dovecot relay/directors Postfix SMTP servers in DMZ 2. one or more backend IMAP/SMTP servers on the inside network 3. There may or may not be separate incoming or outgoing designated SMTP servers. Now the desired functionality is (of course): 1. relay machines receive messages from outside AND inside 2. relays check for all the bad things (spam, viruses etc). 3. for incoming messages relays check for valid local users and reject messages for invalid users 4. after all checks are done incoming messages are transferred to the backend systems where they are accessed via the Dovecot directors While all the above works nicely, the problem I have is how to train my spamassassin (used by amavisd) on the front ends when all messages are on the back ends. Of course transferring the spam detection procedures internally is not such a great option.Am I missing something? I tried googling for info but nothing substantial turned up. Thanks. -- Andreas Kasenides Senior IT Officer Dept. of Computer Science, University of Cyprus Tel: 22892714, Fax: 22892701 (5B4ANK)

2 4

gmail-migration: archived mails in \ALL
by Peer Heinlein 10 Apr '15

10 Apr '15

Hi, I don't completly understand http://wiki2.dovecot.org/Migration/Gmail I can't find the documentation for the -a and the -F Flag. I'd like to migrate ONLY archived mails from an existing gmail-Account. So I'd have to import all Mails from the \ALL-Folder that does NOT have any virtual folder flags set. I tried to use this command: doveadm -D -o imapc_user=user(a)example.com -o pop3c_user=user(a)exampe.com -o imapc_password=secret -o pop3c_password=secret -o imapc_host=imap.googlemail.com -v backup -m '[Gmail]/Tutti i messaggi' -F '-$GmailHaveLabels' -x \Flagged -x \Junk -x \Trash -x \Important -R -u user(a)example.com imapc: But it looks like it's importing too many mails and not only the archived mails without Flags. How do I have do understand -F '-$GmailHaveLabels ?? Is it "that NOT have $GmailHaveLabels"? And: Is there any better way to address the \ALL-Folder? I can use "-x \All" to exclude that folder, but it looks like I can't use "-m \All" to select that folder. We're a little bit in hurry since Google will stop its service this weekend. Any fast help would be appreciated. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

dovecot debug LDAP expansion
by Thomas Baumann 09 Apr '15

09 Apr '15

Hello all, how can LDAP Expansion being debugged? I need to see which LDAP Query is sent to the LDAP server and which Result is sent by the Server. Best regards, Thomas.

2 1

Sieve, multiple addresses, and variables
by Andrew Sullivan 08 Apr '15

08 Apr '15

Hi, I have another sieve question, this time about setting variables. I join a lot of mailing lists at ietf.org. I thought it'd be handy to filter these all into a common folder and then into individual folders, without having to configure each mailing list independently. So wrote this (this is just a part, obviously): require ["envelope", "variables", "date", "fileinto", "mailbox" ]; if address :is :domain "to" "ietf.org" { if address :matches :localpart "to" "*" {set "lopart" "${1}";} } elsif address :is :domain "cc" "ietf.org" { if address :matches :localpart "cc" "*" {set "lopart" "${1}";} } else {set "lopart" "generic-list-box";} fileinto :create "ietf.${lopart}-in"; stop; } Now, this works, unless someone sends a To: line like this: To: ajs(a)crankycanuck.ca, listname(a)ietf.org The problem in that case is that you _do_ get a match, but the bit "if address :matches :localpart "to" "*" {set "lopart" "${1}";}" ends up putting this in a mailbox ietf.ajs-in, when what is the mailbox ietf.listname-in. I thought that allof(if address :matches :localpart "to" "*", address :matches :localpart "to" "*") {set "lopart" "${1}";}, would solve this, but it doesn't seem to. The localpart matching catches the ajs(a)crankycanuck.ca address anyway, which surprised me. Am I dim, am I not understanding something about how to do this, or is this really impossible? Thanks, A -- Andrew Sullivan ajs(a)crankycanuck.ca

2 2

Need a bit of help with the antispam plugin
by Anthony Papillion 08 Apr '15

08 Apr '15

Hello Everyone, I'm running the antispam plugin on Dovecot 2.0.19 on Ubuntu Server 14.04 and I can't seem to get it to work. In the IMAP section of dovecot.conf I have the following lines: protocol imap { mail_plugins = $mail_plugins imap_quota imap_acl antispam # mail_plugins = $mail_plugins imap_quota imap_acl imap_client_workarounds = tb-extra-mailbox-sep # Maximum number of IMAP connections allowed for a user from each IP address. # NOTE: The username is compared case-sensitively. # Default is 10. # Increase it to avoid issue like below: # "Maximum number of concurrent IMAP connections exceeded" mail_max_userip_connections = 20 plugin { antispam_debug_target = syslog antispam_verbose_debug = 1 antispam_backend = pipe antispam_trash = Trash antispam_spam = Junk antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_program = /usr/bin/sa-learn antispam_pipe_program_args = --username=%Lu } } For some reason, when I try to move something to Junk, I get the following in my syslog: Mar 31 18:27:16 anonymail imap: antispam: plugin initialising (2.0-notgit) Mar 31 18:27:16 anonymail imap: antispam: verbose debug enabled Mar 31 18:27:16 anonymail imap: antispam: "Junk" is exact match spam folder Mar 31 18:27:16 anonymail imap: antispam: no unsure folders Mar 31 18:27:16 anonymail imap: antispam: "Trash" is exact match trash folder Mar 31 18:27:16 anonymail imap: antispam: pipe backend spam argument = --spam Mar 31 18:27:16 anonymail imap: antispam: pipe backend not-spam argument = --ham Mar 31 18:27:16 anonymail imap: antispam: pipe backend program = /usr/bin/sa-learn Mar 31 18:27:16 anonymail imap: antispam: pipe backend program arg[0] = --username=anthony(a)cajuntechie.org Mar 31 18:27:16 anonymail imap: antispam: pipe backend tmpdir /tmp Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(Junk): 0 Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(INBOX): 0 Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_trash(Junk): 0 Mar 31 18:27:19 anonymail imap: antispam: mail copy: from trash: 0, to trash: 0 Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(INBOX): 0 Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_spam(Junk): 1 Mar 31 18:27:19 anonymail imap: antispam: mailbox_is_unsure(INBOX): 0 Mar 31 18:27:19 anonymail imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend program /usr/bin/sa-learn Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend program /usr/bin/sa-learn Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend program parameter 1 --username=anthony(a)cajuntechie.org Mar 31 18:27:19 anonymail imap: antispam: running mailtrain backend program parameter 2 --spam Mar 31 18:27:21 anonymail imap: antispam: run program failed with exit code -1 This is probably a permissions issue but I'm not able to debug it. Can anyone offer me any clues as to what I might be doing wrong or how I might fix it? Thanks, Anthony -- Anthony Papillion Phone: 1.918.631.7331 VoIP (SIP): 1259010(a)localphone.com XMPP Chat: cypher(a)chat.cpunk.us Fingerprint: 65EF73EC 8B57F6B1 8C475BD4 426088AC FE21B251 PGP Key: http://www.cajuntechie.org/p/my-pgp-key.html

4 16

can't create folders under shared mailbox's INBOX
by luke.bigum＠lmax.com 08 Apr '15

08 Apr '15

Hello, I have a namespace / ACL problem with shared mailboxes that I can't figure out. I have a local user tam(a)crm.yb.lmax that shares it's INBOX and all other folders with on LDAP group. Members of that group can't create a folder under the shared local user's INBOX: [08-Apr-2015 11:43:05 +0000]: [9501] S: * MYRIGHTS tam(a)crm.yb.lmax lrwstipekxcd [08-Apr-2015 11:43:05 +0000]: [9501] S: A0004 OK Myrights completed. [08-Apr-2015 11:43:05 +0000]: [9501] C: A0005 CREATE tam(a)crm.yb.lmax/Templates [08-Apr-2015 11:43:05 +0000]: [9501] S: A0005 NO [NOPERM] Permission denied I *can* create a folder underneath another folder of the same shared user that already exists: [08-Apr-2015 11:43:47 +0000]: [99CE] S: * MYRIGHTS tam(a)crm.yb.lmax/Drafts lrwstipekxcd [08-Apr-2015 11:43:47 +0000]: [99CE] S: A0004 OK Myrights completed. [08-Apr-2015 11:43:47 +0000]: [99CE] C: A0005 CREATE tam(a)crm.yb.lmax/Drafts/Test [08-Apr-2015 11:43:47 +0000]: [99CE] S: A0005 OK Create completed. Creating the subfolder as the local user itself works fine: [08-Apr-2015 11:35:35 +0000]: [4E9C] C: A0005 CREATE INBOX/Templates [08-Apr-2015 11:35:35 +0000]: [4E9C] S: A0005 OK Create completed. However the local user creates INBOX/Templates, whereas the ldap user is creating under tam(a)crm.yb.lmax/Templates. Is this an artifact of how we've set up namespaces below? Thanks, -Luke [root@localhost dovecot]# doveconf -n # 2.2.15: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.6 (3e924b1b6c5c+) # OS: Linux 2.6.32-358.11.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_master_user_separator = * default_login_user = vmail disable_plaintext_auth = no doveadm_password = secret doveadm_port = 12345 first_valid_gid = 490 first_valid_uid = 490 imapc_ssl_verify = no listen = * mail_access_groups = vmail mail_location = mdbox:~/mdbox/ mail_plugins = " zlib acl" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mdbox_preallocate_space = yes mdbox_rotate_size = 10 M namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = mdbox:/srv/mail/%%d/%%n/mdbox prefix = %%u/ separator = / subscriptions = yes type = shared } namespace personal { hidden = yes inbox = yes location = mailbox LMAX-Sent { auto = subscribe } mailbox Sent { auto = subscribe special_use = \Sent } prefix = INBOX/ separator = / subscriptions = yes type = private } passdb { args = scheme=SSHA512 /etc/dovecot/local-users.passdb driver = passwd-file } passdb { args = scheme=SSHA512 /etc/dovecot/master-users.passdb driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap skip = authenticated } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db sieve = ~/%d/%n/.dovecot.sieve sieve_dir = ~/%d/%n/sieve sieve_extensions = +notify +imapflags +vacation-seconds sieve_vacation_min_period = 10s zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve replication_dsync_parameters = -d -l 30 -U service auth { unix_listener auth-userdb { group = vmail user = vmail } } service config { unix_listener config { user = vmail } } service imap-login { process_limit = 500 process_min_avail = 2 user = vmail } service imap-postlogin { executable = script-login /etc/dovecot/ldap_groups.sh user = vmail } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/pki/tls/certs/localhost.crt ssl_client_ca_file = /etc/pki/tls/certs/ca-bundle.crt ssl_key = </etc/pki/tls/private/localhost.key userdb { args = /etc/dovecot/local-users.userdb driver = passwd-file } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes verbose_ssl = yes protocol lmtp { mail_plugins = " sieve" } protocol imap { mail_plugins = " zlib acl imap_acl" } --- LMAX Exchange, Yellow Building, 1A Nicholas Road, London W11 4AN http://www.LMAX.com/ --- #1 Fastest Growing Tech Company in UK - Sunday Times Tech Track 100 (2014) Awards 2015 Best FX Trading Venue - ECN/MTF - WSL Institutional Trading Awards 2014 Best Margin Sector Platform - Profit & Loss Readers' Choice Awards 2014 Best FX Trading Venue - ECN/MTF - WSL Institutional Trading Awards 2014 Best Infrastructure/Technology Initiative - WSL Institutional Trading Awards 2013 #15 Fastest Growing Tech Company in UK - Sunday Times Tech Track 100 2013 Best Overall Testing Project - The European Software Testing Awards 2013 Best Margin Sector Platform - Profit & Loss Readers' Choice Awards 2013 Best FX Trading Platform - ECN/MTF - WSL Institutional Trading Awards 2013 Best Executing Venue - Forex Magnates Awards 2011 Best Trading System - Financial Sector Technology Awards 2011 Innovative Programming Framework - Oracle Duke's Choice Awards --- FX and CFDs are leveraged products that can result in losses exceeding your deposit. They are not suitable for everyone so please ensure you fully understand the risks involved. This message and its attachments are confidential, may not be disclosed or used by any person other than the addressee and are intended only for the named recipient(s). This message is not intended for any recipient(s) who based on their nationality, place of business, domicile or for any other reason, is/are subject to local laws or regulations which prohibit the provision of such products and services. This message is subject to the terms at http://www.lmax.com/pdf/general-disclaimers.pdf however if you cannot access these, please notify us by replying to this email and we will send you the terms. If you are not the intended recipient, please notify the sender immediately and delete any copies of this message. LMAX Exchange is the trading name of LMAX Limited. LMAX Limited operates a multilateral trading facility. LMAX Limited is authorised and regulated by the Financial Conduct Authority (firm registration number 509778) and is a company registered in England and Wales (number 6505809). LMAX Hong Kong Limited is a wholly-owned subsidiary of LMAX Limited. LMAX Hong Kong is licensed by the Securities and Futures Commission in Hong Kong to conduct Type 3 (leveraged foreign exchange trading) regulated activity with CE Number BDV088.

1 0

ACL syntax for setting specified folders within Maildir/ read-only for owner
by kepa 08 Apr '15

08 Apr '15

Hi, I have dovecot (2.2.16, see dovecot -n at end) installed to /opt on CentOS 6 for access on a local network. I would like to create an archival mail account which will reduce the primary account file size and still make older emails easily accessible. How can I set specified folders in this Maildir read-only with ACL? For example, I included this in the dovecot-acl file to specify protected folders in the archives@ Maildir but it did not work: "Email 2013/*" user=archives lrs "Email 2014/*" user=archives lrs Also tried this on folders without spaces with no success (the folders were still delete-able by the user via the Thunderbird client). Each "Email..." folder has several child folders that should also be read-only. BTW, what is the maximum size for a Maildir that Dovecot can comfortably handle? Thanks! Kepa dovecot -n: # 2.2.16: /opt/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) mail_location = maildir:~/Maildir mail_plugins = acl namespace inbox { inbox = yes location = [mailbox info ...] plugin { acl = vfile:/opt/dovecot/etc/dovecot/dovecot-acl } protocols = imap service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = acl imap_acl

2 1

Users can't use Dovecot IMAP
by John Lewis 08 Apr '15

08 Apr '15

Every time a user logs into Dovcot's IMAP service PAM closes the session immediately after it opens. I would like a user to have a session open long enough to read some emails. dictator@drakeclasher:~$ sudo dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.14-0.bpo.1-amd64 x86_64 Debian 7.8 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = failure_show_msg=yes %s driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp" ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { args = mail driver = pam } Apr 6 21:57:29 drakeclasher su[2346]: pam_unix(su:session): session opened for user mailtest by dictator(uid=0) Apr 6 21:59:55 drakeclasher su[2346]: pam_unix(su:session): session closed for user mailtest dictator@drakeclasher:~$ groups mailtest mailtest : Domain Users mail users

2 2