June 2011 - dovecot - dovecot.org

[Dovecot] Custom sql query for keeping quota with dict-sql
by Marcin Mirosław 05 Jun '11

05 Jun '11

Hello! I'd like to setup quota for for virtualusers, i'm using both maildir++ and mdbox as storage, and i'm using postgresql to keep users. I'm keeping all users data in one table: [...] login text NOT NULL, domain text, password text, quota_mb integer NOT NULL DEFAULT 0 [... other columns ...] i'd like to keep present quota in such two columns: quota_dict_bytes integer NOT NULL DEFAULT 0, quota_dict_messages integer NOT NULL DEFAULT 0 I read wiki a little and it looks i can't define own sql queries, they appear to be hardcoded. Am i wrong? Is it possible to write own queries to get/set quota using such table schema? Or maybe there is diffrent way to track quota for diffrent storages? Regards! Marcin

4 10

[Dovecot] dsync: Invalid mailbox first_recent_uid
by David Jonas 04 Jun '11

04 Jun '11

For the life of me I can't get dsync to work. Please help! Remote server runs dovecot out of /usr/local/dovecot2. Everything makes sense until this line: dsync-local(djonas(a)vitalwerks.com): Error: Invalid mailbox input from worker server: Invalid mailbox first_recent_uid The local uid is 8989 and the remote uid is 89. I added "first_valid_uid = 89" to the local conf but to no avail. Local version is 2.0.12, remote is 2.0.1. # dsync -Dv -u djonas(a)vitalwerks.com mirror \ ssh vmail(a)192.168.15.54 \ /usr/local/dovecot2/bin/dsync -Dv -u djonas(a)vitalwerks.com dsync(vmail): Debug: Effective uid=8989, gid=8989, home=/home/vmail/domains/vitalwerks.com/djonas dsync(vmail): Debug: Quota root: name=user backend=dict args=vitalwerks.com-djonas:proxy::quota dsync(vmail): Debug: dict quota: user=vitalwerks.com-djonas, uri=proxy::quota, noenforcing=0 dsync(vmail): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir:INBOX=~/Maildir dsync(vmail): Debug: maildir++: root=/home/vmail/domains/vitalwerks.com/djonas/Maildir, index=, control=, inbox=/home/vmail/domains/vitalwerks.com/djonas/Maildir dsync-local(djonas(a)vitalwerks.com): Debug: Namespace : Using permissions from /home/vmail/domains/vitalwerks.com/djonas/Maildir: mode=0770 gid=-1 dsync-local(djonas(a)vitalwerks.com): Error: Invalid mailbox input from worker server: Invalid mailbox first_recent_uid dsync-remote(djonas(a)vitalwerks.com): Error: read() from proxy client failed: EOF

2 2

[Dovecot] Segmentation fault again
by Jim Knuth 03 Jun '11

03 Jun '11

Hi, I have the following report after a cron job again? /root/tools/expunge: Zeile 3: 4869 Speicherzugriffsfehler doveadm expunge -A mailbox Spam savedbefore 5d /root/tools/expunge: Zeile 5: 4915 Speicherzugriffsfehler doveadm expunge -A mailbox Papierkorb savedbefore 4d See the attachment. Any ideas greatly appreciated. Thanks -- Mit freundlichen Grüßen, with kind regards, Jim Knuth --------- Das Leben ist bezaubernd, man muss es nur durch die richtige Brille sehen. (Alexandre Dumas)

3 8

[Dovecot] solr substring schema.xml
by Daniel Miller 03 Jun '11

03 Jun '11

I'm trying a modified schema.xml with solr - it appears I now have substring searches! I took the schema.xml file shipped with Dovecot, and modified the text field definition to be: <fieldType name="text" class="solr.TextField" positionIncrementGap="100"> <analyzer type="index"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="1" catenateNumbers="1" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> <analyzer type="query"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> </fieldType> Changing to the new "SnowballPorter" instead of the deprecated "EnglishPorter" filters is probably minor - the magic is the "NGramFilterFactory". 3 & 15 seemed reasonable defaults for the min/max size to search on. -- Daniel

2 2

[Dovecot] unexpected subfolder locaton in Maildir/.INBOX.subfolder
by wulf 03 Jun '11

03 Jun '11

Hallo, I try to migrate existing imap server to dovecot 1.2 in debian squeeze if I connect to imap://user@host/INBOX Inbox works as expected and I get the content of Maildir/{cur,new,tmp} Maildir/.subfolder already exists if I connect to imap://user@host/INBOX.subfolder I get "folder not found" if I do a imap directory listing (raw mutt config, no subscriptions) - I see "../" - If I navigate to "../" I se all my existing subfolders if I create a new folder via imap the folder is created in Maildir/.INBOX.new_subfolder I expect the creation of Maildir/.new_subfolder This doesn't fit to the client configs and if I move the existing folders it doesn't fit to existing delivery agent filters and settings. I enabled mail_debug and the expansion looks ok for me: dovecot: imap-login: Login: user=<wulf>, method=PLAIN, rip=85.178.xx.xxx, lip=80.81.xxx.xxx, TLS dovecot: IMAP(wulf): Effective uid=112, gid=114, home=/var/mail/home/wulf dovecot: IMAP(wulf): maildir: data=~/Maildir dovecot: IMAP(wulf): maildir++: root=/var/mail/home/wulf/Maildir, index=, control=, inbox=/var/mail/home/wulf/Maildir the existing subscription information from courier-imap looks like INBOX.subolder Yes I can sed them to subfolder (of course I have to copy them to Maildir/subscriptions anyhow) But is that the idea? I like to avoid trouble with all the users and their already configured mail-clients. Where is my mistake? Thanks for feedback Best Wulf CONF: protocols = imap imaps log_timestamp = "%Y-%m-%d %H:%M:%S " ssl = required ssl_cert_file = /etc/exim4/xxxxxxxxxxxxxxx.pem ssl_key_file = /etc/exim4/xxxxxx.key mail_location = maildir:~/Maildir mail_uid = 112 mail_gid = 114 mail_access_groups = vmail mail_debug = yes first_valid_uid = 112 protocol imap { } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol managesieve { } auth_verbose = yes auth_debug = yes auth default { mechanisms = plain passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb static { args = uid=112 gid=114 home=/var/mail/home/%u } user = root } dict { } plugin { } dovecot-ldap.conf: hosts = 127.0.0.1:389 auth_bind = yes auth_bind_userdn = uid=%u,ou=users,dc=xxxxxxxx,dc=de base = dc=xxxxxxxx,dc=de

3 4

[Dovecot] Running a dovecot cluster with mixed versions?
by Ian Foutch 03 Jun '11

03 Jun '11

I have been trying to find information and possible issues with running a cluster of dovecot server with different versions without any luck. We have an existing cluster with dovecot v1.1.10 and tried migrating to a new cluster with dovecot v2.0.12. We ran into some issues when we moved traffic to the new cluster and have been unable to reproduce it in our own testing. We may need to put real usage on the new servers but would like to be able to do this by adding newer servers into the existing cluster. What are the potential issues with doing this? Thanks, --Ian This message and any attachments to it are intended only for the addressee(s) identified above and may contain CONFIDENTIAL information. It is not intended for transmission to, or receipt by, any unauthorized persons. If you are not an intended recipient or an agent responsible for delivering it to an intended recipient, you have received this e-mail in error and any dissemination, distribution, or copying of this message or any attachment to it is strictly prohibited. If you have received this email in error, please (i) do not read it, (ii) reply to the sender that you received the message in error, and (iii) erase or destroy the message from your system.

2 1

[Dovecot] Problems in auth when switching from PLAIN-MD5
by Eduardo Casarero 03 Jun '11

03 Jun '11

Hi, i am running dovecot 2.0.11 (with mysql backend) and until now using PLAIN-MD5 as pass default_pass_scheme everything was working fine. However i wanted to change the pass_scheme to something stronger than plain-md5, so i started by reading the wiki. I found this: http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes But when i comment out "default_pass_scheme" and i create the pass with the {SHA256.hex} prefix i see this in the logs: auth: Error: sql(xxx(a)xxxxxx.com,10.21.1.1): Password in passdb is not in expected scheme SHA256.hex I tried with several algorithms, but it seems to be something in my config that it's only working with plain-md5. the auth_mechanism is plain with ssl/tls. Maybe someone can give me a hint of where to see o which config file review. Thanks in advance. Eduardo.

2 3

[Dovecot] slow squat fts index creation
by Cor Bosman 03 Jun '11

03 Jun '11

Hi all, ive been playing with squat indexes. Up to about 300.000 emails in a single mailbox this was working flawlessly. The search index file is about 500MB at that time. Ive now added some more emails, and at 450.000 or so emails im seeing a serious problem with squat index creation. It takes...f o r e v e r . The .tmp file is being so slowly, it will probably take 2-3 hours to create. Upto this point it took maybe a minute. Im doing this in an openvz container, so theoretically i may be hitting some openvz resource limit. But ive upped all the limits and dont see any improvements. I dont see any resources starvation either. Could there be some dovecot issue when the search index reaches say 1GB? (im estimating that it's now trying to save about 1GB search index). Regards, Cor

2 1

[Dovecot] Dovecot 1.2 with MySQL limit Trash folder
by Damien Robinet 03 Jun '11

03 Jun '11

Hi All, I need your help to limit the size of the Trash folder. I want to exclude the Trash folder in my user quota. But I do not want the Trash folder can not exceed 10M for example. I can manage to exclude the size of the Trash folder. But I can not limit the size of the folder. On my test, I've bytes=512000 for the Trash folder. But the user can move more that 512000B on the Trash folder ... Could you help me please ? Bests Regards, Damien ################################ ## My SQL query (dovecot-sql.conf) ## ################################ user_query = SELECT CONCAT( '/home/vmail/', maildir ) AS home, CONCAT( '/home/vmail/', maildir ) AS sieve_dir, 201 AS uid, 201 AS gid, CONCAT('*:storage=',ROUND((quota*1048.576)),'B') AS quota_rule, 'Trash:storage=50000B' AS quota_rule2, 'Trash:ignore' AS quota_rule3 FROM mail_mailbox WHERE username = '%u' AND actif = '1' ############ ## My Log: ## ############ 2011-05-24 20:08:59 imap-login: Info: Login: user=<postmaster(a)domain.tld>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.10 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_autocreate_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_expire_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Effective uid=201, gid=201, home=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota root: name=user backend=dict args=:proxy::quota 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=* bytes=1048576 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=Trash bytes=512000 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: expire: No expire or expire_altmove settings - plugin disabled 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: dict quota: user=postmaster(a)domain.tld, uri=proxy::quota, noenforcing=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir: data=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir++: root=/home/vmail/d/o/domain.tld/postmaster, index=, control=, inbox=/home/vmail/d/o/domain.tld/postmaster 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Namespace : Using permissions from /home/vmail/d/o/domain.tld/postmaster: mode=0700 gid=-1 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Connection closed bytes=38/363 ################### ## My dovecot.conf ## ################### dict { quota = mysql:/etc/dovecot/dovecot-quota.conf } plugin { args = /etc/dovecot/dovecot-sql.conf quota = dict:user::proxy::quota autocreate = Junk autocreate2 = NonJunk autocreate3 = Drafts autocreate4 = Sent autocreate5 = Trash autosubscribe = Junk autosubscribe2 = NonJunk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = Trash }

2 1

[Dovecot] New IPC features : any configuration doc ?
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Dovecot complains at start for the ipc listener not correctly configured. What is the configuration scheme ? Thanks JM

2 5