January 2025 - dovecot

Replication ade
by Hanns Mattes 01 Feb '25

01 Feb '25

Hei, mit 2.4 verschwindet ja, wenn ich das richtig verstanden habe, die Replication aus dem Werkzeugkasten von Dovecot. Obwohl ich nur ein recht kleines System mit etwa 500 Nutzern betreibe fand ich die Replication als ziemlich beruhigend :-) Meine Frage in die Runde: Wie wollt Ihr die Replikation ersetzen? Irgendwas mit NFS oder gibt es da eine empfohlene Herangehensweise? Fragende Grüße Hanns -- Sig for hire.

4 4

2.4.0 missing fields in documentation for event smtp_server_transaction_finished
by Christian Rößner 01 Feb '25

01 Feb '25

Hi, Event: smtp_server_transaction_finished remote_ip and remote_port are also available Feature-request: Please also add user to the fields, as lmtp_proxy=yes does a userdb lookup and is aware of the user. Would make things much easier... Regards Christian Rößner -- Rößner-Network-Solutions Zertifizierter ITSiBe / CISO Marburger Str. 70a, 36304 Alsfeld Fax: +49 6631 78823409, Mobil: +49 171 9905345 USt-IdNr.: DE225643613, https://roessner.website PGP fingerprint: 658D 1342 B762 F484 2DDF 1E88 38A5 4346 D727 94E5

2 1

2.4.0 on MacOS
by John Muccigrosso 01 Feb '25

01 Feb '25

I got bitten by the upgrade from 2.3 to 2.4 on my MacOS laptop. I know enough to be dangerous here and had a set-up that was working fine, but now I can't quite figure out how to modify my conf file to work correctly. The current error I'm getting is that there is no group "dovecot" even though I've created one and made the default user a member: > Fatal: service(dict) Group doesn't exist: dovecot More broadly I find the documentation hard to follow, as others seem to have noted in the past. Any help appreciated. Jackie

2 3

Help understanding doveadm-sync stateful
by Bruno MATEU 31 Jan '25

31 Jan '25

Hello, With the removal of the replication plugin in next releases, i'm trying to setup automatic synchronization using doveadm sync between my master and my replica. I managed to make the full sync work from my replica using the following comamnd `sync -A -N -R -f tcp:master-fqdn:12345` However i'd like to do stateful synchronization to avoid doing the full replication each time, and i haven't managed to do that. I tried the following: `doveadm sync -A -N -R -s "$(</var/lib/dovecot/sync-state)" tcp:master-fqdn:12345 > /var/lib/dovecot/sync-state`. However this output a `doveadm(username): Error: Saved sync state is invalid, falling back to full sync: Invalid base64 data` for every user. After looking at the state in /var/lib/dovecot/sync-state, i noticed that there is one line for every user with an associated state, plus one line with only a state. For some reason, the state is the same for every user, except one where the state is much longer. Do i need to run the command for each user, and give as an argument the corresponding state ? Is it enough to run the doveadm sync command with -A argument if i give the state in the last line outputted by doveadm sync ? Is this the right way to do it ? Best regards, Bruno MATEU

1 1

Different Replicator Crash??
by Kent Borg 31 Jan '25

31 Jan '25

I added the suggested "count--" and recompiled, and it now appears to work, the replication goes both ways, eyeballing the e-mail on the two servers they look the same. Good. But part of the time I am still getting what looks very much like the same crash, is there another "count--" I need to add to that file? > Jan 28 10:53:08 la dovecot[96175]: replicator: Panic: data stack: Out > of memory when allocating 268435496 bytes > Jan 28 10:53:08 la dovecot[96175]: replicator: Error: Raw backtrace: > #0 t_askpass[0x7fb404b0c0] -> #1 backtrace_append[0x7fb404b374] -> #2 > backtr\ > ace_get[0x7fb404b510] -> #3 execvp_const[0x7fb4057ba4] -> #4 > i_syslog_fatal_handler[0x7fb4058510] -> #5 i_panic[0x7fb3fa6808] -> #6 > t_pop_pass_st\ > r[0x7fb4050eb4] -> #7 connection_deinit[0x7fb4056430] -> #8 > pool_datastack_create[0x7fb407e7b0] -> #9 > array_bsearch_insert_pos_i[0x7fb40446d0] ->\ > #10 t_base64_scheme_decode[0x7fb404cb24] -> #11 > buffer_append[0x7fb404d3d0] -> #12 replicator_queue_push[0x558c4b4f40] > -> #13 replicator_brain_i\ > nit[0x558c4b53e4] -> #14 _start[0x558c4b3d70] -> #15 > _start[0x558c4b3f04] -> #16 io_loop_call_io[0x7fb4072f20] -> #17 > io_loop_handler_run_interna\ > l[0x7fb4075450] -> #18 io_loop_handler_run[0x7fb4075680] -> #19 > io_loop_run[0x7fb4075944] -> #20 master_service_run[0x7fb3fd84b0] -> > #21 main[0x5\ > 58c4b3930] -> #22 __libc_init_first[0x7fb3dd76d0] -> #23 > __libc_start_main[0x7fb3dd7780] -> #24 _start[0x558c4b3b80] > Jan 28 10:53:08 la dovecot[96175]: replicator: Fatal: master: > service(replicator): child 96714 killed with signal 6 (core dumps > disabled - https:\ > //dovecot.org/bugreport.html#coredumps) Thanks, -kb

1 0

Replication Question: Who Initiates?
by Kent Borg 31 Jan '25

31 Jan '25

As I understand it, if I am doing replication between a pair of servers, I run the replicator on just one and it makes all the two way changes necessary to make the two machines match. But this only happens when some change happens on that machine that runs the replicator. First, is this correct? If so, is there a way to have that other machine give the first machine poke, to get it to run a replication? Thanks, -kb

2 1

Writing to a Dictionary Using Lua
by Andrea Gabellini 31 Jan '25

31 Jan '25

Hello, I am using the push_notification_lua plugin and would like to modify my script to write data into a dictionary configured as follows: dict_server { dict proxy { idle_timeout = 300s name = sql slow_warn = 1s } dict sql { sql_driver = mysql mysql localhost { dbname = xxx password = xxx user = xxx } dict_map "shared/dsync/$user" { sql_table = dsync dict_map_value_field last_event { type = uint } dict_map_key_field userid { value = $user } } } } I am not very familiar with Lua, and I couldn't find any relevant examples in the documentation or online. Would it be possible to provide a sample code snippet demonstrating how to write to this dictionary using Lua? Thank you! -- TIM San Marino S.p.A. Andrea Gabellini Engineering R&D TIM San Marino S.p.A. - https://www.telecomitalia.sm Via Ventotto Luglio, 212 - Piano -2 47893 - Borgo Maggiore - Republic of San Marino Tel: (+378) 0549 886237 Fax: (+378) 0549 886188 -- Informativa Privacy Questa email ha per destinatari dei contatti presenti negli archivi di TIM San Marino S.p.A.. Tutte le informazioni vengono trattate e tutelate nel rispetto della normativa vigente sulla protezione dei dati personali (Reg. EU 2016/679). Per richiedere informazioni e/o variazioni e/o la cancellazione dei vostri dati presenti nei nostri archivi potete inviare una email a privacy(a)telecomitalia.sm. Avviso di Riservatezza Il contenuto di questa e-mail e degli eventuali allegati e' strettamente confidenziale e destinato alla/e persona/e a cui e' indirizzato. Se avete ricevuto per errore questa e-mail, vi preghiamo di segnalarcelo immediatamente e di cancellarla dal vostro computer. E' fatto divieto di copiare e divulgare il contenuto di questa e-mail. Ogni utilizzo abusivo delle informazioni qui contenute da parte di persone terze o comunque non indicate nella presente e-mail potra' essere perseguito ai sensi di legge.

2 3

"Modseq 34839 no longer in transaction log"
by Kent Borg 29 Jan '25

29 Jan '25

My new custom-built .deb packages seem to work, or at least work better! When new e-mails come in, it quickly attempts a sync, but says it fails: > Jan 29 10:31:49 la dovecot[1199]: doveadm: Error: > doveadm(kentborg)<2465><gL2eARV0mmehCQAAA3PmQQ>: Warning: Failed to do > incremental sync for mai\ > lbox INBOX, retry with a full sync (Modseq 34839 no longer in > transaction log (highest=37557, last_common_uid=12476, nextuid=12614)) Is this a leftover problem from my earlier crashes? I tried a full sync ("doveadm replicator replicate -f kentborg") and rebooting both machines, but I still get the error when new e-mails come in. The number in the error increments by three the several times I have seen this so far. Is there a way to make this happy? Thanks, -kb P.S. I am only doing one-way syncing so far.

1 0

Why does metrics exporter not work anymore?
by Christian Rößner 29 Jan '25

29 Jan '25

Hi, I am trying to get the metrics exporter to work in 2.4.0, but for some reason, I do not see any connection attempts to the named http server nor do I get any errors: $ doveconf -n # 2.4.0 (daeb6bc59c): /etc/dovecot/dovecot.conf # Pigeonhole version 2.4.0 (1b2d5bb9) # OS: Linux 6.10.14-linuxkit x86_64 Debian 12.9 # Hostname: b7638a15bee0 dovecot_config_version = 2.4.0 auth_allow_cleartext = yes auth_cache_verify_password_with_worker = yes auth_failure_delay = 0 secs auth_mechanisms = auth_mechanisms { plain = yes login = yes } auth_username_format = %{user | username | lower} debug_log_path = /dev/stdout default_internal_group = vmail default_internal_user = vmail default_login_user = vmail dovecot_storage_version = 2.4.0 first_valid_uid = 1000 imap_id_retain = yes info_log_path = /dev/stdout last_valid_uid = 1000 listen = listen { * = yes } lmtp_proxy = yes log_path = /dev/stdout mail_debug = yes mail_driver = sdbox mail_gid = vmail mail_home = /srv/mail/%Ln mail_path = ~/Mail mail_uid = vmail protocols { imap = yes pop3 = yes lmtp = yes } ssl = no verbose_proctitle = yes namespace inbox { inbox = yes separator = / } service lmtp { inet_listener lmtp { port = 24 ssl = no } } service imap-login { client_limit = 100 process_min_avail = 1 restart_request_count = unlimited inet_listener imap { port = 143 } } service pop3-login { client_limit = 100 process_min_avail = 1 restart_request_count = unlimited inet_listener pop3 { port = 110 } } event_exporter log { driver = log format = json time_format = rfc3339 } event_exporter conn_state { driver = http-post format = json http_post_url = http://nauthilus:8080/api/v1/custom/dovecot-session-cleaner time_format = rfc3339 http_client_request_absolute_timeout = 5sec } metric client_disconnect_http { exporter = conn_state exporter_include = exporter_include { name = yes hostname = yes timestamps = yes categories = yes fields = yes } filter = event=mail_user_session_finished AND (category=imap OR category=pop3 OR category=lmtp OR category=sieve) } metric imap_noop { exporter = conn_state exporter_include = exporter_include { name = yes hostname = yes timestamps = yes categories = yes fields = yes } filter = event=imap_command_finished AND cmd_name=NOOP } passdb lua { lua_file = /etc/dovecot/auth.lua } userdb prefetch { } userdb lua { auth_verbose = no lua_file = /etc/dovecot/auth.lua result_failure = return-fail result_internalfail = return-fail result_success = continue-ok skip = never } It is an example Docker setup found here: https://github.com/croessner/nauthilus-demo There are no error logs in dovecot. Thanks in advance Christian Rößner -- Rößner-Network-Solutions Zertifizierter ITSiBe / CISO Marburger Str. 70a, 36304 Alsfeld Fax: +49 6631 78823409, Mobil: +49 171 9905345 USt-IdNr.: DE225643613, https://roessner.website PGP fingerprint: 658D 1342 B762 F484 2DDF 1E88 38A5 4346 D727 94E5

4 16

Fwd: dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped
by Stephane De Greef 28 Jan '25

28 Jan '25

-------- Message transféré -------- Sujet : Re: dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped Date : Tue, 28 Jan 2025 11:22:35 +0100 De : Stephane De Greef <stephane.degreef(a)pacapime.be> Pour : dovecot-owner(a)dovecot.org doveconf -n # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-30-amd64 x86_64 Debian 12.9 ext4 # Hostname: pacapime.ovh auth_mechanisms = plain login mail_gid = 8 mail_home = /var/mail/%n mail_location = maildir:/var/mail/%n mail_plugins = " quota notify push_notification" mail_uid = 500 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/app-senders-passwd driver = passwd-file } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/bin/rspamc antispam_pipe_program_args = -h;localhost:11334;-P;q1 antispam_pipe_program_notspam_arg = learn_ham antispam_pipe_program_spam_arg = learn_spam antispam_spam_pattern_ignorecase = junk;spam antispam_trash_pattern_ignorecase = trash;papierkorb;deleted messages antispam_verbose_debug = 0 quota = maildir:User quota quota_rule2 = SPAM:ignore quota_rule3 = Trash:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = /var/mail/sievescript/%n/.dovecot.sieve sieve_before = /etc/dovecot/global_script/ sieve_dir = /var/mail/sievescript/%n/scripts/ } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } } service quota-warning { executable = script /usr/bin/quota-warning.sh user = vmail } service stats { unix_listener stats-reader { group = mail mode = 0660 user = vmail } unix_listener stats-writer { group = mail mode = 0660 user = vmail } } ssl = required ssl_cert = </etc/yunohost/certs/pacapime.ovh/crt.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = username_format=%n /etc/dovecot/app-senders-passwd driver = passwd-file } protocol imap { imap_client_workarounds = mail_plugins = " quota notify push_notification imap_quota antispam" } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = quota sieve postmaster_address = postmaster(a)pacapime.ovh } local_name pacapime.be { ssl_cert = </etc/yunohost/certs/pacapime.be/crt.pem ssl_key = # hidden, use -P to show it } local_name auth.pacapime.be { ssl_cert = </etc/yunohost/certs/auth.pacapime.be/crt.pem ssl_key = # hidden, use -P to show it } local_name ftp.pacapime.be { ssl_cert = </etc/yunohost/certs/ftp.pacapime.be/crt.pem ssl_key = # hidden, use -P to show it } local_name www.pacapime.be { ssl_cert = </etc/yunohost/certs/www.pacapime.be/crt.pem ssl_key = # hidden, use -P to show it } local_name adm.pacapime.ovh { ssl_cert = </etc/yunohost/certs/adm.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name coturn.pacapime.ovh { ssl_cert = </etc/yunohost/certs/coturn.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name doc.pacapime.ovh { ssl_cert = </etc/yunohost/certs/doc.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name drive.pacapime.ovh { ssl_cert = </etc/yunohost/certs/drive.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name exc.pacapime.ovh { ssl_cert = </etc/yunohost/certs/exc.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name graph.pacapime.ovh { ssl_cert = </etc/yunohost/certs/graph.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name mail.pacapime.ovh { ssl_cert = </etc/yunohost/certs/mail.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name mattermost.pacapime.ovh { ssl_cert = </etc/yunohost/certs/mattermost.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name paper.pacapime.ovh { ssl_cert = </etc/yunohost/certs/paper.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name pdf.pacapime.ovh { ssl_cert = </etc/yunohost/certs/pdf.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name pictures.pacapime.ovh { ssl_cert = </etc/yunohost/certs/pictures.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name qr.pacapime.ovh { ssl_cert = </etc/yunohost/certs/qr.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name round.pacapime.ovh { ssl_cert = </etc/yunohost/certs/round.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name rust.pacapime.ovh { ssl_cert = </etc/yunohost/certs/rust.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name sql.pacapime.ovh { ssl_cert = </etc/yunohost/certs/sql.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name stat.pacapime.ovh { ssl_cert = </etc/yunohost/certs/stat.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name talk.pacapime.ovh { ssl_cert = </etc/yunohost/certs/talk.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name test.pacapime.ovh { ssl_cert = </etc/yunohost/certs/test.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name tools.pacapime.ovh { ssl_cert = </etc/yunohost/certs/tools.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name video.pacapime.ovh { ssl_cert = </etc/yunohost/certs/video.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name webmin.pacapime.ovh { ssl_cert = </etc/yunohost/certs/webmin.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it } local_name www.pacapime.ovh { ssl_cert = </etc/yunohost/certs/www.pacapime.ovh/crt.pem ssl_key = # hidden, use -P to show it }

2 2