[dovecot/core] 044081: lib-dns: Add DNS specific matching algorithms

Fri Nov 18 12:00:15 UTC 2016

  Branch: refs/heads/master-2.2
  Home:   https://github.com/dovecot/core
  Commit: 04408131c54813ff8b7e7567d29c7f581c661caf
      https://github.com/dovecot/core/commit/04408131c54813ff8b7e7567d29c7f581c661caf
  Author: Aki Tuomi <aki.tuomi at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-dns/Makefile.am
    A src/lib-dns/dns-util.c
    A src/lib-dns/dns-util.h

  Log Message:
  -----------
  lib-dns: Add DNS specific matching algorithms

RFC4343 and RFCRFC4592 compare and match algorithms

  Commit: 41bee81223f49e83d922314ca93d841de831e931
      https://github.com/dovecot/core/commit/41bee81223f49e83d922314ca93d841de831e931
  Author: Aki Tuomi <aki.tuomi at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-dns/Makefile.am
    A src/lib-dns/test-dns-util.c

  Log Message:
  -----------
  lib-dns: Add tests for dns-util

  Commit: 2e896b5e3d75319050ca0ff5a966afe4797c2e4d
      https://github.com/dovecot/core/commit/2e896b5e3d75319050ca0ff5a966afe4797c2e4d
  Author: Aki Tuomi <aki.tuomi at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/config/Makefile.am
    M src/config/config-filter.c

  Log Message:
  -----------
  config: Match local_name using dns-util

This way it correctly handles wildcards.

  Commit: d980af3f2fd3db0c240789bc4787f2e26c470031
      https://github.com/dovecot/core/commit/d980af3f2fd3db0c240789bc4787f2e26c470031
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index.c

  Log Message:
  -----------
  lib-storage: Fix handling LAYOUT=index losing mailbox names

It lost all the mailbox names.

  Commit: 5cbd16c3dfbeeb485c00554c23405f0941d1f32c
      https://github.com/dovecot/core/commit/5cbd16c3dfbeeb485c00554c23405f0941d1f32c
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-sync.c
    M src/lib-storage/list/mailbox-list-index.c
    M src/lib-storage/list/mailbox-list-index.h

  Log Message:
  -----------
  lib-storage: If LAYOUT=index loses mailbox names, write the generated ones to index.

Previously it just kept complaining and regenerating new names, without
actually fixing up the situation.

  Commit: 95be2fc4d032e52f5da1770b41f549f57c30bf40
      https://github.com/dovecot/core/commit/95be2fc4d032e52f5da1770b41f549f57c30bf40
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index.c

  Log Message:
  -----------
  lib-storage: Improve mailbox list index corruption errors

  Commit: dbe6c905e7050c2217f8e2cfc1b8a54a6d49610c
      https://github.com/dovecot/core/commit/dbe6c905e7050c2217f8e2cfc1b8a54a6d49610c
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-sync.c
    M src/lib-storage/list/mailbox-list-index.c
    M src/lib-storage/list/mailbox-list-index.h

  Log Message:
  -----------
  lib-storage: Fix invalid parents in LAYOUT=index

Previously it just kept complaining without fixing the errors.

  Commit: 4e42afdaf372871fb455d0009f2c5bf83049ba80
      https://github.com/dovecot/core/commit/4e42afdaf372871fb455d0009f2c5bf83049ba80
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index.c

  Log Message:
  -----------
  lib-storage: Prevent parent loops in mailbox list index

  Commit: d76ce1b2f3a9050e1e756f380f77d9accf7e4469
      https://github.com/dovecot/core/commit/d76ce1b2f3a9050e1e756f380f77d9accf7e4469
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-backend.c

  Log Message:
  -----------
  lib-storage: Prevent renaming mailbox under itself.

This resulted earlier in a loop, which broke the mailbox index.
Note that IMAP already prevented this, so it could only be triggered by
other tools, like doveadm.

  Commit: 03917da0d245a2afbad5306a57adc073178315d9
      https://github.com/dovecot/core/commit/03917da0d245a2afbad5306a57adc073178315d9
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/index-storage.c
    M src/lib-storage/list/mailbox-list-index-backend.c
    M src/lib-storage/mail-storage-private.h

  Log Message:
  -----------
  LAYOUT=index: Update mailbox name to mailbox index's header when opening.

This way if the mailbox list index gets lost, a recent mailbox name is still
available.

  Commit: ad98f19c09a96ee3e439619c0a4d1d93dc2dce50
      https://github.com/dovecot/core/commit/ad98f19c09a96ee3e439619c0a4d1d93dc2dce50
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/doveadm/doveadm-dump-index.c

  Log Message:
  -----------
  doveadm dump: Add support for the new box-name index header.

  Commit: c4057d78f5bb8819b0fca730bcbd86653191873b
      https://github.com/dovecot/core/commit/c4057d78f5bb8819b0fca730bcbd86653191873b
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/index-rebuild.c

  Log Message:
  -----------
  lib-storage: Preserve box-name header when rebuilding index.

  Commit: 0e6ec60d00d624caa8f66ecdff9e8f9edc91aad9
      https://github.com/dovecot/core/commit/0e6ec60d00d624caa8f66ecdff9e8f9edc91aad9
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-backend.c
    M src/lib-storage/list/mailbox-list-index-sync.c
    M src/lib-storage/list/mailbox-list-index.c
    M src/lib-storage/list/mailbox-list-index.h

  Log Message:
  -----------
  LAYOUT=index: Don't write corrupted mailbox names to box-name header.

This way when opening a mailbox the box-name header isn't overwritten by
a corrupted name.

Keep track of the corrupted names with MAILBOX_LIST_INDEX_FLAG_CORRUPTED_NAME
flag in list index records. The flag isn't removed until the mailbox is
renamed.

  Commit: 1e32b21d3754a3bb825416e49953b3642380e984
      https://github.com/dovecot/core/commit/1e32b21d3754a3bb825416e49953b3642380e984
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-backend.c
    M src/lib-storage/mail-storage-private.h

  Log Message:
  -----------
  lib-storage: Added struct mailbox.corrupted_mailbox_name

This allows backends that are adding lost mailboxes to mailbox list index to
indicate that they don't actually know the name of the mailbox, and the
mailbox list index should try to figure it out and rename the mailbox to its
proper name.

  Commit: 7962988b0b4b1a1f240782ad8dcc845e713af59e
      https://github.com/dovecot/core/commit/7962988b0b4b1a1f240782ad8dcc845e713af59e
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-backend.c

  Log Message:
  -----------
  LAYOUT=index: Try to rename corrupted mailbox name during mailbox open.

  Commit: d0f04acfa567286e5a8e9f7a1f17b8971fe8b8de
      https://github.com/dovecot/core/commit/d0f04acfa567286e5a8e9f7a1f17b8971fe8b8de
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/list/mailbox-list-index-backend.c
    M src/lib-storage/list/mailbox-list-index-sync.c

  Log Message:
  -----------
  lib-storage: Fix compiler warnings about enum mismatches

  Commit: 70f4b4fc6d802999c0a1f8860ae01c1c28d6fd6d
      https://github.com/dovecot/core/commit/70f4b4fc6d802999c0a1f8860ae01c1c28d6fd6d
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/imapc/imapc-storage.c

  Log Message:
  -----------
  imapc: Fix assert-crash when deleting mailbox triggers mailbox_get_open_status().

For example vsize header updating triggers this.

Fixes:
Panic: file mail-storage.c: line 1683: unreached

  Commit: f8d52f69ce8210149f9a78bae8d490904681db79
      https://github.com/dovecot/core/commit/f8d52f69ce8210149f9a78bae8d490904681db79
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-index/mail-index-write.c
    M src/lib-index/mail-transaction-log-file.c

  Log Message:
  -----------
  lib-index: Make sure an already-corrupted index/log isn't written

  Commit: ed526ea61b0cefc48f0201560137d56e08bdfb1f
      https://github.com/dovecot/core/commit/ed526ea61b0cefc48f0201560137d56e08bdfb1f
  Author: Paul Howarth <paul at city-fan.org>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M configure.ac
    M src/lib-ssl-iostream/iostream-openssl.c

  Log Message:
  -----------
  configure: Fix build with old OpenSSL without SSL_clear_options

SSL_clear_options was introduced in OpenSSL 0.9.8m but may be
backported to older versions in "enterprise" OS releases, so a version
check is insufficient here.

It was originally implemented as a macro but is a function in more
recent OpenSSL versions, so a test that works for both cases is needed.

  Commit: 3d4a16d387c183ab42f3976c7e62db1ea8497138
      https://github.com/dovecot/core/commit/3d4a16d387c183ab42f3976c7e62db1ea8497138
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-index/mail-index-transaction-sort-appends.c

  Log Message:
  -----------
  lib-index: Assert if mail_index_transaction_sort_appends() sees any uid==0

Every mail must have an UID at this stage.

  Commit: 3ccf77afa814cc08736a684acfb0e95083d17c68
      https://github.com/dovecot/core/commit/3ccf77afa814cc08736a684acfb0e95083d17c68
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-index/mail-index-transaction-finish.c
    M src/lib-index/mail-index-transaction-private.h
    M src/lib-index/test-mail-index-transaction-finish.c

  Log Message:
  -----------
  lib-index: Added internal mail_index_transaction_finish_so_far()

This can be called multiple times before mail_index_transaction_finish().
It's going to perform all the work of reordering mails and dropping
unnecessary changes that can be done before changing sequences to UIDs.

This will be needed for the following patch that implements
mail_index_transaction_get_highest_modseq().

  Commit: c04a8e72620641deafccd19f5e2107913a8ba67a
      https://github.com/dovecot/core/commit/c04a8e72620641deafccd19f5e2107913a8ba67a
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-index/mail-index-transaction-export.c
    M src/lib-index/mail-index-transaction-finish.c
    M src/lib-index/mail-index-transaction-private.h
    M src/lib-index/mail-index-transaction.c
    M src/lib-index/mail-index.h
    M src/lib-index/mail-transaction-log-file.c

  Log Message:
  -----------
  lib-index: Added mail_index_transaction_get_highest_modseq()

  Commit: 2479d44bb93751cc6f7c7818b4085e7f11049be3
      https://github.com/dovecot/core/commit/2479d44bb93751cc6f7c7818b4085e7f11049be3
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/index-mail-headers.c
    M src/lib-storage/mail-storage.c
    M src/lib-storage/mail.c

  Log Message:
  -----------
  lib-storage: Add asserts to make sure mailbox_header_lookup_ctx is used correctly.

  Commit: d5fa1f29ead1e0f4955696388d7d446464b8d40a
      https://github.com/dovecot/core/commit/d5fa1f29ead1e0f4955696388d7d446464b8d40a
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/mail-namespace.c
    M src/lib-storage/mail-namespace.h

  Log Message:
  -----------
  lib-storage: Add mail_namespace_alloc()

This makes it easier to create new namespaces.
Based on patch by Jeff Sipek

  Commit: d97ad2e7bfd2ee702d2ca66f9913e9c56294c843
      https://github.com/dovecot/core/commit/d97ad2e7bfd2ee702d2ca66f9913e9c56294c843
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/mail-namespace.c

  Log Message:
  -----------
  lib-storage: Use mail_namespace_alloc() for mail_namespaces_init_location()

Based on patch by Jeff Sipek

  Commit: f242660029e442528a7a8726d6cfafd2da0827fc
      https://github.com/dovecot/core/commit/f242660029e442528a7a8726d6cfafd2da0827fc
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/shared/shared-storage.c
    M src/lib-storage/mail-namespace.c
    M src/lib-storage/mail-namespace.h

  Log Message:
  -----------
  lib-storage: Add struct mail_namespace.user_set

  Commit: c0d3aa56067fdd379afae0c8b6bba83a6a234906
      https://github.com/dovecot/core/commit/c0d3aa56067fdd379afae0c8b6bba83a6a234906
  Author: Josef 'Jeff' Sipek <jeff.sipek at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/imapc/imapc-settings.h
    M src/lib-storage/index/imapc/imapc-storage.c

  Log Message:
  -----------
  imapc: use serialized settings as unique_root_dir

Without this, it is not possible to instantiate multiple imapc storages.
Any attempts to will result in multiple namespaces sharing the same storage,
regardless of if that was the intention.

  Commit: f0343cb7aba0591ba5aa0569d0eb8171e7837693
      https://github.com/dovecot/core/commit/f0343cb7aba0591ba5aa0569d0eb8171e7837693
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/dbox-multi/mdbox-storage.c
    M src/lib-storage/index/imapc/imapc-storage.c
    M src/lib-storage/index/maildir/maildir-storage.c
    M src/lib-storage/index/mbox/mbox-storage.c
    M src/lib-storage/index/pop3c/pop3c-storage.c
    M src/lib-storage/mail-storage-settings.c
    M src/lib-storage/mail-storage-settings.h

  Log Message:
  -----------
  lib-storage: Add mail_namespace_get_driver_settings() and use it.

It obsoletes mail_storage_get_driver_settings().

  Commit: fa42553e83c58644b0fea76584a589d2bf030bdd
      https://github.com/dovecot/core/commit/fa42553e83c58644b0fea76584a589d2bf030bdd
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/imapc/imapc-list.c

  Log Message:
  -----------
  imapc: Use struct mail_namespace.user_set

  Commit: 758c7196531d8e8fc92ab593a66fcef0bd06f1fd
      https://github.com/dovecot/core/commit/758c7196531d8e8fc92ab593a66fcef0bd06f1fd
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-settings/settings-parser.c
    M src/lib-settings/settings-parser.h

  Log Message:
  -----------
  lib-settings: Avoid duplicating settings' values when not needed

  Commit: 47505a2735079d393628f033cf842bb0e09e4c37
      https://github.com/dovecot/core/commit/47505a2735079d393628f033cf842bb0e09e4c37
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-settings/settings-parser.c
    M src/lib-settings/settings-parser.h

  Log Message:
  -----------
  lib-settings: Add settings_parse_keyvalue()

  Commit: f148562cb6cf3ee973404de49011c023d124ddde
      https://github.com/dovecot/core/commit/f148562cb6cf3ee973404de49011c023d124ddde
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/config/config-parser.c
    M src/doveadm/doveadm-dsync.c
    M src/lib-storage/mail-storage-service.c

  Log Message:
  -----------
  global: Replace some settings_parse_line() calls with settings_parse_keyvalue()

  Commit: 853f5e3184ae54e84ddd6e6e2a12b1abbd6f6363
      https://github.com/dovecot/core/commit/853f5e3184ae54e84ddd6e6e2a12b1abbd6f6363
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/mail-storage-service.c
    M src/lib-storage/mail-storage-service.h

  Log Message:
  -----------
  lib-storage: Add mail_storage_service_user_get_pool()

  Commit: 2aa182ac91d179b94923eae31941f688fb345736
      https://github.com/dovecot/core/commit/2aa182ac91d179b94923eae31941f688fb345736
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-index/mail-index-sync.c

  Log Message:
  -----------
  lib-index: Fix detecting whether caller synced everything in mailbox.

When mailbox_index_sync_begin() was followed by _commit(), without _next()s
in the middle actually syncing the mailbox, the tail_offset was updated to
indicate that the mailbox was fully synced. Existing code didn't rely on
this, so it probably didn't break anything.

This code hasn't worked for a long time, because log_view is always read
fully to the end in _sync_begin().

  Commit: 1d0ef5c88e113874c48660f84417d8bb69501021
      https://github.com/dovecot/core/commit/1d0ef5c88e113874c48660f84417d8bb69501021
  Author: Josef 'Jeff' Sipek <jeff.sipek at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib-storage/index/index-mail-headers.c

  Log Message:
  -----------
  lib-storage: fix index_mail_get_headers return value

And make it more obvious that we're not setting the actual return value in
index_mail_get_first_header.

  Commit: a14d0006121d12996838fccfb4db21929e4c2c20
      https://github.com/dovecot/core/commit/a14d0006121d12996838fccfb4db21929e4c2c20
  Author: Timo Sirainen <timo.sirainen at dovecot.fi>
  Date:   2016-11-18 (Fri, 18 Nov 2016)

  Changed paths:
    M src/lib/connection.c
    M src/lib/connection.h

  Log Message:
  -----------
  lib: Add connection.allow_empty_args_input

This simplifies input_args() callbacks since they don't always have to check
for args[0] == NULL. This is enabled by default, because none of the current
users want it and it's somewhat unlikely there even will be those in future.

Compare: https://github.com/dovecot/core/compare/bb2fcd3c89ad...a14d0006121d