inbox.sourceware.org experiment

[Mark Wielaard]

Hi,

On Wed, Aug 24, 2022 at 12:08:51AM +0200, Mark Wielaard via Overseers wrote:
> Sorry this took a bit longer. But I wanted to make sure I got it right.
> I solved it slightly simpler by installing a /home/inbox/.forward with:
> |/usr/bin/public-inbox-mda

This is now |/home/inbox/public-inbox-mda-true.sh
Which does:
/usr/bin/public-inbox-mda --no-precheck 2>&1 | ts >> /home/inbox/log/public-inbox-mda.out.log || true

|| true to make sure any errors don't cause a bounce.  --no-precheck
because public-inbox-mda is very picky and rejects various emails that
seem just fine. And a timestamped log of errors goes to
/home/inbox/log/public-inbox-mda.out.log

> And then simply add the inbox user as extra recipient. So the STANZA
> looks like:
> 
> # STANZA START: test-list
> # CREATED: Sat Mar  7 13:49:45 2020
> test-list:             "|/usr/local/mailman/mailman post test-list", inbox
> test-list-bounces:     "|/usr/local/mailman/mailman bounces test-list"
> test-list-confirm:     "|/usr/local/mailman/mailman confirm test-list"
> test-list-join:        "|/usr/local/mailman/mailman join test-list"
> test-list-leave:       "|/usr/local/mailman/mailman leave test-list"
> test-list-owner:       "|/usr/local/mailman/mailman owner test-list"
> test-list-request:     "|/usr/local/mailman/mailman request test-list"
> test-list-subscribe:   "|/usr/local/mailman/mailman subscribe test-list"
> test-list-unsubscribe: "|/usr/local/mailman/mailman unsubscribe test-list"
> # STANZA END: test-list
> 
> The script to generate those is in
> /etc/mailman/mailman-aliases-to-inbox.sh
> And the postfix main.cf has been updated to use the generated
> /etc/mailman/aliases-inbox

This was a little too naive, public-inbox-mda does ignore emails to
addresses it doesn't know about, but some addresses generated odd/bad
loops. In particular the "root" list (now removed by Frank) and the
mailman and postmaster lists (I removed the inbox recipient by hand).

The script really should be updated to only add inbox to those mailman
post lists it is archiving.

> The only thing I don't know is how to automate the
> /etc/mailman/mailman-aliases-to-inbox.sh running when new lists are
> added. Should this be a mailman trigger or cronjob check?

So once automated make sure the above changes are also done
automatically.

I noticed two issues some lists seem to have a bad/corrupt xapian
database and generate an error while indexing (gcc-patches). emails
with slashes / in the Message-ID sometimes get wrongly escaped and
appear to not be in the archive while they really are.
e.g. the message I am replying to shows as:
https://inbox.sourceware.org/overseers/YwVP8+LHvyLzUG%2F+@wildebeest.org/
But should be:
https://inbox.sourceware.org/overseers/YwVP8+LHvyLzUG/+@wildebeest.org/

Cheers,

Mark