Fetch emails from Amazon S3 and feed to procmail

fetch-ses-email.sh

#!/bin/bash

# Fetch emails from Amazon S3 (deposited by the Amazon SES receiver's S3 action)
# and feed to procmail. In the spirit of fetchmail, but using S3 instead of SMTP.

BUCKET=my-bucket-name
export AWS_PROFILE=my-aws-profile

PROCMAIL="/usr/bin/procmail"

# for each object in the bucket...
for F in `aws s3 ls "s3://${BUCKET}/" | awk '{print $4;}'`; do
    if [ "${F}" == "AMAZON_SES_SETUP_NOTIFICATION" ]; then
        continue # ignore this object SES creates during set-up
    fi

    # download the object and feed it on stdin to procmail
    if ! aws s3 cp "s3://${BUCKET}/${F}" - | ${PROCMAIL}; then
        echo "S3->Procmail fetch of ${F} failed with status $?"
    else
        echo "$0 successfully fetched ${F}" >> "${HOME}/.fetchlog"

        # success - delete the S3 object
        aws s3 rm "s3://${BUCKET}/${F}" --quiet
    fi
done

Kia ora Dan
I just wanted to thank you for this script :) I have an unusual scenario where I have to forward certain emails to a specific domain to external email addresses (using the AWS recommended method with an S3 bucket and lambda), and others (to the same domain), process via postifx on an EC2 to users. Many hours of turning this over, and I was stumped. The notion of a script in this style just hadn't occurred to me. Now I have a catch-all rule that puts everything else incoming in the bucket, and your script feeds them into sendmail. Genius. Thank you again, Jamie

Thanks, glad you found the script useful!