Dockerfile for auto update MongoDB from JSON file

README.md

JSON to MongoDB

For sure, this is not solution for production.

I have JSON files with all my bank/credit card transactions, and I found that to create a good dashboard, most of the solutions require a database.

I created a Dockerfile to update a sibling mongo container in docker-compose.yml, with the updated JSON files.

It use the HEALTHCHECK feature as a workaround to trigger the restore each time.

Any suggestions are welcome (include English corrections).

Dockerfile

FROM mongo

ARG REPO_USER=baruchiro
ARG REPOSITORY=Accounts
ARG RESTORE_SCRIPT=mongo/load.sh

ENV REPOSITORY=${REPOSITORY}
ENV RESTORE_SCRIPT=${RESTORE_SCRIPT}

RUN apt-get update
RUN apt-get install -y git

RUN mkdir /root/.ssh/

ADD id_rsa /root/.ssh/id_rsa

RUN touch /root/.ssh/known_hosts
RUN ssh-keyscan github.com >> /root/.ssh/known_hosts

RUN git clone git@github.com:${REPO_USER}/${REPOSITORY}.git
RUN chmod +x "/${REPOSITORY}/${RESTORE_SCRIPT}"

HEALTHCHECK --interval=10m --timeout=30s --start-period=3s --retries=3 CMD [ "/${REPOSITORY}/${RESTORE_SCRIPT}" ]

ENTRYPOINT [ "/bin/sh", "-c", "/${REPOSITORY}/${RESTORE_SCRIPT} && tail -f /dev/null" ]

restore.sh

#! /bin/bash

BASEDIR=$(dirname "$0")

cd $BASEDIR/..
git checkout -- .
git pull

cd data

for dateField in "date"; do
    sed -i "s/\(\"$dateField\":\s*\)\(\"[-0-9T:.Z]*\"\)/\1ISODate(\2)/g" ./contributions.json
done
mongoimport --host mongodb --db transactions --collection maaser --type json --file ./contributions.json --jsonArray --mode=merge --upsertFields="date,sum,to"

for json in transactions-*.json ; do \

    for dateField in "date" "processedDate"; do
        sed -i "s/\(\"$dateField\":\s*\)\(\"[-0-9T:.Z]*\"\)/\1ISODate(\2)/g" "$json"
    done
    
    mongoimport --host mongodb --db transactions --collection transactions --type json \
        --file $json --jsonArray --mode=merge --upsertFields=hash ;
done