Skip to content

Instantly share code, notes, and snippets.

@muness
Forked from eclubb/sqlite2pg.sh
Last active April 3, 2017 17:23
Show Gist options
  • Save muness/cce830a8d6718e67e7674bdd0a2361cd to your computer and use it in GitHub Desktop.
Save muness/cce830a8d6718e67e7674bdd0a2361cd to your computer and use it in GitHub Desktop.
Script to import SQLite3 database into PostgreSQL
#!/bin/sh -ex
# This script will migrate schema and data from a SQLite3 database to PostgreSQL.
# Schema translation based on http://stackoverflow.com/a/4581921/1303625.
# Some column types are not handled (e.g blobs).
SQLITE_DB_PATH=$1
PG_DB_NAME=$2
PG_USER_NAME=$3
SQLITE_DUMP_FILE="sqlite_data.sql"
sqlite3 $SQLITE_DB_PATH .dump > $SQLITE_DUMP_FILE
# PRAGMAs are specific to SQLite3.
gsed -i '/PRAGMA/d' $SQLITE_DUMP_FILE
# Convert sequences.
gsed -i '/sqlite_sequence/d ; s/integer PRIMARY KEY AUTOINCREMENT/serial PRIMARY KEY/ig' $SQLITE_DUMP_FILE
# Convert column types.
gsed -i ' s/BOOLEAN/smallint/g ; s/`/"/g ; s/STRING/text/g ; s/datetime/timestamp/g ; s/integer[(][^)]*[)]/integer/g ; s/tinyint/smallint/g ; s/text[(]\([^)]*\)[)]/varchar(\1)/g' $SQLITE_DUMP_FILE
createdb -U $PG_USER_NAME $PG_DB_NAME || echo "$PG_DB_NAME already exists..."
psql $PG_DB_NAME $PG_USER_NAME < $SQLITE_DUMP_FILE &> output.log
# Update Postgres sequences.
psql $PG_DB_NAME $PG_USER_NAME -c "\ds" | grep sequence | cut -d'|' -f2 | tr -d '[:blank:]' |
while read sequence_name; do
table_name=${sequence_name%_id_seq}
psql $PG_DB_NAME $PG_USER_NAME -c "select setval('$sequence_name', (select max(id) from $table_name))"
done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment