Navigation Menu

Skip to content

Instantly share code, notes, and snippets.

@carlochess
Created September 3, 2018 03:51
Show Gist options
  • Star 11 You must be signed in to star a gist
  • Fork 2 You must be signed in to fork a gist
  • Save carlochess/658a98589709f46dbb3d20502e48556b to your computer and use it in GitHub Desktop.
Save carlochess/658a98589709f46dbb3d20502e48556b to your computer and use it in GitHub Desktop.
How to install Pyodbc for Sqlserver.
# Start a container that mimic the lambda environment
docker run -it --rm --entrypoint bash -e ODBCINI=/var/task -e ODBCSYSINI=/var/task -v "$PWD":/var/task lambci/lambda:build-python2.7
# Then, download ODBC source code, compile and take the output
curl ftp://ftp.unixodbc.org/pub/unixODBC/unixODBC-2.3.5.tar.gz -O
tar xvzf unixODBC-2.3.5.tar.gz
cd unixODBC-2.3.5
./configure --sysconfdir=/var/task --disable-gui --disable-drivers --enable-iconv --with-iconv-char-enc=UTF8 --with-iconv-ucode-enc=UTF16LE --prefix=/home
make install
cd ..
mv /home/* .
mv unixODBC-2.3.5 unixODBC-2.3.5.tar.gz /tmp/
# Install MSsql odbc driver
curl https://packages.microsoft.com/config/rhel/6/prod.repo > /etc/yum.repos.d/mssql-release.repo
ACCEPT_EULA=Y yum -y install msodbcsql
export CFLAGS="-I/var/task/include"
export LDFLAGS="-L/var/task/lib"
# Then you can install pyodbc (or pip install -t . -r requirements.txt)
pip install pyodbc -t .
cp -r /opt/microsoft/msodbcsql .
cat <<EOF > odbcinst.ini
[ODBC Driver 13 for SQL Server]
Description=Microsoft ODBC Driver 13 for SQL Server
Driver=/var/task/msodbcsql/lib64/libmsodbcsql-13.1.so.9.2
UsageCount=1
EOF
cat <<EOF > odbc.ini
[ODBC Driver 13 for SQL Server]
Driver = ODBC Driver 13 for SQL Server
Description = My ODBC Driver 13 for SQL Server
Trace = No
EOF
# Test if it works
python -c "import pyodbc; print(pyodbc.drivers());"
python -c 'import pyodbc;conn = pyodbc.connect("DRIVER={ODBC Driver 13 for SQL Server}; SERVER=YOUr_SERVER:ADD;PORT=1443;DATABASE=TestDB;UID=SA;PWD=<YourStrong!Passw0rd>");crsr = conn.cursor();rows = crsr.execute("select @@VERSION").fetchall();print(rows);crsr.close();conn.close()'
@ca0abinary
Copy link

I created a Dockerfile based on this and the fixes mentioned since. It creates a .zip file usable as a lambda layer.
https://gist.github.com/ca0abinary/e4825841d47d987ffc78ed62e5619055

@rags1357
Copy link

Hi Everyone!

I am facing a similar problem as most of you did before!
May be I am missing something!! :(

The Test Script works locally inside the docker container.
Could you please help me understand the steps that needs to be done after you zip the files.

This is what i did -

I created a lambda_function.py and added inside the zip folder
Created a zip of it and uploaded it to the Lambda function ( Not as a layer)
Contents of my zip are :
total 12
drwxr-xr-x 3 root root 4096 Nov 20 23:28 microsoft
drwxr-xr-x 4 root root 4096 Nov 20 23:28 mssql-tools
drwxr-xr-x 3 root root 4096 Nov 20 23:22 python
bash-4.2# cd /opt
When i try to run the lambda it throws me an error saying that no module named "pyodbc"
Appreciate any help here! been stuck at this for a while now!

Thanks,
Raghu

@ca0abinary
Copy link

Hi @rags1357! The gist I provided above has been updated with a comment that includes steps to test locally with AWS SAM. It includes a template.yaml with embedded python test code.

@rags1357
Copy link

rags1357 commented Dec 3, 2019

Thanks @ca0abinary! Appreciate it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment