Skip to content

Instantly share code, notes, and snippets.

View esenthil2018's full-sized avatar

Senthil.E esenthil2018

9 followers · 0 following
View GitHub Profile
@esenthil2018
esenthil2018 / semi_structured_rag_v1.ipynb
Created February 3, 2024 03:04
Semi_Structured_RAG_V1.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@esenthil2018
esenthil2018 / table.csv
Created March 23, 2023 20:18
Tool Scalability Deployment Language Data Processing ML Libraries Execution Environment Ease of Use Use Cases
Apache Airflow High On-prem/cloud Python Limited Any Local, Kubernetes Moderate Data pipelines, workflow management, task scheduling
MLflow Medium On-prem/cloud Python Limited Any Local, Kubernetes Easy Experiment tracking, model management, model deployment
Kubeflow High Cloud Python Limited Any Kubernetes Moderate End-to-end ML pipelines, distributed training, model serving
Prefect High On-prem/cloud Python Limited Any Local, Kubernetes Easy Data pipelines, workflow management, task scheduling
TFX High Cloud Python TensorFlow TensorFlow Kubernetes Moderate End-to-end ML pipelines, TensorFlow-specific tasks
Dask High On-prem/cloud Python High Any Local, Kubernetes, HPC Moderate Large-scale data processing, parallel and distributed computing
@esenthil2018
esenthil2018 / dock8.py
Created June 12, 2022 16:32
# install SQL Server PHP connector module
RUN pecl install sqlsrv pdo_sqlsrv
# initial configuration of SQL Server PHP connector
RUN echo "extension=/usr/lib/php/20151012/sqlsrv.so" >> /etc/php/7.0/cli/php.ini
RUN echo "extension=/usr/lib/php/20151012/pdo_sqlsrv.so" >> /etc/php/7.0/cli/php.ini
@esenthil2018
esenthil2018 / dock7.py
Created June 12, 2022 16:21
# install necessary locales
RUN apt-get install -y locales \
&& echo "en_US.UTF-8 UTF-8" > /etc/locale.gen \
&& locale-gen
@esenthil2018
esenthil2018 / dock6.py
Created June 12, 2022 16:00
# php libraries
RUN apt-get update && apt-get install -y \
php7.0 libapache2-mod-php7.0 mcrypt php7.0-mcrypt php-mbstring php-pear php7.0-dev \
--no-install-recommends \
&& rm -rf /var/lib/apt/lists/*
@esenthil2018
esenthil2018 / dock5.py
Created June 12, 2022 06:40
# install SQL Server drivers
RUN apt-get update && ACCEPT_EULA=Y apt-get install -y unixodbc-dev msodbcsql
@esenthil2018
esenthil2018 / dok4.py
Created June 12, 2022 06:31
# adding custom MS repository
RUN curl https://packages.microsoft.com/keys/microsoft.asc | apt-key add -
RUN curl https://packages.microsoft.com/config/ubuntu/16.04/prod.list > /etc/apt/sources.list.d/mssql-release.list
@esenthil2018
esenthil2018 / dock3.py
Created June 12, 2022 06:14
# apt-get and system utilities
RUN apt-get update && apt-get install -y \
curl apt-utils apt-transport-https debconf-utils gcc build-essential g++-5\
&& rm -rf /var/lib/apt/lists/*
@esenthil2018
esenthil2018 / dk1.py
Created June 12, 2022 05:40
# php-mssql
# PHP runtime with pdo_sqlsrv to connect to SQL Server
FROM ubuntu:16.04
@esenthil2018
esenthil2018 / dockerfile.py
Created June 12, 2022 05:36
# php-mssql
# PHP runtime with pdo_sqlsrv to connect to SQL Server
FROM ubuntu:16.04
# apt-get and system utilities
RUN apt-get update && apt-get install -y \
curl apt-utils apt-transport-https debconf-utils gcc build-essential g++-5\
&& rm -rf /var/lib/apt/lists/*
# adding custom MS repository