Skip to content

Instantly share code, notes, and snippets.

View oneryalcin's full-sized avatar

Mehmet Öner Yalçın oneryalcin

23 followers · 16 following
View GitHub Profile
@oneryalcin
oneryalcin / Analyzing Product Sentiment Oner.ipynb
Created September 27, 2015 13:09
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@oneryalcin
oneryalcin / Coursera ML Foundations Week 3 Homework.ipynb
Created September 27, 2015 15:52
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@oneryalcin
oneryalcin / Coursera ML week4 - Document retreival Oner
Created September 27, 2015 18:08
{
"cells": [
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
@oneryalcin
oneryalcin / Coursera ML week4 - Document retreival Oner
Created September 27, 2015 18:08
{
"cells": [
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
@oneryalcin
oneryalcin / description.md
Created April 4, 2017 13:28 — forked from mangecoeur/description.md
Pandas PostgresSQL support for loading to DB using fast COPY FROM method

This small subclass of the Pandas sqlalchemy-based SQL support for reading/storing tables uses the Postgres-specific "COPY FROM" method to insert large amounts of data to the database. It is much faster that using INSERT. To acheive this, the table is created in the normal way using sqlalchemy but no data is inserted. Instead the data is saved to a temporary CSV file (using Pandas' mature CSV support) then read back to Postgres using Psychopg2 support for COPY FROM STDIN.

@oneryalcin
oneryalcin / pandas_diff.py
Last active May 30, 2023 09:55
Asymmetric difference of two pandas Dataframes
def diff_df(df1, df2, how="left"):
"""
Find Difference of rows for given two dataframes
this function is not symmetric, means
diff(x, y) != diff(y, x)
however
diff(x, y, how='left') == diff(y, x, how='right')
Ref: https://stackoverflow.com/questions/18180763/set-difference-for-pandas/40209800#40209800
"""
@oneryalcin
oneryalcin / add_deploy_user.yml
Created February 22, 2019 14:17
Ansible 2.7 compatible Playbook that deploys a new user with sudo rights and passwordless login to remote server. It also disables root user and password authentication
######### ansible.cfg FILE ############
[defaults]
inventory = ./dev
######### DEV FILE ############
# Dev file
[servers]
@oneryalcin
oneryalcin / corporate_messaging.py
Last active August 6, 2019 11:27
Example NLTK (Corporate messaging - Udacity example)
import nltk
nltk.download(['punkt', 'wordnet'])
import re
import numpy as np
import pandas as pd
from nltk.tokenize import word_tokenize
from nltk.stem import WordNetLemmatizer
from sklearn.metrics import confusion_matrix
from sklearn.model_selection import train_test_split
@oneryalcin
oneryalcin / custom_transformer.py
Last active August 6, 2019 12:09
sklearn's FeatureUnion in Action. We use additional custom defined StartingVerbExtractor to use in our pipeline in parallel.
import nltk
nltk.download(['punkt', 'wordnet', 'averaged_perceptron_tagger'])
import re
import pandas as pd
from nltk.tokenize import word_tokenize
from nltk.stem import WordNetLemmatizer
from sklearn.base import BaseEstimator, TransformerMixin
url_regex = 'http[s]?://(?:[a-zA-Z]|[0-9]|[$-_@.&+]|[!*\(\),]|(?:%[0-9a-fA-F][0-9a-fA-F]))+'
@oneryalcin
oneryalcin / gridsearchcv_pipeline.py
Last active August 6, 2019 13:19
Sklearn's GridSearchCV with Pipelines
import nltk
nltk.download(['punkt', 'wordnet', 'averaged_perceptron_tagger'])
import re
import numpy as np
import pandas as pd
from nltk.tokenize import word_tokenize
from nltk.stem import WordNetLemmatizer
from sklearn.metrics import confusion_matrix