Skip to content

Instantly share code, notes, and snippets.

View yossisp's full-sized avatar

Yossi Spektor yossisp

  • Tel Aviv, Israel
View GitHub Profile
@yossisp
yossisp / test_sql2.py
Created August 8, 2023 13:19
How to convert CRUD status change log table into table with date and entity column?
!pip install -q pyspark==3.3.0 spark-nlp==5.0.0
import pandas as pd
from pyspark.sql import SparkSession
from pyspark import SparkContext
spark = SparkSession.builder \
.appName("Python Spark SQL basic example") \
.getOrCreate()
@yossisp
yossisp / test_sql1.py
Last active August 8, 2023 18:05
How to convert CRUD status change log table into table with date and entity column?
# The code below refers to the following Stackoverflow answer: https://stackoverflow.com/a/76818322/5863693
!pip install -q pyspark==3.3.0 spark-nlp==5.0.0
import sparknlp
import pandas as pd
from pyspark.sql import SparkSession
from pyspark import SparkContext
spark = SparkSession.builder \
@yossisp
yossisp / entropy.js
Last active June 28, 2019 06:55
Entropy-Calculation
/*
Calculates entropy and conditional entropy as defined in Information Theory (https://en.wikipedia.org/wiki/Entropy_(information_theory))
entropy = -Sum(P_i*log_2(P_i))
*/
const Entropy = (...values) => {
let calculationResult = 0;
let fraction = 0;
@yossisp
yossisp / Dockerfile-prod1
Last active March 1, 2024 00:29
nginx setup for multiple docker-compose containers (react.js app, node.js server)
# Dockerfile for react.js app and nginx
# build environment
FROM node:8-alpine as builder
WORKDIR /usr/src/app
ENV PATH /usr/src/app/node_modules/.bin:$PATH
COPY package.json /usr/src/app/package.json
RUN npm install
COPY . /usr/src/app
RUN npm run build --loglevel verbose