pratos

1. General Background and Overview

• Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
• Models and Issues in Data Stream Systems
• Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
• Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
• [Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

pratos

# For Windows users# Note: <> denotes changes to be made

#Create a conda environment
conda create --name <environment-name> python=<version:2.7/3.5>

#To create a requirements.txt file:
conda list #Gives you list of packages used for the environment

conda list -e > requirements.txt #Save all the info about packages to your folder

pratos

General git commands_

git clone <git-clone repository link>
------------or----------------------
git remote add origin https://github.com/user/repo.git

git add <folder/filename>
git commit -m "Comment"
git status

pratos

cd
cd /etc/ssh
sudo nano sshd_config

Search for keepalive (Use Ctrl+W to search) Add the below

ClientAliveInterval 30

pratos

Get list of the packages installed in the system

$ dpkg --list

Remove the packages from Ubuntu

sudo apt-get --purge remove <package-name>

pratos

Install Zeppelin in Ubuntu systems

• First install Java, Scala and Spark in Ubuntu

  • Install Java

    sudo apt-add-repository ppa:webupd8team/java
    sudo apt-get update
    sudo apt-get install oracle-java8-installer
    

pratos

Installing Zeppelin in Windows

We would need cygwin for this. Install the basic Cygwin and specifically install wget,tar,qawk,bzip2,subversion,vim

Run the installer After Cygwin gets installed, get the setup file and install the below:

> C:/Users/user/Downloads/setup-x86_64.exe -q -P  wget,tar,qawk,bzip2,subversion,vim

pratos

library(lubridate)
parse_date_time(x = paste("01-", "13-Jan", sep = ""),
+                 orders = c("d m y", "d-y-m", "m-d-y"),
+                 locale = "eng", tz="GMT")
[1] "2013-01-01 GMT"

parse_date_time(x = paste("01-", "Jan-13", sep = ""),
+                 orders = c("d m y", "d-y-m", "m-d-y"),
+                 locale = "eng", tz="GMT")

pratos

Installing MySQL 5.7 in Ubuntu 16.04LTS (Note: Things still break in Ubuntu, advisable to move to docker and setup volumes_)

sudo apt-get purge mysql-server mysql-client mysql-common mysql-server-core-5.7 mysql-client-core-5.7
sudo rm -rf /etc/mysql /var/lib/mysql

Clean-up

sudo apt-get autoremove

pratos

Clone the recursive repo for xgboost

git clone --recursive https://github.com/dmlc/xgboost
cd xgboost
make -j4

cd in the folder: xgboost/python-package