purukaushik

(require 'package)
(add-to-list 'package-archives '("melpa" . "http://melpa.org/packages/"))
(setq package-list '(autopair el-get form-feed gist gh logito pcache git f dash s dash s git-gutter+ dash git-commit with-editor dash async dash idle-highlight-mode jedi auto-complete popup jedi-core python-environment deferred epc ctable concurrent deferred jedi-core python-environment deferred epc ctable concurrent deferred js2-mode json-mode json-snatcher json-reformat json-reformat json-snatcher logito lua-mode markdown-mode pcache popup python-environment deferred s sublime-themes web-mode with-editor dash async yasnippet))

(package-initialize)

(unless package-archive-contents
  (package-refresh-contents))

(dolist (package package-list)

purukaushik

(autopair el-get form-feed gist gh logito pcache git f dash s dash s git-gutter+ dash git-commit with-editor dash async dash idle-highlight-mode jedi auto-complete popup jedi-core python-environment deferred epc ctable concurrent deferred jedi-core python-environment deferred epc ctable concurrent deferred js2-mode json-mode json-snatcher json-reformat json-reformat json-snatcher logito lua-mode markdown-mode pcache popup python-environment deferred s sublime-themes web-mode with-editor dash async yasnippet)

purukaushik

Endpoints to test:

1. http://schemas.dev.mozaws.net/schema/telemetry - Shows docTypes under telemetry

2. http://schemas.dev.mozaws.net/schema/telemetry/<docType> for each docType from 2 - go to version page (6).

3. http://schemas.dev.mozaws.net/validate/telemetry - redirect to 1

4. http://schemas.dev.mozaws.net/validate/telemetry/<docType> - redirect to 2

purukaushik

UltraLightBeam next steps###

1. Watching HN, blog post comments and github issues after Asa's post goes public
2. Leaving out dashboard works till v2 release
3. Reverse the sorting to show best networks instead of the worst
4. Better measurements than dashboards for now.
5. Scalability issues

Network page

1. Click on ad network -> dashboard with two histograms - filesize, load time

purukaushik

What to document

telemetry-schema-service

v1.0

1. release notes

2. API.md

purukaushik

#!/bin/bash

# store the current dir
CUR_DIR=$(pwd)

# Let the person running the script know what's going on.
echo "\n\033[1mPulling in latest changes for all repositories...\033[0m\n"

# Find all git repositories and update it to the master latest revision
for i in $(find . -name ".git" | cut -c 3-); do

purukaushik

Setting up EC2 AMI for MongoDB

1. Launch an Amazon Linux Instance on ec2 - choose 30 GB of EBS storage- free-tier eligible
2. ssh into the AMI box
3. Use this to install mongodb - https://docs.mongodb.com/manual/tutorial/install-mongodb-on-amazon/
4. Use this to create admin user - https://docs.mongodb.com/manual/tutorial/enable-authentication/
5. Setup a read only user for running fetch queries
6. https://docs.mongodb.com/manual/reference/configuration-options/#security.authorization for restarting mongod service with auth

purukaushik

install findspark ( pip install -e . after cloning https://github.com/minrk/findspark, and cd findspark)

fire a notebook (jupyter notebook)

enter the following:

import findspark
import os
findspark.init()

purukaushik

Steps to setup a local docker swarm cluster with Docker Machine, swarm.

1. docker-machine create -d virtualbox local

2. eval "$(docker-machine env local)"

3. docker run swarm create

purukaushik

1. Download Hadoop and install.

2. Setup $HADOOP_HOME

3. Install openssh-server and run

   sudo /etc/init.d/ssh restart
   

   Check if ssh is running on port 22 by:

netstat -tupln | grep 22