wenming

============================
Configuring IPython.parallel
============================

This guide describes the steps needed to run IPython engines on Microsoft Azure to perform a parallel
computation in the Microsoft cloud. We assume (see above guide) that Python, IPython and PyZMQ have
been installed on a set of Azure compute nodes.

1. Install Python, IPython and PyZMQ on a system having open access to the internet. We used an
   Ubuntu 11.04 system for this purpose. This system will run the IPython controller and the IPython 

wenming

#!/usr/bin/python
#opens the triplets, saves song & user keys, writes out a simpler matrix based on int user, int song, int rating.


dataset_file = open('train_triplets.txt', 'r') #http://labrosa.ee.columbia.edu/millionsong/sites/default/files/challenge/train_triplets.txt.zip
songs_count = 0 
users_count = 0
dataset_count = 0
users_dict = dict()
songs_dict = dict()	

wenming

#!/usr/bin/python #http://labrosa.ee.columbia.edu/millionsong/sites/default/files/challenge/train_triplets.txt.zip
songs_file = open('songs.txt', 'r')
users_file = open('users.txt', 'r')
dataset_file = open('train_triplets.txt', 'r')
#dataset_file = open('a.txt', 'r')
songs_count = 0 
users_count = 0
dataset_count = 0

users_dict = dict()

wenming

Swap notepad with curl.

PS C:\Users\wenmingy> while (1)
{ $filename = get-date -format 'yy-MM-dd-H-m-s'; $filename=$filename + ".log"; echo $filename; start-process -wait notepad $filename}

wenming

///repo lists is just a copy and paste from your repo dashboard. For example: the list could be: 

WindowsAzure-TrainingKit/Tutorial-HPCSOAapps
WindowsAzure-TrainingKit/Tutorial-HPCPowershellDeployment
WindowsAzure-TrainingKit/Tutorial-HPCMPIIntro
WindowsAzure-TrainingKit/Tutorial-HPCBasicParametricSweepApps
WindowsAzure-TrainingKit/Tutorial-TPLAzureScaleOut
WindowsAzure-TrainingKit/Tutorial-HPCImageRendering
WindowsAzure-TrainingKit/Tutorial-HPCBLAST
WindowsAzure-TrainingKit/Tutorial-HPCDeployToExistingCluster