james-pagliuca

For advertiser 1269 (Medialets [DGA]), going to add push url http://c.medialytics.com/creative?type=s&tagID=sacb7932f53d34d6fbaf1548beaf84579 and secure push url https://s-cdn-c.medialytics.com/creative?type=s&tagID=sacb7932f53d34d6fbaf1548beaf84579
09:37:53			14:37:53.635 [main] INFO  c.t.p.s.i.v.IdSyncValidation$ - Requesting URL: http://c.medialytics.com/creative?type=s&tagID=sacb7932f53d34d6fbaf1548beaf84579
09:37:53			14:37:53.926 [main] INFO  c.t.p.s.i.v.IdSyncValidation$ - Requesting URL: http://tapestry.tapad.com/tapestry/1?ta_partner_id=1269&ta_partner_did=b1d6cfdc68a122075251d9be55658588&ta_format=png
09:37:54			14:37:54.000 [main] INFO  c.t.p.s.i.v.IdSyncValidation$ - Requesting URL: https://s-cdn-c.medialytics.com/creative?type=s&tagID=sacb7932f53d34d6fbaf1548beaf84579
09:37:54			14:37:54.889 [main] INFO  c.t.p.s.i.v.IdSyncValidation$ - Requesting URL: https://tapestry.tapad.com/tapestry/1?ta_partner_id=1269&ta_partner_did=c5d89ca6b626264fc7ec866129100417&ta_format=png
09:37:54			14:37:54.978 [mai

james-pagliuca

James-Pagliuca-MacBook-Air:Zillow james.pagliuca$ aws s3 cp s3://ftp.data.tapad.com/mnt/home/zillow/home/zillow/final_GUID_file/* .
A client error (403) occurred when calling the HeadObject operation: Forbidden
Completed 1 part(s) with ... file(s) remaining

james-pagliuca

James-Pagliuca-MacBook-Air:Zillow james.pagliuca$ aws s3 cp s3://ftp.data.tapad.com/mnt/home/zillow/home/zillow/final_GUID_file/* .
A client error (403) occurred when calling the HeadObject operation: Forbidden
Completed 1 part(s) with ... file(s) remaining

james-pagliuca

package jobs.dga.scripts

import java.io.{FileWriter, BufferedWriter, File}
import scala.io.Source

/**
 * Reads an audience amplify file, counting how many times each idType/platform combination is in each audience
 * Audiences to keep track of are passed in a comma separated string arg
 * Example:
 *   sbt run-main AudienceAmplifyFileAnalyzer path_to_audience_amplify_file.txt desired_outfile_location.tsv audience1,audience2

james-pagliuca

>>> import os
>>> os.system("ls")
README.md	data-pod-jobs	monitoring	src		temp
bin		local-runtime	project		target		version.sbt
0
>>> os.system("hadoop -fs ls")
Unknown cluster requested, defaulting to nj1
Error: No command named `-fs' was found. Perhaps you meant `hadoop fs'
256
>>> 

james-pagliuca

package jobs.dga.scripts

import com.twitter.scalding.{TypedTsv, JobTest}
import jobs.dga.scripts.AdIdsWithCompanySightingInGraphSince._
import org.joda.time.DateTime
import jobs.dga.test.TestUtils._
import org.scalatest.{Matchers, FunSuite}

/**
 * Created by james.pagliuca on 10/29/15.

james-pagliuca

package jobs.dga.scripts

import com.twitter.scalding.typed.TypedSink
import com.twitter.scalding.{Tsv, _}
import jobs.dga.IdHelper
import org.joda.time.DateTime
import org.joda.time.format.DateTimeFormat

// check that apsalar ids made it to alias generator
class ApsalarCheck(args: Args) extends Job(args) {

james-pagliuca

Old error
----------
[info] Resolving com.tapad.hadoop#common-sbt-scalding;1.0.4-rc01 ...
[warn]  module not found: com.tapad.hadoop#common-sbt-scalding;1.0.4-rc01
[warn] ==== typesafe-ivy-releases: tried
[warn]   https://repo.typesafe.com/typesafe/ivy-releases/com.tapad.hadoop/common-sbt-scalding/scala_2.10/sbt_0.13/1.0.4-rc01/ivys/ivy.xml
[warn] ==== sbt-plugin-releases: tried
[warn]   https://repo.scala-sbt.org/scalasbt/sbt-plugin-releases/com.tapad.hadoop/common-sbt-scalding/scala_2.10/sbt_0.13/1.0.4-rc01/ivys/ivy.xml
[warn] ==== local: tried
[warn]   /Users/james.pagliuca/.ivy2/local/com.tapad.hadoop/common-sbt-scalding/scala_2.10/sbt_0.13/1.0.4-rc01/ivys/ivy.xml