Skip to content

Instantly share code, notes, and snippets.

To run in DataProc:

Add to build.sbt:

LibraryDependencies ++= Seq(
  "com.google.cloud" % "google-cloud-logging" % "1.102.0" exclude("io.grpc", "grpc-alts"),
  "io.grpc" % "grpc-alts" % "1.29.0"
)

assemblyMergeStrategy in assembly := {
@dannylee8
dannylee8 / blue-q8-dataproc-results
Created December 22, 2020 18:00
blue-q8-dataproc-results
20/12/01 01:52:31 INFO org.spark_project.jetty.util.log: Logging initialized @2249ms
20/12/01 01:52:31 INFO org.spark_project.jetty.server.Server: jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
20/12/01 01:52:31 INFO org.spark_project.jetty.server.Server: Started @2342ms
20/12/01 01:52:31 INFO org.spark_project.jetty.server.AbstractConnector: Started ServerConnector@5e9456ae{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
20/12/01 01:52:31 WARN org.apache.spark.scheduler.FairSchedulableBuilder: Fair Scheduler configuration file not found so jobs will be scheduled in FIFO order. To use fair scheduling, configure pools in fairscheduler.xml or set spark.scheduler.allocation.file to a file that contains the configuration.
+-------------+-------+---------+
| name|agg_gdp|agg_cases|
+-------------+-------+---------+
| Africa| 12349| 2543|
|North America| 3245| 763|
<!DOCTYPE html>
<html>
<body>
<<<<<<< HEAD
<h1>Previous Title</h1>
<p>Some text.</p>
=======
<h1>New Title</h1>
@dannylee8
dannylee8 / Website_problems_list.md
Last active August 1, 2020 23:07
Finding Problems on Websites

Crunchbase

ERROR: Trying to update profile email fails. DESC: I signed up with linkedin, but recently changed my email on linkedin. Without disconnecting from CB. When i tried to log into cb it didnt work so I reset my password. In profile section, when I click on my email to update it, type in a new address and click save, it doesnt do anything. I get the following error in Chrome console when I load the page:

polyfills-es2015.9f509c5561b54b6c051d.js:1 GET https://www.crunchbase.com/v4/md/personalizations/crunchbase 404

And another, when I click the save button:

@dannylee8
dannylee8 / eslint-configurations-feature-checking-comparision.md
Last active January 27, 2023 16:14
ESLint Configuration Feature Comparision (airbnb vs google vs eslint recommended vs standard)
🏄🏻‍♂️ Eslint Airbnb Google Standard
Error Checking [docs]
@dannylee8
dannylee8 / scroller.pl
Created May 26, 2020 16:59
Found one of the first programs I ever wrote. This one was at escape.com and was a text scroller on sunos.
#!/usr/local/bin/perl
#
# scroller for text files
#
##############################################################################
# configuration
#
$clear_command = '/usr/ucb/clear'; # command to clear screen
##############################################################################
@dannylee8
dannylee8 / portfolio_related.php
Created April 29, 2020 00:01
Visual Composer (Hind Theme) portfolio_related.php edits nothing happens / changes don't show up.
@dannylee8
dannylee8 / FlattenSHopifyOrders_singleObject
Created April 23, 2020 17:55
Flatten (single element in array) Orders using jq's paths(scalar) aka leaf_paths
{
"id": 450789469,
"email": "bob.norman@hostmail.com",
"created_at": "2008-01-10T11:00:00-05:00",
"updated_at": "2008-01-10T11:00:00-05:00",
"number": 1,
"token": "b1946ac92492d2347c6235b4d2611184",
"gateway": "authorize_net",
"total_price": "598.94",
"subtotal_price": "597.00",
@dannylee8
dannylee8 / FlattenShopifyOrders
Created April 23, 2020 17:42
Flatten (multiple) Orders using jq's paths(scalar) aka leaf_paths
{
"0.id": 450789469,
"0.email": "bob.norman@hostmail.com",
"0.created_at": "2008-01-10T11:00:00-05:00",
"0.updated_at": "2008-01-10T11:00:00-05:00",
"0.number": 1,
"0.token": "b1946ac92492d2347c6235b4d2611184",
"0.gateway": "authorize_net",
"0.total_price": "598.94",
"0.subtotal_price": "597.00",