mmizutani

Homebrew - Scala 2.10.4

Install Tapped version of Scala 2.10.4 (old version)
> brew install homebrew/versions/scala210

Unlink version of Scala 2.11 (if installed)
> brew unlink scala

Link Tapped version of Scala 2.10.4
> brew link scala210 --force

cstrap

import smtplib
from email.mime.text import MIMEText

msg = MIMEText('There was a terrible error that occured and I wanted you to know!')
msg['Subject'] = 'Hello world'
msg['From'] = 'from@example.com'
msg['To'] = 'to@example.com'

username = 'mailtrap.io username'
password = 'mailtrap.io password'

kmader

Serialization

As all objects must be Serializable to be used as part of RDD operations in Spark, it can be difficult to work with libraries which do not implement these featuers.

Java Solutions

Simple Classes

For simple classes, it is easiest to make a wrapper interface that extends Serializable. This means that even though UnserializableObject cannot be serialized we can pass in the following object without any issue

public interface UnserializableWrapper extends Serializable {
 public UnserializableObject create(String parm1, String parm2);

dideler

The program below can take one or more plain text files as input. It works with python2 and python3.

Let's say we have two files that may contain email addresses:

1. file_a.txt

foo bar
ok ideler.dennis@gmail.com sup
 hey...user+123@example.com,wyd
hello world!