davideicardi

Avro serialization

There are 4 possible serialization format when using avro:

• Avro Json encoding
• Avro Data Serialization (https://avro.apache.org/docs/current/spec.html#Data+Serialization) Binary format with an header that contains the full schema, this is the format usually used when writing Avro files
• Avro Single Object Encoding (https://avro.apache.org/docs/current/spec.html#single_object_encoding) Binary format with an header with only the fingerprint/id of the schema, this it the format used by Kafka (see this
• Avro Binary Encoding (https://avro.apache.org/docs/current/spec.html#binary_encoding)

jkpl

object Main extends App {
  AvoidLosingGenericType.run()
  AvoidMatchingOnGenericTypeParams.run()
  TypeableExample.run()
  TypeTagExample.run()
}

class Funky[A, B](val foo: A, val bar: B) {
  override def toString: String = s"Funky($foo, $bar)"
}

slaypni

#!/usr/bin/env python3
# -*- coding: utf-8 -*-

import sys
import math

import numpy as np

sys.path.append('xgboost/wrapper/')
import xgboost as xgb