mdellabitta

Keybase proof

I hereby claim:

• I am mdellabitta on github.
• I am michaeldb (https://keybase.io/michaeldb) on keybase.
• I have a public key ASBExrW5r7uG2cWtfoa1ahCcsFQYAiex64LB8AjfbwJK7go

To claim this, I am signing this object:

mdellabitta

How to build hadoop native dylibs for macOS for Spark

This worked for me for the versions of Hadoop and Spark that I needed to use. Probably will work for other versions as well, until macOS takes the next step further from the light...

1. Install dependencies with homebrew:
   • snappy
   • zlib
   • zstd
   • bzip2

mdellabitta

Keybase proof

I hereby claim:

• I am mdellabitta on github.
• I am mdellabitta (https://keybase.io/mdellabitta) on keybase.
• I have a public key ASBjFMmoR7kiSy8ncYpQwNh9_0tJDm6xWvu5u9_nm9mE6go

To claim this, I am signing this object:

mdellabitta

<?xml version="1.0" ?>
<assembly xmlns="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.0"
          xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
          xsi:schemaLocation="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.0 http://maven.apache.org/xsd/assembly-1.1.0.xsd">
    <id>hadoop</id>
    <formats>
        <format>jar</format>
    </formats>
    <includeBaseDirectory>false</includeBaseDirectory>
    <dependencySets>

mdellabitta

      <build>  
        <plugins>
            <plugin>
                <artifactId>maven-assembly-plugin</artifactId>
                <version>2.2</version>
                <executions>
                    <execution>
                        <id>some-id</id>
                        <configuration>
                            <finalName>some-name</finalName>

mdellabitta

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.io.*;
import org.apache.hadoop.mapreduce.Mapper;


public class SolrMapper extends Mapper<LongWritable, Text, Text, Text> {
  private HttpSolrServer solrServer;
  private Text outKey = new Text();
  
  @Override

mdellabitta

<add>
  <doc>
    <field name="one">1</field> 
    <field name="one">3</field> 
    <field name="two">2</field> 
    <field name="two">4</field> 
    <field name="two">6</field> 
    <field name="two">8</field> 
 </doc>
</add>

mdellabitta

#!/usr/bin/env ruby

output = `xrandr --query`


ids = output.lines.find_all do |line| 
  line =~ /\sconnected/
end

if ids.size == 1 

mdellabitta

<param name="httpClientTimeoutSecs" value="20">
    <comment>Number of seconds Fedora http client will wait for a connection before timing 
                out.</comment>
  </param>
  <param name="httpClientSocketTimeoutSecs" value="120">
    <comment>Number of seconds Fedora http client will wait for data coming across an 
                established http connection.</comment>
  </param>
  <param name="httpClientMaxConnectionsPerHost" value="20">
    <comment>Maximum number of Fedora http client connections allowed to a given host.</comment>

mdellabitta

require 'csv'

CSV.open("list_of_pids.csv", "rb").each do |csv|
  pid = csv[1]

  ["JP2", "THUMBNAIL", "WIDE_THUMBNAIL", "REFERENCE_THUMBNAIL"].each do |ds_id|      
    response = `curl --silent -I "http://example.org:8080/fedora/objects/#{pid}/datastreams/#{ds_id}/content" --user "fedoraAdmin:somepassword"`
    puts "#{csv[0]},#{csv[1]},#{ds_id},#{response.lines.first}"
  end
end