Michael Della Bitta mdellabitta

Keybase proof

I hereby claim:

I am mdellabitta on github.
I am michaeldb (https://keybase.io/michaeldb) on keybase.
I have a public key ASBExrW5r7uG2cWtfoa1ahCcsFQYAiex64LB8AjfbwJK7go

To claim this, I am signing this object:

How to build hadoop native dylibs for macOS for Spark

This worked for me for the versions of Hadoop and Spark that I needed to use. Probably will work for other versions as well, until macOS takes the next step further from the light...

Install dependencies with homebrew:
- snappy
- zlib
- zstd
- bzip2

Keybase proof

I hereby claim:

I am mdellabitta on github.
I am mdellabitta (https://keybase.io/mdellabitta) on keybase.
I have a public key ASBjFMmoR7kiSy8ncYpQwNh9_0tJDm6xWvu5u9_nm9mE6go

To claim this, I am signing this object:

	<?xml version="1.0" ?>
	<assembly xmlns="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.0"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.0 http://maven.apache.org/xsd/assembly-1.1.0.xsd">
	<id>hadoop</id>
	<formats>
	<format>jar</format>
	</formats>
	<includeBaseDirectory>false</includeBaseDirectory>
	<dependencySets>

	<build>
	<plugins>
	<plugin>
	<artifactId>maven-assembly-plugin</artifactId>
	<version>2.2</version>
	<executions>
	<execution>
	<id>some-id</id>
	<configuration>
	<finalName>some-name</finalName>

	import org.apache.hadoop.conf.Configuration;
	import org.apache.hadoop.io.*;
	import org.apache.hadoop.mapreduce.Mapper;


	public class SolrMapper extends Mapper<LongWritable, Text, Text, Text> {
	private HttpSolrServer solrServer;
	private Text outKey = new Text();

	@Override

	<add>
	<doc>
	<field name="one">1</field>
	<field name="one">3</field>
	<field name="two">2</field>
	<field name="two">4</field>
	<field name="two">6</field>
	<field name="two">8</field>
	</doc>
	</add>

	#!/usr/bin/env ruby

	output = `xrandr --query`


	ids = output.lines.find_all do \|line\|
	line =~ /\sconnected/
	end

	if ids.size == 1

	<param name="httpClientTimeoutSecs" value="20">
	<comment>Number of seconds Fedora http client will wait for a connection before timing
	out.</comment>
	</param>
	<param name="httpClientSocketTimeoutSecs" value="120">
	<comment>Number of seconds Fedora http client will wait for data coming across an
	established http connection.</comment>
	</param>
	<param name="httpClientMaxConnectionsPerHost" value="20">
	<comment>Maximum number of Fedora http client connections allowed to a given host.</comment>

	require 'csv'

	CSV.open("list_of_pids.csv", "rb").each do \|csv\|
	pid = csv[1]

	["JP2", "THUMBNAIL", "WIDE_THUMBNAIL", "REFERENCE_THUMBNAIL"].each do \|ds_id\|
	response = `curl --silent -I "http://example.org:8080/fedora/objects/#{pid}/datastreams/#{ds_id}/content" --user "fedoraAdmin:somepassword"`
	puts "#{csv[0]},#{csv[1]},#{ds_id},#{response.lines.first}"
	end
	end