gaborbarna’s gists

gaborbarna / stacktrace

Created January 18, 2021 10:50

	org.apache.spark.SparkException: Job aborted due to stage failure: Task 2 in stage 50967.0 failed 30 times, most recent failure: Lost task 2.29 in stage 50967.0 (TID 611666, ip-10-134-0-32.us-west-2.compute.internal, executor 2): java.lang.NullPointerException
	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
	at java.util.concurrent.ConcurrentHashMap.putAll(ConcurrentHashMap.java:1084)
	at org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider.getStore(HDFSBackedStateStoreProvider.scala:204)
	at org.apache.spark.sql.execution.streaming.state.StateStore$.get(StateStore.scala:371)
	at org.apache.spark.sql.execution.streaming.state.StateStoreRDD.compute(StateStoreRDD.scala:88)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:288)
	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
	at org.apache.spark.rdd.RDD.

gaborbarna / Dockerfile

Last active January 14, 2021 13:25

	FROM docker.util.pages/platform/openjdk:8.0

	ARG VERSION
	ENV VERSION ${VERSION}

	WORKDIR /usr/local/oit

	COPY target/scala-2.11/outcome-ingestor-tool-assembly-${VERSION}.jar ./

gaborbarna / sample-job.yaml

Last active January 18, 2021 13:11

	kubectl --context data-services.us-west-2a --namespace tools apply -f job.yaml
	kubectl --context data-services.us-west-2a --namespace tools get pods --selector=job-name=oit-test
	kubectl --context data-services.us-west-2a --namespace tools logs <pod name>

gaborbarna / red.c

Last active December 23, 2017 14:48

gaborbarna / NodeDataVR.cs

Created September 7, 2017 22:06

	using EpForceDirectedGraph.cs;

	public class NodeDataVR : NodeData
	{
	public NodeDataVR(JSONObject entity) {
	this.jsonObject = entity;
	this.label = entity ["id"].str;
	}

	public JSONObject jsonObject { get; set; }

gaborbarna / gist:5352800

Created April 10, 2013 08:19

	import maf, os
	maf.setBasedir( os.path.dirname( os.path.abspath( __file__ ) ) )

	import pkgutil
	import argparse
	import management2.tasks
	import inspect
	from maf.application.management.application import Application
	import config
	from management2.registry import provide_resource

gaborbarna / hash-test.clj

Last active December 12, 2015 01:58

	(ns hash-test.core
	(:require [criterium.core :as crit]))

	(defn fill-with-into [items]
	(into {} (map vec items)))

	(defn no-assoc [items]
	(apply hash-map items))

	(defn assoc-all [items]

gaborbarna / stat-server.coffee

Created December 14, 2012 05:48

	_ = require 'underscore'
	http = require 'http'
	fs = require 'fs'
	sys = require 'sys'
	os = require 'os'
	exec = (require 'child_process').exec
	udp = require 'dgram'
	hostname = (require 'os').hostname()
	iface = 'wlan0'
	udp_port = 8125

gaborbarna / stat-server.coffee

Created December 14, 2012 05:47

	_ = require 'underscore'
	http = require 'http'
	fs = require 'fs'
	sys = require 'sys'
	os = require 'os'
	exec = (require 'child_process').exec
	udp = require 'dgram'
	hostname = (require 'os').hostname()
	iface = 'wlan0'
	udp_port = 8125

gaborbarna / *Messages*.txt

Created December 14, 2012 05:45

	Wrote /home/lesbroot/.emacs.d/elpa/pcache-0.2.3/pcache.elc
	Checking /home/lesbroot/.emacs.d/elpa/pcache-0.2.3...
	Done (Total of 2 files compiled, 1 skipped)
	Contacting host: marmalade-repo.org:80
	Parsing tar file...done
	Extracting gh-0.5.3/
	Extracting gh-0.5.3/gh-common.el
	Wrote /home/lesbroot/.emacs.d/elpa/gh-0.5.3/gh-common.el
	Extracting gh-0.5.3/README
	Wrote /home/lesbroot/.emacs.d/elpa/gh-0.5.3/README