Nur Kholis M kholis

Intro

Out of the box, my SMB performance on macOS 12.3.1 would top out at around 20MB/s in short ~5 second bursts, which was absolutely horrendous, slow to navigate in Finder and slugish to interact with.

Since making these changes, I now get sustained ~80-100MB/s+ and instant Finder navigation which is superb and how things should be out-of-the-box (OOTB)!

May 2023 update: As of Ventura, the SMB issues were just horribly inconsistent and hard to maintain. Something in the combination of Unraid, macOS and SMB just doesn't play nice. I ended up binning NFS/SMB all together and heading to a locally hosted Nextcloud instance for file syncing, then using SFTP/Ansible Git flow for editing files within appdata.

Sources

HP Smart Storage Admin CLI (`ssacli`) installation and usage on Proxmox PVE (6.x)

Why use HP Smart Storage Admin CLI?

You can use ssacli (smart storage administrator command line interface) tool to manage any of supported HP Smart Array Controllers in your Proxmox host without need to reboot your server to access Smart Storage Administrator in BIOS. That means no host downtime when managing your storage.

CLI is not as convenient as GUI interface provided by BIOS or desktop utilities, but still allows you to fully manage your controller, physical disks and logical drives on the fly with no Proxmox host downtime.

ssacli replaces older hpssacli, but shares the same syntax and adds support for newer servers and controllers.

Installation

Kafka console consumer with Kerberos

1. Create a jaas.conf file with the following contents:

KafkaClient {
   com.sun.security.auth.module.Krb5LoginModule required
   useKeyTab=true
   keyTab="keytabFile.keytab"
   storeKey=true
   useTicketCache=false
   serviceName="kafka"

Install Docker

Download all dependencies from by following the documentation https://docs.docker.com/engine/installation/linux/docker-ce/centos/#install-using-the-repository

yumdownloader --resolve yum-utils device-mapper-persistent-data lvm2
yumdownloader --resolve docker-ce

Copy to master node and install afterwards:

yum install -y *.rpm

Generate ssl certificates with Subject Alt Names on OSX

Open ssl.conf in a text editor.

Edit the domain(s) listed under the [alt_names] section so that they match the local domain name you want to use for your project, e.g.

DNS.1   = my-project.dev

Additional FQDNs can be added if required:

On master and nodes

Pull images form internet access laptop

docker pull gcr.io/google_containers/kube-apiserver-amd64:v1.5.0
docker pull gcr.io/google_containers/kube-controller-manager-amd64:v1.5.0
docker pull gcr.io/google_containers/kube-proxy-amd64:v1.5.0
docker pull gcr.io/google_containers/kube-scheduler-amd64:v1.5.0
docker pull weaveworks/weave-npc:1.8.2
docker pull weaveworks/weave-kube:1.8.2

	Based on ideas here, expanded to enable Hive support
	https://www.linkedin.com/pulse/running-spark-2xx-cloudera-hadoop-distro-cdh-deenar-toraskar-cfa/

	wget https://archive.apache.org/dist/spark/spark-2.4.8/spark-2.4.8-bin-without-hadoop.tgz

	tar -xvzf spark-2.4.8-bin-without-hadoop.tgz
	cd spark-2.4.8-bin-without-hadoop

	cp -R /etc/spark2/conf/* conf/
	cp /etc/hive/conf/hive-site.xml conf/

	# Requirements: kafka-python gssapi krbticket
	import os
	import time
	from kafka import KafkaConsumer, KafkaProducer
	from krbticket import KrbConfig, KrbCommand

	try:
	os.environ['KRB5CCNAME'] = '/tmp/krb5cc_<myusername>'
	kconfig = KrbConfig(principal='araujo', keytab='/path/to/<myusername>.keytab')
	KrbCommand.kinit(kconfig)

	# -- coding: utf-8 --

	"""
	Example of Python Data Frame with SparkSession.
	"""
	from pyspark.conf import SparkConf
	from pyspark.sql import SparkSession
	from pyspark.sql.functions import *
	from pyspark.sql.types import *

	from flask import Flask, request, jsonify, json, abort
	from flask_cors import CORS, cross_origin

	import pandas as pd

	app = Flask(__name__)

	cors = CORS(app)
	app.config['CORS_HEADERS'] = 'Content-Type'