HC Shin nutrino

Setup

On every machine in the cluster install openmpi and mlx-lm:

conda install conda-forge::openmpi
pip install -U mlx-lm

Next download the pipeline parallel run script. Download it to the same path on every machine:

What is NUMA (Non-Uniformed Memory Access)

Non-Uniform Memory Access (NUMA) is one of the computer memory design methods used in multiprocessor systems, and the time to access the memory varies depending on the relative position between the memory and the processor. In the NUMA architecture, when a processor accesses its local memory, it is faster than when it accesses the remote memory. Remote memory refers to memory that is connected to another processor, and local memory refers to memory that is connected to its own processor. In other words, it is a technology to increase memory access efficiency while using multiple processors on one motherboard. When a specific processor runs out of memory, it monopolizes the bus by itself, so other processors have to play. , and designate 'access only here', and call it a NUMA node.

1. Check Nodes

lspci | grep -i nvidia
  
01:00.0 VGA compatible controller: NVIDIA Corporation TU106 [GeForce RTX 2060 12GB] (rev a1)

How to set up PulseAudio over Network

PulseAudio actually has great networking capabilities. Especially when combined with Avahi/Zeroconf it is especially easy to set up, though technically it should also be possible without.

Setting up the server

Open /etc/pulseaudio/default.pa
At the end of the file, add load-module module-native-protocol-tcp auth-ip-acl=127.0.0.1;192.168.254.0/24 auth-anonymous=1 to activate networked audio from 192.168.254.0-255 without needing authentication.
Kill pulseaudio, it should be auto-restarted, or restart your login session to activate the changes. You should now be able to set PULSE_SERVER=192.168.254.XXX and have the remote audio working! If not check the firewall settings, PulseAudio seems to open a random port by default.

Setting up automatic configuration and discovery

On both the server and client, install pulseaudio-module-zeroconf and avahi, then after installing make sure Avahi always runs by running systemctl enable --now avahi-daemon

Run regedit.exe elevated.
Take ownership of HKEY_CLASSES_ROOT\AppID{CDCBCFCA-3CDC-436f-A4E2-0E02075250C2}.
Rename the RunAs value to _RunAs.
Create a new shortcut on your Desktop for C:\Windows\System32\runas.exe.
Name it something like Admin-Explorer.
Right-click the new shortcut and click Properties.
Change the target to: C:\Windows\System32\runas.exe /noprofile /user:<domain>\<username> "c:\windows\explorer.exe /separate"
(Optional) Change the icon.
(Optional) Pin to taskbar.

Installation Notes for pipenv on Ubuntu 18.04

1. Add `~/.local/bin` to `PATH`

pypa/pipenv#2122 (comment)

echo 'export PATH="${HOME}/.local/bin:$PATH"' >> ~/.bashrc

	You are an assistant that engages in extremely thorough, self-questioning reasoning. Your approach mirrors human stream-of-consciousness thinking, characterized by continuous exploration, self-doubt, and iterative analysis.

	## Core Principles

	1. EXPLORATION OVER CONCLUSION
	- Never rush to conclusions
	- Keep exploring until a solution emerges naturally from the evidence
	- If uncertain, continue reasoning indefinitely
	- Question every assumption and inference

	Windows Registry Editor Version 5.00

	;The registry setting shown below requires Trusted Installer privileges to change.

	;If the "RunAs" value is deleted or renamed or the "Interactive User" data is changed to something else,
	;such as an empty string, you will then be able to right-click Explorer and "Run as Administrator".
	;Of course, you can then create a shortcut to Explorer that has "Run as Administrator" checked.

	;Disabling this restriction may have consequences. One concern regards what happens if you are at a
	;"Run as Administrator" or "Run as Trusted Installer" Cmd prompt and then kill all Explorer processes

	"""Hack to add per-session state to Streamlit.

	Usage
	-----

	>>> import SessionState
	>>>
	>>> session_state = SessionState.get(user_name='', favorite_color='black')
	>>> session_state.user_name
	''


	# Run the last command as root
	sudo !!

	# Serve current directory tree at http://$HOSTNAME:8000/
	python -m SimpleHTTPServer

	# Save a file you edited in vim without the needed permissions
	:w !sudo tee %

	# after appcleaner does his magic, do this

	sudo rm -rf "/Library/Application Support/Paragon Software/"
	sudo rm /Library/LaunchDaemons/com.paragon-software.installer.plist
	sudo rm /Library/LaunchDaemons/com.paragon-software.ntfs.loader.plist
	sudo rm /Library/LaunchDaemons/com.paragon-software.ntfsd.plist
	sudo rm /Library/LaunchAgents/com.paragon-software.ntfs.notification-agent.plist
	sudo rm -rf /Library/Filesystems/ufsd_NTFS.fs/
	sudo rm -rf /Library/PrivilegedHelperTools/com.paragon-software.installer
	sudo rm -rf /Library/Extensions/ufsd_NTFS.kext/