Erik van Widenfelt erikvw

https://docs.vllm.ai/en/latest/getting_started/installation/cpu/#apple-silicon

Installing on Macbook Pro M1

After a successful build according to the docs, the server fails to start. This error is the issue:

WARNING 02-01 16:22:28 [interface.py:219] Failed to import from vllm._C: ImportError('dlopen(/Users/erikvw/vllm/vllm/_C.abi3.so, 0x0002): Symbol not found: __ZN3c1013MessageLoggerC1EPKcii\n Referenced from: /Users/erikvw/vllm/vllm/_C.abi3.so\n Expected in: <8D97C466-D00B-36C7-8E36-A2E591A516BD> /Users/erikvw/vllm/.venv/lib/python3.12/site-packages/torch/lib/libc10.dylib')

Made some slight changes to the build to resolve the above error

remove old .venv and clear uv cache

1. Setup ODBC on your Mac (including Apple Silicon)

Install brew

https://brew.sh

unixodbc package from brew works for Apple Silicon

See https://formulae.brew.sh/formula/unixodbc#default

AWS_ACCESS_KEY_ID=
AWS_DEFAULT_ACL=None
AWS_ENABLED=False
AWS_LOCATION=mocca/static
AWS_S3_CUSTOM_DOMAIN=
AWS_S3_ENDPOINT_URL=
AWS_SECRET_ACCESS_KEY=
AWS_STORAGE_BUCKET_NAME=
CDN_ENABLED=False

	# Running multipass on a mac (M1)
	# minconda won't work since the conda does not support a linux os on M1
	# use pyenv to get the python version need (3.12 here)
	# use python venv to creat a virtual environment

	# install pyenv
	sudo apt update; sudo apt install build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev curl libncursesw5-dev xz-utils tk-dev libxml2-dev libxmlsec1-dev libffi-dev liblzma-dev

	curl https://pyenv.run \| bash

	# Got ...
	#
	#ImportError: dlopen(/Users/erikvw/miniconda3/envs/edc-dev/lib/python3.9/site-packages/cups.cpython-39-darwin.so, 0x0002): Symbol not found: _libiconv
	# Referenced from: /Users/erikvw/miniconda3/envs/edc-dev/lib/python3.9/site-packages/cups.cpython-39-darwin.so
	# Expected in: /usr/lib/libiconv.2.dylib
	#
	#
	# Before building pycups ...

	# install cups from brew

	export PS1="\u@\h:\w$ "

	function parse_git_branch() {
	git branch 2> /dev/null \| sed -e '/^[^]/d' -e 's/ \(.\)/\\1/'
	}

	if [ "$color_prompt" = yes ]; then
	PS1='\[\033[01;36m\]\u@\[\033[00m\]:\[\033[01;33m\]\w\[\033[0;35m\]-($(parse_git_branch))\[\033[00m\]\$ '
	else
	PS1='\u@\h:\w$(parse_git_branch)\$ '

	. "$HOME/.duplicity/.env_variables.conf"

	duplicity list-current-files $AWS_ENDPOINT/$AWS_BUCKET

	unset AWS_ACCESS_KEY_ID
	unset AWS_SECRET_ACCESS_KEY
	unset AWS_ENDPOINT
	unset AWS_BUCKET
	unset GPG_KEY
	unset PASSPHRASE

	# restores archive file to the given folder.
	# then run mysql dbname < archive_file.sql

	. "$HOME/.duplicity/.env_variables.conf"

	# note will fail if file exists
	duplicity --verbosity info \
	--encrypt-sign-key=$GPG_KEY \
	--log-file $HOME/.duplicity/info.log \
	--file-to-restore $1 \

	export AWS_ACCESS_KEY_ID=
	export AWS_SECRET_ACCESS_KEY=
	export AWS_BUCKET=
	export AWS_ENDPOINT=
	export GPG_KEY=
	export PASSPHRASE=
	export DB_NAME=
	export DB_DATE=$(date +%Y%m%d%H%M%S)
	export BACKUP_DIR=$HOME/mysql_backup/
	export DB_FILE=$BACKUP_DIR$DB_NAME-$DB_DATE.sql

	#!/bin/bash

	# ######################################################
	# Use duplicity to backup all files in BACKUP_DIR
	#
	# 1. run mysqldump
	# 2. transfer all *.sql files to AWS_BUCKET w/ duplicity
	# 3. remove all files older than 7 days
	#
	# ######################################################