Igor Kupczyński igor-kupczynski

Local LLM Setup with Ollama + Open WebUI + SearxNG

This setup gives you a private, local ChatGPT-like interface with web search capabilities.

What's Included

Ollama - Runs LLMs locally on your GPU
Open WebUI - Clean web interface (like ChatGPT) to chat with your models
SearxNG - Private meta-search engine that Open WebUI can use for web searches

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

	--langdef=Scala
	--langmap=Scala:.scala
	--regex-Scala=/^[ \t](((implicit\|private\|public)?[ \t])(\[[a-zA-Z0-9_]\])?[ \t])class[ \t]*([a-zA-Z0-9_]+)/\5/c,classes/
	--regex-Scala=/^[ \t](((implicit\|private\|public)?[ \t])(\[[a-zA-Z0-9_]\])?[ \t])object[ \t]*([a-zA-Z0-9_]+)/\5/o,objects/
	--regex-Scala=/^[ \t]trait[ \t]([a-zA-Z0-9_]+)/\1/t,traits/
	--regex-Scala=/^[ \t]case[ \t]class[ \t]*([a-zA-Z0-9_]+)/\1/r,cclasses/
	--regex-Scala=/^[ \t]abstract[ \t]class[ \t]*([a-zA-Z0-9_]+)/\1/a,aclasses/
	--regex-Scala=/[ \t](((implicit\|override\|lazy\|private\|public)?[ \t])(\[[a-zA-Z0-9_]\])?[ \t])def[ \t]([a-zA-Z0-9_=]+)[ \t].*[:={]/\5/m,methods/
	--regex-Scala=/[ \t](((override\|lazy\|private\|public)?[ \t])(\[[a-zA-Z0-9_]\])?[ \t])val[ \t]([a-zA-Z0-9_]+)[ \t][:=]/\5/V,values/
	--regex-Scala=/[ \t](((override\|lazy\|private\|public)?[ \t])(\[[a-zA-Z0-9_]\])?[ \t])var[ \t]([a-zA-Z0-9_]+)[ \t][:=]/\5/v,variables/

Igor Kupczyński igor-kupczynski

Local LLM Setup with Ollama + Open WebUI + SearxNG

What's Included

Anti-hype LLM reading list

Foundational Concepts

Pre-Transformer Models