Will Foster sadsfae

QUADS LLM Inference Architecture Design Document

Document Information

Version: 1.1
Date: September 2025
Author: Perf/Scale DevOps Team
Status: Draft

IRC Reference

Not intended as a guide for newbies, more like a "cheat sheet" for the somewhat experienced IRC user, especially one who wields some power over a channel.

The Basics

/join #channel
- Joins the specified channel.
/part #channel
Leaves the specified channel.

	#! /usr/bin/env python3

	import yaml
	import urllib3
	import os
	from dotenv import load_dotenv
	from quads_lib import QuadsApi

	load_dotenv()

	#! /usr/bin/env python3

	import re
	from quads.quads_api import QuadsApi
	from quads.config import Config

	quads = QuadsApi(Config)

	hosts = quads.get_hosts()
	pattern = r"^(?P<rack>[^-]+)-(?P<uloc>[^-]+)-(?P<blade>[^-]+)-(?P<host_type>[^.]+)\.(?P<domain>.+)$"

	#! /usr/bin/env python
	import asyncio
	from datetime import date, datetime

	from quads.config import conf
	from quads.model import Cloud, CloudHistory, Schedule
	from quads.tools.jira import Jira


	async def main(loop):

Will Foster sadsfae

QUADS LLM Inference Architecture Design Document

Document Information

Table of Contents

IRC Reference

The Basics