neelabalan neelabalan

This is Felix Kuehling, long time KFD driver architect. I started looking into the TinyGrad source code yesterday, focusing on ops_kfd.py, ops_hsa.py and driver/hsa.py, to understand how TinyGrad talks to our HW and help with the ongoing debugging effort from the top down. This analysis is based on this commit: https://github.com/tinygrad/tinygrad/tree/3de855ea50d72238deac14fc05cda2a611497778

I'm intrigued by the use of Python for low-level programming. I think I can learn something from your use of ctypes and clang2py for fast prototyping and test development. I want to share some observations based on my initial review.

ops_kfd looks pretty new, and I see many problems with it based on my long experience working on KFD. I think it's interesting, but probably not relevant for the most pressing problems at hand, so I'll cover that last.

ops_hsa uses ROCr APIs to manage GPU memory, create a user mode AQL queue for GPU kernel dispatch, async SDMA copies, and signal-based synchronization with barrier packets

Python + Redis

API get

Running 30s test @ http://rpi:5000/api/v1/url/aaaa
  12 threads and 400 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   489.29ms  196.29ms   1.38s    82.02%
    Req/Sec    68.43     31.64   192.00     72.98%

Docker Commands, Help & Tips

Show commands & management commands

$ docker

Docker version info

The repository for the assignment is public and Github does not allow the creation of private forks for public repositories.

The correct way of creating a private frok by duplicating the repo is documented here.

For this assignment the commands are:

Create a bare clone of the repository. (This is temporary and will be removed so just do it wherever.)

git clone --bare [email protected]:usi-systems/easytrace.git

1xx: Information

Code	Message	Description
100	Continue	The server has received the request headers, and the client should proceed to send the request body
101	Switching Protocols	The requester has asked the server to switch protocols
103	Checkpoint	Used in the resumable requests proposal to resume aborted PUT or POST requests

2xx: Successful

Code	Message	Description

	""" To use: install LLM studio (or Ollama), clone OpenVoice, run this script in the OpenVoice directory
	git clone https://github.com/myshell-ai/OpenVoice
	cd OpenVoice
	git clone https://huggingface.co/myshell-ai/OpenVoice
	cp -r OpenVoice/* .
	pip install whisper pynput pyaudio
	"""

	from openai import OpenAI
	import time

	#!/usr/bin/env python3
	import os
	from datetime import datetime, timezone
	from pathlib import Path

	from prompt_toolkit import PromptSession
	from prompt_toolkit.history import FileHistory
	import openai
	from rich.console import Console
	from rich.markdown import Markdown

	from datetime import datetime
	from typing import Optional

	import pandas as pd
	from rich import box
	from rich.console import Console
	from rich.table import Table

	console = Console()

	from collections import defaultdict
	from time import perf_counter

	import trio
	from attr import attrs, attr


	@attrs(slots=True)
	class TimeInfo:
	deschedule_start = attr(type=float, default=0)

	#Newbie programmer
	def factorial(x):
	if x == 0:
	return 1
	else:
	return x * factorial(x - 1)
	print factorial(6)


	#First year programmer, studied Pascal