Peter Naur's classic 1985 essay "Programming as Theory Building" argues that a program is not its source code. A program is a shared mental construct (he uses the word theory) that lives in the minds of the people who work on it. If you lose the people, you lose the program. The code is merely a written representation of the program, and it's lossy, so you can't reconstruct
Austin teleprint-me
teleprint-me
/ programming-as-theory-building.md
Created
October 3, 2024 04:34
— forked from onlurking/programming-as-theory-building.md
Programming as Theory Building - Peter Naur
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /** Lambdas in C. Compile with GCC! | |
| * ███ ▄████████ ███ ▄████████ ███ █▄ ▄██████▄ | |
| *▀█████████▄ ███ ███ ▀█████████▄ ███ ███ ███ ███ ███ ███ | |
| * ▀███▀▀██ ███ █▀ ▀███▀▀██ ███ █▀ ███ ███ ███ ███ | |
| * ███ ▀ ▄███▄▄▄ ███ ▀ ███ ███ ███ ███ ███ | |
| * ███ ▀▀███▀▀▀ ███ ▀███████████ ███ ███ ███ ███ | |
| * ███ ███ █▄ ███ ███ ███ ███ ███ ███ | |
| * ███ ███ ███ ███ ▄█ ███ ███ ███ ███ ███ | |
| * ▄████▀ ██████████ ▄████▀ ▄████████▀ ████████▀ ▀██████▀ | |
| * |
teleprint-me
/ convert.py
Created
March 24, 2024 04:36
— forked from chu-tianxiang/convert.py
Convert grok-1 weight to torch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import numpy as np | |
| import torch | |
| import jax | |
| from tqdm import tqdm | |
| from model import LanguageModelConfig, TransformerConfig, QuantizedWeight8bit as QW8Bit | |
| from runners import InferenceRunner, ModelRunner, sample_from_model | |
| CKPT_PATH = "./checkpoints" |