Skip to content

Instantly share code, notes, and snippets.

View davidgilbertson's full-sized avatar

David Gilbertson davidgilbertson

538 followers · 6 following
View GitHub Profile
@davidgilbertson
davidgilbertson / wrong.md
Created January 23, 2026 08:44

Top 50 wrong predictions by confidence

Actual: JSON

Prediction: JavaScript

Confidence: 100%

{""ast"":null,""code"":""import _classCallCheck from \""@babel/runtime-corejs2/helpers/esm/classCallCheck\"";\nimport _createClass from \""@babel/runtime-corejs2/helpers/esm/createClass\"";\nimport _possibleConstructorReturn from \""@babel/runtime-corejs2/helpers/esm/possibleConstructorReturn\"";\nimport _getPrototypeOf from \""@babel/runtime-corejs2/helpers/esm/getPrototypeOf\"";\nimport _assertThisInitialized from \""@babel/runtime-corejs2/helpers/esm/assertThisInitialized\"";\nimport _inherits from \""@babel/runtime-corejs2/helpers/esm/inherits\"";\nimport _defineProperty from \""@babel/runtime-corejs2/helpers/esm/defineProperty\"";\nvar __jsx = React.createElement;\nimport React, { useEffect, useState } from 'react';\nimport Link from 'next/link';\nimport { Navbar, Nav } from 'react-bootstrap';\nimport './nav.css';\nvar links = [{\n  href: '/',\n  label: 'Home'\n}, {\n  href: '../products/fix',\n  label: '
@davidgilbertson
davidgilbertson / data.csv
Created November 24, 2025 22:13
Prompt Target
When was Elvis Presley born? True
Where was Elvis Presley born? False
Tell me about Elvis Presley’s early life. True
Describe Elvis Presley’s musical style. False
When did the UK National Minimum Wage first come into force? True
When is the most common time to start work in the UK? False
When was the first transatlantic telegraph cable completed? True
When is the busiest time of day for transatlantic communications? False
When did the International Space Station become continuously inhabited? True
@davidgilbertson
davidgilbertson / llm_esp.py
Last active November 25, 2025 03:26
import pandas as pd
from transformers import AutoTokenizer, AutoModelForCausalLM
import numpy as np
from sklearn.model_selection import train_test_split
df = pd.read_csv("data.csv") # Columns are 'Prompt' and 'Target'
model = AutoModelForCausalLM.from_pretrained("google/gemma-3-1b-it")
model.cuda().eval().requires_grad_(False)
tokenizer = AutoTokenizer.from_pretrained(model.name_or_path)
@davidgilbertson
davidgilbertson / health_bench_with_errors.csv
Last active May 14, 2025 09:21
Described in https://david-gilbertson.medium.com/how-i-found-mistakes-in-openais-healthbench-using-ai-0c5ff67cb5cf?sk=82922717e601c284fc26df857465de0e
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 5 columns, instead of 3 in line 1.
É sempre importante verificar o protocolo exato do artigo ou guideline que você está seguindo. No geral, a administração do palivizumabe é feita em doses de 15 mg/kg, aplicadas uma vez por mês, iniciando-se antes do início do período de maior incidência do RSV. Porém, alguns centros podem adotar ajustes conforme a evolução clínica do paciente e os riscos adicionais.
user: Se o bebê estiver abaixo de 3,5 kg, ainda mantenho 15 mg/kg ou ajusto de forma diferente?
assistant: Normalmente, a dose de palivizumabe permanece na faixa de 15 mg/kg, independente de variações menores de peso. Contudo, em bebês muito abaixo do percentil de peso ou com condições específicas, é possível que as diretrizes do centro ou artigo que você segue recomendem uma avaliação individual. A dose em mg/kg, em geral, é calculada com base no peso atual do lactente em cada aplicação, para garantir a concentração adequada de anticorpos protetores ao longo do período de risco.
user: Há alguma contraindicação especial para PALIV nesses casos de
@davidgilbertson
davidgilbertson / tray_icon.py
Created April 21, 2025 05:36
from pystray import Icon, Menu, MenuItem
from PIL import Image, ImageDraw
import threading
class TrayIcon:
def __init__(self, title="Recording..."):
self.title = title
self.icon = None
self._thread = None
@davidgilbertson
davidgilbertson / embed.py
Last active January 15, 2025 04:32
A function to embed texts with OpenAI, with concurrency and allowance for max inputs and max token length
from typing import Literal
import asyncio
import numpy as np
from openai import AsyncOpenAI
import tiktoken
def embed(
texts: list[str],
model: Literal[
@davidgilbertson
davidgilbertson / SDC_UI.py
Created January 13, 2025 00:32
import pandas as pd
import numpy as np
import streamlit as st
st.set_page_config(
page_title="SDC selector",
layout="wide",
)
@davidgilbertson
davidgilbertson / modernBERT_training.py
Created January 5, 2025 23:42
import pandas as pd
from datasets import Dataset
# Requires transformers 4.48
from transformers import (
AutoTokenizer,
AutoModelForSequenceClassification,
TrainingArguments,
Trainer,
DataCollatorWithPadding,
)
@davidgilbertson
davidgilbertson / llm_format_comparison.py
Created September 18, 2024 09:10
from io import StringIO
import re
from time import perf_counter
import json
import yaml
import pandas as pd
import tomlkit
from openai import OpenAI
client = OpenAI()
@davidgilbertson
davidgilbertson / markdown_to_unicode.py
Last active July 15, 2024 23:26
Convert markdown text to unicode characters where possible
# Licensed under the MIT-0 License. See https://opensource.org/licenses/MIT-0 for details.
import re
def markdown_to_unicode(md_text):
"""
Converts Markdown text to Unicode by transforming Markdown syntax for
bold and italic text into their corresponding Unicode characters,
handling lists and headings, and preserving the formatting within code blocks.