Gilbert Bagaoisan gbertb

Working on https://spider.cloud — the fastest crawler for LLMs and AI Agents · Reach out if you want to scrape data fast · AI Engineer · Designer

gbertb / spider-crawl.ts

Created August 3, 2025 16:43

spider crawl typescript example

	import { Spider } from "@spider-cloud/spider-client";
	import { JSDOM } from 'jsdom';

	const SPIDER_API_KEY = process.env.SPIDER_API_KEY;
	if (!SPIDER_API_KEY) {
	console.error('Error: SPIDER_API_KEY environment variable is not set');
	console.error('Please run: export SPIDER_API_KEY=your-api-key');
	process.exit(1);
	}

gbertb / spider_crawl_jsonlines.py

Created May 5, 2025 06:37

Spider Streaming Results Example

	import os
	import requests
	import argparse
	import time
	import logging
	import logging.handlers
	from pathlib import Path
	from datetime import datetime
	from typing import Dict
	import jsonlines

gbertb / spider_crewai_stock_research.py

Created May 13, 2024 05:16

CrewAI + Spider Stock Research Assistant

	from dotenv import load_dotenv
	from crewai import Task, Process
	from crewai import Agent, Crew
	from crewai_tools import SerperDevTool, tool
	from langchain_community.document_loaders import SpiderLoader
	from langchain_core.prompts import PromptTemplate
	from langchain_openai import ChatOpenAI
	from langchain.chains.combine_documents.stuff import StuffDocumentsChain, LLMChain
	from typing import List

gbertb / macOS Internals.md

Created May 8, 2023 16:12 — forked from kconner/macOS Internals.md

macOS Internals

Understand your Mac and iPhone more deeply by tracing the evolution of Mac OS X from prelease to Swift. John Siracusa delivers the details.

Starting Points

You've got two main options:

gbertb / dispatch_openai_requests.py

Created May 3, 2023 04:19 — forked from neubig/dispatch_openai_requests.py

A simple script to get results from the OpenAI Asynchronous API

	import openai
	import asyncio
	from typing import Any

	async def dispatch_openai_requests(
	messages_list: list[list[dict[str,Any]]],
	model: str,
	temperature: float,
	max_tokens: int,
	top_p: float,

gbertb / middleware.ts

Created April 23, 2023 03:25 — forked from perkinsjr/middleware.ts

Using Clerk with Upstash for Middleware rate limiting and API Protection

	import { getAuth, withClerkMiddleware } from "@clerk/nextjs/server";
	import { NextResponse, NextFetchEvent } from "next/server";
	import type { NextRequest } from "next/server";
	import { Ratelimit } from "@upstash/ratelimit";
	import { Redis } from "@upstash/redis";

	// Add public paths for Clerk to handle.
	const publicPaths = ["/", "/sign-in", "/sign-up", "/api/blocked"];

	// set your rate limit.

gbertb / promptlayer.js

Created March 26, 2023 20:37

example promptlayer call

	var requestStartTime = Date.now()

	const stream = new ReadableStream({
	async start(controller) {
	const onParse = (event: ParsedEvent \| ReconnectInterval) => {
	if (event.type === "event") {
	const data = event.data;

	if (data === "[DONE]") {
	controller.close();

gbertb / list.md

Created November 18, 2020 00:12 — forked from ih2502mk/list.md

Quantopian Lectures Saved

Lecture 1: Introduction to Research — [📝Lecture Notebooks] [▶️Video]
Lecture 2: Introduction to Python — [📝Lecture Notebooks] [▶️Video]
Lecture 3: Introduction to NumPy — [📝Lecture Notebooks] [▶️Video]
Lecture 4: Introduction to pandas — [📝Lecture Notebooks] [▶️Video]
Lecture 5: Plotting Data — [📝Lecture Notebooks] [[▶️Vide

gbertb / twittermute.txt

Created January 25, 2020 19:03 — forked from IanColdwater/twittermute.txt

Here are some terms to mute on Twitter to clean your timeline up a bit.

	Mute these words in your settings here: https://twitter.com/settings/muted_keywords

	ActivityTweet
	generic_activity_highlights
	generic_activity_momentsbreaking
	RankedOrganicTweet
	suggest_activity
	suggest_activity_feed
	suggest_activity_highlights
	suggest_activity_tweet

gbertb / playAudio.swift

Created November 5, 2018 02:54

Play Audio after completing quiz

	func playAudio() {

	do {
	if let fileURL = Bundle.main.path(forResource: "Game Show Win", ofType: "wav") {
	audioPlayer = try AVAudioPlayer(contentsOf: URL(fileURLWithPath: fileURL))
	audioPlayer?.volume = 0.4
	} else {
	print("No file with specified name exists")
	}
	} catch let error {