Skip to content

Instantly share code, notes, and snippets.

@monday8am
Last active December 9, 2025 17:20
Show Gist options
  • Select an option

  • Save monday8am/f5fc3d2a02791cfcce709e4c1a92958f to your computer and use it in GitHub Desktop.

Select an option

Save monday8am/f5fc3d2a02791cfcce709e4c1a92958f to your computer and use it in GitHub Desktop.
Koog framework using local inference engine
Layer Component Role
Koog LLMClient Interface Koog expects
Bridge LocalInferenceLLMClient Adapter implementing Koog's interface
Bridge PromptExecuter:(Str) → Str? Function passed at construction
Bridge LocalInferenceEngine Platform-agnostic interface
Platform LiteRTLmInferenceEngineImpl Android-specific implementation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment