Skip to content

Instantly share code, notes, and snippets.

@conwid

conwid/09 inferencebackend

Created May 19, 2025 19:59
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save conwid/30981b73f094b61ae4df69320d9ff67b to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save conwid/30981b73f094b61ae4df69320d9ff67b to your computer and use it in GitHub Desktop.
Download ZIP
Gist created from visual studio extension
Raw
09 inferencebackend
public class CustomInferenceBackend(IConfiguration configuration) : IInferenceBackend
{
private readonly OpenAIInferenceBackend openAIInferenceBackend = new OpenAIInferenceBackend(configuration);
public async Task<string> GetChatResponseAsync(ChatParameters options)
{
var resp = await openAIInferenceBackend.GetChatResponseAsync(options);
return resp;
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment