xbalajipge/ai-gateway-notes.md

Last active October 3, 2025 06:25

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/xbalajipge/edd6db566c9445f958652643d79d3be4.js"></script>
Save xbalajipge/edd6db566c9445f958652643d79d3be4 to your computer and use it in GitHub Desktop.

Download ZIP

ai-gateway-notes.md

Raw

ai-gateway-notes.md

 python apitest.py -m "Where is PG&E" -u "https://aws-ai-gateway.nonprod.pge.com/v1"  -M "@bedrock-aigatew-02d091/us.anthropic.claude-sonnet-4-20250514-v1:0" -s "You are a helpful assistant"

python apitest.py -m "Where is PG&E" -u "https://aws-ai-gateway.nonprod.pge.com/v1"  -M "@bedrock-aigatew-02d091/us.anthropic.claude-3-7-so
nnet-20250219-v1:0"

invoking classifer

python eba/python/llm/llm_classify.py --method portkey --api-key "${PORTKEY_WS_API_KEY}"  --portkey-base-url "https://aws-ai-gateway.nonprod.pge.com/v1" --portkey-integration "bedrock-aigatew-02d091" --model "us.anthropic.claude-sonnet-4-20250514-v1:0" --dir eba/data -i merged_remedy_atlas.jsonl --lines 5

 python eba/python/llm/llm_classify.py --method portkey --api-key "${PORTKEY_WS_API_KEY}"  --portkey-base-url "https://aws-ai-gateway.nonprod.pge.com/v1" --portkey-integration "bedrock-aigatew-02d091" --model "us.anthropic.claude-sonnet-4-20250514-v1:0" --dir eba/data -i merged_remedy_atlas.jsonl --lines "1,10"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment