1# AI Gateway SDK Integration
2 
3## Vercel AI SDK (Recommended)
4 
5```typescript
6import { createAiGateway } from 'ai-gateway-provider';
7import { createOpenAI } from '@ai-sdk/openai';
8import { generateText } from 'ai';
9 
10const gateway = createAiGateway({
11  accountId: process.env.CF_ACCOUNT_ID,
12  gateway: process.env.CF_GATEWAY_ID,
13  apiKey: process.env.CF_API_TOKEN // Optional for auth gateways
14});
15 
16const openai = createOpenAI({ apiKey: process.env.OPENAI_API_KEY });
17 
18// Single model
19const { text } = await generateText({
20  model: gateway(openai('gpt-4o')),
21  prompt: 'Hello'
22});
23 
24// Automatic fallback array
25const { text } = await generateText({
26  model: gateway([
27    openai('gpt-4o'),
28    anthropic('claude-sonnet-4-5'),
29    openai('gpt-4o-mini')
30  ]),
31  prompt: 'Complex task'
32});
33```
34 
35### Options
36 
37```typescript
38model: gateway(openai('gpt-4o'), {
39  cacheKey: 'my-key',
40  cacheTtl: 3600,
41  metadata: { userId: 'u123', team: 'eng' }, // Max 5 entries
42  retries: { maxAttempts: 3, backoff: 'exponential' }
43})
44```
45 
46## OpenAI SDK
47 
48```typescript
49const client = new OpenAI({
50  apiKey: process.env.OPENAI_API_KEY,
51  baseURL: `https://gateway.ai.cloudflare.com/v1/${accountId}/${gatewayId}/openai`,
52  defaultHeaders: { 'cf-aig-authorization': `Bearer ${cfToken}` }
53});
54 
55// Unified API - switch providers via model name
56model: 'openai/gpt-4o'  // or 'anthropic/claude-sonnet-4-5'
57```
58 
59## Anthropic SDK
60 
61```typescript
62const client = new Anthropic({
63  apiKey: process.env.ANTHROPIC_API_KEY,
64  baseURL: `https://gateway.ai.cloudflare.com/v1/${accountId}/${gatewayId}/anthropic`,
65  defaultHeaders: { 'cf-aig-authorization': `Bearer ${cfToken}` }
66});
67```
68 
69## Workers AI Binding
70 
71```toml
72# wrangler.toml
73[ai]
74binding = "AI"
75[[ai.gateway]]
76id = "my-gateway"
77```
78 
79```typescript
80await env.AI.run('@cf/meta/llama-3-8b-instruct', 
81  { messages: [...] },
82  { gateway: { id: 'my-gateway', metadata: { userId: '123' } } }
83);
84```
85 
86## LangChain / LlamaIndex
87 
88```typescript
89// Use OpenAI SDK pattern with custom baseURL
90new ChatOpenAI({
91  configuration: {
92    baseURL: `https://gateway.ai.cloudflare.com/v1/${accountId}/${gatewayId}/openai`
93  }
94});
95```
96 
97## HTTP / cURL
98 
99```bash
100curl https://gateway.ai.cloudflare.com/v1/{account}/{gateway}/openai/chat/completions \
101  -H "Authorization: Bearer $OPENAI_KEY" \
102  -H "cf-aig-authorization: Bearer $CF_TOKEN" \
103  -H "cf-aig-metadata: {\"userId\":\"123\"}" \
104  -d '{"model":"gpt-4o","messages":[...]}'
105```
106 
107## Headers Reference
108 
109| Header | Purpose |
110|--------|---------|
111| `cf-aig-authorization` | Gateway auth token |
112| `cf-aig-metadata` | JSON object (max 5 keys) |
113| `cf-aig-cache-ttl` | Cache TTL in seconds |
114| `cf-aig-skip-cache` | `true` to bypass cache |
115