1# Workers AI Configuration
2 
3## wrangler.jsonc
4 
5```jsonc
6{
7  "name": "my-ai-worker",
8  "main": "src/index.ts",
9  "compatibility_date": "2024-01-01",
10  "ai": {
11    "binding": "AI"
12  }
13}
14```
15 
16## TypeScript
17 
18```bash
19npm install --save-dev @cloudflare/workers-types
20```
21 
22```typescript
23interface Env {
24  AI: Ai;
25}
26 
27export default {
28  async fetch(request: Request, env: Env) {
29    const response = await env.AI.run('@cf/meta/llama-3.1-8b-instruct', {
30      messages: [{ role: 'user', content: 'Hello' }]
31    });
32    return Response.json(response);
33  }
34};
35```
36 
37## Local Development
38 
39```bash
40wrangler dev --remote  # Required for AI - no local inference
41```
42 
43## REST API
44 
45```typescript
46const response = await fetch(
47  `https://api.cloudflare.com/client/v4/accounts/${ACCOUNT_ID}/ai/run/@cf/meta/llama-3.1-8b-instruct`,
48  {
49    method: 'POST',
50    headers: { 'Authorization': `Bearer ${API_TOKEN}` },
51    body: JSON.stringify({ messages: [{ role: 'user', content: 'Hello' }] })
52  }
53);
54```
55 
56Create API token at: dash.cloudflare.com/profile/api-tokens (Workers AI - Read permission)
57 
58## SDK Compatibility
59 
60**OpenAI SDK:**
61```typescript
62import OpenAI from 'openai';
63const client = new OpenAI({
64  apiKey: env.CLOUDFLARE_API_TOKEN,
65  baseURL: `https://api.cloudflare.com/client/v4/accounts/${env.ACCOUNT_ID}/ai/v1`
66});
67```
68 
69## Multi-Model Setup
70 
71```typescript
72const MODELS = {
73  chat: '@cf/meta/llama-3.1-8b-instruct',
74  embed: '@cf/baai/bge-base-en-v1.5',
75  image: '@cf/stabilityai/stable-diffusion-xl-base-1.0'
76};
77```
78 
79## RAG Setup (with Vectorize)
80 
81```jsonc
82{
83  "ai": { "binding": "AI" },
84  "vectorize": {
85    "bindings": [{ "binding": "VECTORIZE", "index_name": "embeddings-index" }]
86  }
87}
88```
89 
90## Troubleshooting
91 
92| Error | Fix |
93|-------|-----|
94| `env.AI is undefined` | Check `ai` binding in wrangler.jsonc |
95| Local AI doesn't work | Use `wrangler dev --remote` |
96| Type 'Ai' not found | Install `@cloudflare/workers-types` |
97| @cloudflare/ai package error | Don't install - use native binding |
98