Prompts Index

Prompts are reusable templates that define how agents and tools interact with LLMs.

Prompt Categories

Evaluation Prompts

Path: prompts/evaluation/

Templates for quality assessment tasks.

Research Prompts

Path: prompts/research/

Templates for information gathering and synthesis.

Agent System Prompts

Path: prompts/agent-system/

System prompts for agent definitions.

Prompt Template Format

Standard Structure

# Prompt Name

## Purpose
Brief description of what this prompt accomplishes.

## Prompt Template

[The actual prompt with {{variables}}]

## Variables
| Variable | Description | Required |
|----------|-------------|----------|
| var_name | What it contains | Yes/No |

## Example Usage
Concrete example showing inputs and expected outputs.

## Best Practices
Guidelines for using this prompt effectively.

Variable Syntax

Use Handlebars-style templating:

{{variable}}                 # Simple substitution
{{#if condition}}...{{/if}} # Conditional section
{{#each array}}...{{/each}} # Iteration

Prompt Design Principles

1. Clear Role Definition

Tell the model exactly what it is and what it's doing.

You are an expert evaluator assessing the quality of AI-generated responses.

2. Explicit Instructions

Don't assume the model will infer requirements.

For each criterion:
1. First, identify specific evidence from the response
2. Then, determine the appropriate score based on the rubric
3. Finally, provide actionable feedback

3. Structured Output

Specify the exact format you need.

Format your response as structured JSON:

{ "scores": [...], "summary": {...} }

4. Guard Rails

Include constraints and warnings.

Important Guidelines:
- Do NOT prefer responses simply because they are longer
- Do NOT prefer responses based on their position (A vs B)
- Focus on the specified criteria

Adding New Prompts

1. Determine category or create new: prompts/<category>/
2. Create prompt file: prompts/<category>/<prompt-name>.md
3. Include:

• Purpose
• Template with variables
• Variable documentation
• Example usage
• Best practices

1. Update this index

Prompt Testing Checklist

• [ ] Variables render correctly
• [ ] Output format is parseable
• [ ] Edge cases are handled
• [ ] Instructions are unambiguous
• [ ] Examples match expected output
• [ ] Constraints are clear