A Prompt Engineering Checklist
This checklist distills the strategic principles from this book into a practical tool you can use every time you write, review, or deploy a prompt. Print it, bookmark it, or integrate it into your workflow.
Before Writing the Prompt
- Define the goal: What specific outcome does this prompt need to produce?
- Identify the audience: Who will see the output? What are their expectations?
- Set the token budget: What is the maximum acceptable cost per request?
- Choose the model tier: Does this task require a frontier model, or will a smaller model suffice?
- Check for existing prompts: Has someone in the organization already solved this problem?
While Writing the Prompt
- Be explicit: State every requirement, constraint, and expectation. Assume no shared context.
- Structure clearly: Use sections, delimiters, and consistent formatting.
- Include examples: Show the model what good output looks like.
- Specify the output format: Define exactly how the response should be structured.
- Address edge cases: What should the model do when input is ambiguous, incomplete, or adversarial?
- Add safety guardrails: Include boundaries for harmful content, injection defense, and graceful failure modes.
After Writing the Prompt
- Test with varied inputs: Run at least ten diverse test cases covering happy paths, edge cases, and adversarial inputs.
- Test multiple runs: Run the same input at least five times to check consistency.
- Evaluate all dimensions: Score correctness, consistency, efficiency, safety, and maintainability.
- Review with a colleague: Get a prompt review before deploying to production.
- Document the prompt: Record its purpose, version, test results, and known limitations.
In Production
- Monitor performance: Track success rate, latency, token usage, and error patterns.
- Set up alerts: Define thresholds for anomalies that trigger investigation.
- Maintain a changelog: Record every modification with motivation and measured impact.
- Regression test on changes: Rerun the full test suite after every prompt modification.
- Review periodically: Schedule regular reviews to catch drift and optimization opportunities.
This checklist is a starting point. Adapt it to your organization's needs and revisit it as your prompt engineering practice matures. For hands-on practice applying these principles, explore the Prompt Engineering course on FreeAcademy.