Prompt drafting
'Given this task description + 3 examples, write a system prompt that would make an assistant produce correct outputs.' Cheap starting point.
Advertisement
Prompt critique
'Here is my prompt + 5 failing outputs. Diagnose why the prompt fails + suggest changes.' Excellent for debugging.
Advertisement
APE (Automatic Prompt Engineer)
Zhou et al 2022. Search over candidate prompts, evaluate each on task, pick winner. Reinforcement-learning flavor.
DSPy
Framework: declare task signature, framework compiles + optimizes prompts. Removes hand-tuning entirely.