Prompt Smithing
ELI5 — The Vibe Check
Prompt smithing is the craft of shaping prompts through deliberate iteration — testing, tweaking, measuring. Not vibes-based prompting. Real engineering applied to prompt design.
Real Talk
Prompt smithing is the disciplined practice of prompt engineering: versioning prompts, A/B testing variants, measuring outputs against evals, and iterating systematically. Distinguishes professional prompt engineering from ad-hoc prompting. Tools: LangSmith, Humanloop, Promptlayer for prompt versioning and evaluation.
When You'll Hear This
"Two weeks of prompt smithing got our eval score from 72% to 91%." / "Hire a promptsmith — don't just vibe it."
Related Terms
Prompt Engineering
Prompt engineering is the art of talking to AI so it actually does what you want.
Prompt Surgery
Prompt surgery is surgically editing your prompt to fix a specific failure, rather than rewriting the whole thing.
Promptsmith
A promptsmith is someone who specializes in crafting prompts. Not a prompt engineer (too corporate). Not a prompt whisperer (too mystical).