Prompt Engineer skills & stack
The skills and tools employers expect from a Prompt Engineer, plus what each level is expected to own.
Core skills
Prompt design & testingEvals / A-B testingContext & RAGPythonModel behavior analysis
Typical stack & tools
OpenAI / Anthropic SDKsPythonEval frameworks (e.g. promptfoo)LangSmith / LangfuseVector DBs / RAGNotebook tooling
What you'll actually do
- •Design, version, and systematically test prompts against eval sets
- •Build prompt + eval pipelines so quality is measured, not guessed
- •Engineer context: retrieval, formatting, and few-shot selection
- •Diagnose and fix model failure modes (hallucination, refusal, drift)
- •Partner with engineers and PMs to ship prompt changes safely
Skills by level
- Junior
- Iterates prompts against provided evals for a single feature.
- Mid
- Owns prompts + eval pipelines for a product; drives measurable quality gains.
- Senior
- Sets prompting/eval standards and mentors; bridges into agent engineering.
Browse open Prompt Engineer roles on the live board.
See Prompt Engineer jobs