What an AI engineer actually does all week
Less model training than you might think, and more evaluation, plumbing and product judgement.
, 6 minute read
"AI engineer" has become one of the most-used job titles in technology, and one of the least consistently defined. In most organisations, though, the role has settled into a recognisable shape: a software engineer who builds product features on top of existing models rather than training models from scratch.
A realistic week
- Turning a vague request ("can the assistant summarise contracts?") into a testable specification with examples of good and bad output.
- Building the retrieval, prompting and tool-calling code that makes the feature work.
- Writing and running evaluations, then deciding whether a change actually improved quality.
- Watching production traces for failures, cost spikes and latency, and fixing the causes.
- Explaining trade-offs to product and legal colleagues: what the system can reliably do, and what it shouldn't be trusted with.
The skills that matter most
Strong software engineering comes first: APIs, testing, data handling and deployment. On top of that sit three AI-specific skills. The first is evaluation, because without measurement every change is guesswork. The second is retrieval and context design, since most quality problems trace back to what the model was or wasn't shown. The third is judgement about failure: knowing where a model is likely to be wrong and designing the product so those failures are caught, not shipped.
How it differs from ML engineering
Machine learning engineers more often own the model itself: data pipelines for training, feature engineering, training runs and model serving. AI engineers more often own the application around a model someone else trained. The boundary is blurry and moving, and many people do both, but the distinction helps when choosing what to learn first.
If you already build software, the fastest route into this role is usually learning evaluation and retrieval properly, not deep learning theory.