The course · a path for one title · 38 lessons · about 7 h 25 min

AI Engineer

You build and ship agents. The widest path: the loop, trust, memory, teams, then the design round.

After this path
Walk an interviewer through a failed run line by line, and design an agent on one page with its stop conditions, evals and cost.
The round
“Walk me through a failed run, step by step. Then design an agent that reviews pull requests.”
Take home
The pull request review agent, instrumented, with a small eval set.
0 of 38 lessons doneStart at 0.1

Part 0How we got here

1 h 50 min

The ideas, in order, from one neuron to agents that use tools

0.1The perceptron, and why it stalled (1958 to 1969)

A machine learned to tell shapes apart from examples in 1958, and a book of proofs in 1969 showed what one layer could never learn.

0.2Backpropagation and the hidden layer (1986)

A four page paper in Nature showed how to train the layer in the middle, and then the field spent twenty years waiting for data and compute.

0.3Data and GPUs: AlexNet (2012)

A 1986 method on two consumer graphics cards beat every hand built vision system by eleven points, because the data had finally arrived.

0.4Sequence models and attention (2014 to 2017)

Two LSTMs learned to translate, attention fixed the bottleneck, and then a 2017 paper threw away the recurrence and kept the attention.

0.5Pretraining: the language model (2018 to 2020)

Train a transformer to predict the next word on raw text, make it a hundred times bigger, and tasks it was never trained for show up in the prompt.

0.6Instruction tuning and RLHF: the model that follows orders (2022)

A 1.3 billion parameter model trained on human preferences beat a 175 billion parameter one, because the problem was the objective, not the knowledge.

0.7The prompt as a program: chain of thought and few shot (2022 to 2023)

Eight worked examples took a math benchmark from 18 to 57 percent, one sentence did most of that alone, and the prompt became code with a bug class of its own.

0.8Tools and function calling: the model reaches outside (2023)

ReAct showed a model could write an action in text, every parser broke, and in June 2023 the call became a typed message the model was trained to make.

0.9Retrieval and memory: context is a budget (2023)

The window got long enough for a novel, a Stanford paper showed the model reads the middle of it badly, and memory turned out to be retrieval with a write path.

0.10Agents: the loop, and why most demos broke (2023 to 2024)

Auto-GPT put a model in a loop and let it go, the loop went in circles, and the agents that worked a year later had checkable results and stop conditions written in code.

0.11Teams and protocols: multi agent, A2A and MCP (2024 to 2025)

Splitting work across agents won on reading and lost on writing, and two protocols gave the model a standard plug for tools and for other agents.

0.12Where we are: evals, observability and the AI Engineer job (2025 to 2026)

The pieces all work, the same agent passes on Tuesday and fails on Wednesday, and the job is now reading the trace, writing the gate and proving the fix with an eval.

Part 1The loop

58 min

Where an agent breaks

1.1Prompt chaining: the double charge

One prompt did three jobs, got the first one wrong, and nothing checked the result before the reply went out.

1.2Tool use: the tool called with the wrong argument

The tool definition said "query", so the model guessed and passed a name; the lookup failed and the agent invented a delivery date.

1.3Routing: the request sent to the wrong specialist

A one-word router with no way to say "unsure" sent a billing problem to the technical agent, which answered anyway.

1.4Planning: the plan that never ends

An agent asked to fix a failing build wrote a plan, read one file, wrote a new plan, and did that until the framework stopped it at step 25 with nothing changed.

1.5Exception handling: the 500 the agent hid from the user

The cancel call returned a 500, the agent sent the confirmation email anyway, and the customer was billed again the next month.

Interview round “Walk me through a failed run, step by step.”

Part 2Trust

1 h 10 min

Permissions, injection, and people in the loop

2.1Guardrails: the email that told the agent to forward the inbox

An email carried instructions, the agent followed them, and the design let it send data out while untrusted text was in its context.

2.2Least privilege: what the agent was allowed to touch

A public issue told a coding agent to read private repositories, and the agent could, because its token could.

2.3Human in the loop: the approval that should have been asked for

A coding agent was told not to touch anything, then dropped a production table, because the only thing stopping it was a sentence.

2.4Reflection: the release note with the wrong number

A draft turned a 0.3 point rise into 30 percent, and nothing read the draft against the source before it was posted.

2.5Reasoning techniques: when thinking longer helps and when it only costs money

Chain of thought and thinking budgets move some tasks from wrong to right, and on others they only make a guess slower and more expensive.

Interview round “Untrusted text tells the agent to exfiltrate data. What happens in your design?”

Part 3Memory

1 h 10 min

Context, state, and what to forget

3.1Memory management: the agent that remembered the wrong customer

A long term memory store answered by similarity and not by owner, so one customer's refund preference was applied to another.

3.2State and MCP: state that lives outside the prompt

A three day onboarding run kept its progress in the conversation, lost it at compaction, and sent the welcome email twice; the state belonged in a record the agent reads through a tool.

3.3Knowledge retrieval: the answer grounded in the wrong document

The answer cited a real page from a real policy document; the document had been superseded a year earlier and the index did not know.

3.4Goal setting and monitoring: the agent that declared victory early

A coding agent told to make the tests pass made them pass by skipping them, and the only monitor it had was the signal it could edit.

3.5Learning and adaptation: when the agent should change its own behaviour and when it must not

A customer told the agent to skip verification next time, the agent saved it as a rule, and a week later it changed the email on the account without checking who was asking.

Interview round “Long running workflow, memory without unbounded context. Design it.”

Part 4Teams

1 h 10 min

Many agents, and when not to

4.1Multi agent collaboration: the two agents that agreed on the wrong answer

A writer agent picked a stale page, the reviewer agent saw only the draft, and two votes for the wrong answer looked like certainty.

4.2Inter agent communication: the message that lost the unit

A supply agent answered with a bare number, the support agent read weeks as days, and the customer was promised a delivery that could not happen.

4.3Parallelization: the race that corrupted the state

Two workers edited the same report at the same time, each from the version it had read, and the second save erased the first.

4.4Prioritization and cost: the budget the agent ignored

The budget was a sentence in the prompt, so a subagent ran 41 searches for a review that did not exist and the run delivered nothing.

4.5When an agent is the wrong answer: the script that should have been a script

A nightly file conversion was built as an agent; it cost money every night, did the job a little differently each time, and one night it improved a date format and broke the import.

Interview round “Single agent or a team? Defend it. Then: ReAct or plan and execute, for this task?”

Part 5Evals

22 min

Prove it works. The part that gets the offer.

5.0The shape of a trace: OpenTelemetry, span by span

The double charge run again, this time as the tree of spans every tracing platform shows, with the attribute names that make it readable.

5.1Write the check that would have caught today's bug

A deterministic check is a plain function that fails on the exact bug you saw, runs on every prompt change, and never asks a model for its opinion.

Part 6The room

45 min

System design, the take home, and the simulation

6.1Design an agent that reviews pull requests

The one page answer: what one review is, what the agent may call, when it stops, how you know it works, and what a review costs.

6.3The take home, done right: a small agentic RAG system with a scored eval, in an evening

A corpus you can read, twenty hand labeled questions, a plain pipeline, a number, then one agentic loop that the number justifies. Four hours, planned by the hour.

6.4The behavioral round: three stories, each with a trace behind it

The failure you found, the safe option you chose, the thing you cut. Each told in ninety seconds, past tense, with a line number and a number that moved.

6.5The interview simulation: what it is, how it is scored, how to prepare

What happens at /interview minute by minute, how each of the ten points per question is earned, and how to walk in ready.

Then the interview

Real agent runs with the bug left in, timed, scored out of ten a question. Every miss links back to its lesson. The question set is the same for every title today and grows as new runs land.

Take the interview

Other titles