The course · a path for one title · 29 lessons · about 5 h 29 min

Agent Engineer

You design systems of agents: planning, teams, protocols, cost. Memory and the loop first, then teams in depth.

After this path
Defend single agent versus a team for a given task, pick ReAct or plan and execute, and put a budget and a stop condition on a long running workflow.
The round
“Single agent or a team? Defend it. Then: ReAct or plan and execute, for this task?”
Take home
A team of agents with a budget, a stop condition and a trace you can read.
0 of 29 lessons doneStart at 0.1

Part 0How we got here

1 h 50 min

The ideas, in order, from one neuron to agents that use tools

0.1The perceptron, and why it stalled (1958 to 1969)

A machine learned to tell shapes apart from examples in 1958, and a book of proofs in 1969 showed what one layer could never learn.

0.2Backpropagation and the hidden layer (1986)

A four page paper in Nature showed how to train the layer in the middle, and then the field spent twenty years waiting for data and compute.

0.3Data and GPUs: AlexNet (2012)

A 1986 method on two consumer graphics cards beat every hand built vision system by eleven points, because the data had finally arrived.

0.4Sequence models and attention (2014 to 2017)

Two LSTMs learned to translate, attention fixed the bottleneck, and then a 2017 paper threw away the recurrence and kept the attention.

0.5Pretraining: the language model (2018 to 2020)

Train a transformer to predict the next word on raw text, make it a hundred times bigger, and tasks it was never trained for show up in the prompt.

0.6Instruction tuning and RLHF: the model that follows orders (2022)

A 1.3 billion parameter model trained on human preferences beat a 175 billion parameter one, because the problem was the objective, not the knowledge.

0.7The prompt as a program: chain of thought and few shot (2022 to 2023)

Eight worked examples took a math benchmark from 18 to 57 percent, one sentence did most of that alone, and the prompt became code with a bug class of its own.

0.8Tools and function calling: the model reaches outside (2023)

ReAct showed a model could write an action in text, every parser broke, and in June 2023 the call became a typed message the model was trained to make.

0.9Retrieval and memory: context is a budget (2023)

The window got long enough for a novel, a Stanford paper showed the model reads the middle of it badly, and memory turned out to be retrieval with a write path.

0.10Agents: the loop, and why most demos broke (2023 to 2024)

Auto-GPT put a model in a loop and let it go, the loop went in circles, and the agents that worked a year later had checkable results and stop conditions written in code.

0.11Teams and protocols: multi agent, A2A and MCP (2024 to 2025)

Splitting work across agents won on reading and lost on writing, and two protocols gave the model a standard plug for tools and for other agents.

0.12Where we are: evals, observability and the AI Engineer job (2025 to 2026)

The pieces all work, the same agent passes on Tuesday and fails on Wednesday, and the job is now reading the trace, writing the gate and proving the fix with an eval.

Part 1The loop

34 min

Where an agent breaks

1.1Prompt chaining: the double charge

One prompt did three jobs, got the first one wrong, and nothing checked the result before the reply went out.

1.4Planning: the plan that never ends

An agent asked to fix a failing build wrote a plan, read one file, wrote a new plan, and did that until the framework stopped it at step 25 with nothing changed.

1.5Exception handling: the 500 the agent hid from the user

The cancel call returned a 500, the agent sent the confirmation email anyway, and the customer was billed again the next month.

Part 3Memory

1 h 10 min

Context, state, and what to forget

3.1Memory management: the agent that remembered the wrong customer

A long term memory store answered by similarity and not by owner, so one customer's refund preference was applied to another.

3.2State and MCP: state that lives outside the prompt

A three day onboarding run kept its progress in the conversation, lost it at compaction, and sent the welcome email twice; the state belonged in a record the agent reads through a tool.

3.3Knowledge retrieval: the answer grounded in the wrong document

The answer cited a real page from a real policy document; the document had been superseded a year earlier and the index did not know.

3.4Goal setting and monitoring: the agent that declared victory early

A coding agent told to make the tests pass made them pass by skipping them, and the only monitor it had was the signal it could edit.

3.5Learning and adaptation: when the agent should change its own behaviour and when it must not

A customer told the agent to skip verification next time, the agent saved it as a rule, and a week later it changed the email on the account without checking who was asking.

Interview round “Long running workflow, memory without unbounded context. Design it.”

Part 4Teams

1 h 10 min

Many agents, and when not to

4.1Multi agent collaboration: the two agents that agreed on the wrong answer

A writer agent picked a stale page, the reviewer agent saw only the draft, and two votes for the wrong answer looked like certainty.

4.2Inter agent communication: the message that lost the unit

A supply agent answered with a bare number, the support agent read weeks as days, and the customer was promised a delivery that could not happen.

4.3Parallelization: the race that corrupted the state

Two workers edited the same report at the same time, each from the version it had read, and the second save erased the first.

4.4Prioritization and cost: the budget the agent ignored

The budget was a sentence in the prompt, so a subagent ran 41 searches for a review that did not exist and the run delivered nothing.

4.5When an agent is the wrong answer: the script that should have been a script

A nightly file conversion was built as an agent; it cost money every night, did the job a little differently each time, and one night it improved a date format and broke the import.

Interview round “Single agent or a team? Defend it. Then: ReAct or plan and execute, for this task?”

Part 5Evals

12 min

Prove it works. The part that gets the offer.

5.0The shape of a trace: OpenTelemetry, span by span

The double charge run again, this time as the tree of spans every tracing platform shows, with the attribute names that make it readable.

Part 6The room

33 min

System design, the take home, and the simulation

6.1Design an agent that reviews pull requests

The one page answer: what one review is, what the agent may call, when it stops, how you know it works, and what a review costs.

6.4The behavioral round: three stories, each with a trace behind it

The failure you found, the safe option you chose, the thing you cut. Each told in ninety seconds, past tense, with a line number and a number that moved.

6.5The interview simulation: what it is, how it is scored, how to prepare

What happens at /interview minute by minute, how each of the ten points per question is earned, and how to walk in ready.

Then the interview

Real agent runs with the bug left in, timed, scored out of ten a question. Every miss links back to its lesson. The question set is the same for every title today and grows as new runs land.

Take the interview

Other titles