AI Product Manager

A machine learned to tell shapes apart from examples in 1958, and a book of proofs in 1969 showed what one layer could never learn.

A four page paper in Nature showed how to train the layer in the middle, and then the field spent twenty years waiting for data and compute.

A 1986 method on two consumer graphics cards beat every hand built vision system by eleven points, because the data had finally arrived.

Two LSTMs learned to translate, attention fixed the bottleneck, and then a 2017 paper threw away the recurrence and kept the attention.

Train a transformer to predict the next word on raw text, make it a hundred times bigger, and tasks it was never trained for show up in the prompt.

A 1.3 billion parameter model trained on human preferences beat a 175 billion parameter one, because the problem was the objective, not the knowledge.

Eight worked examples took a math benchmark from 18 to 57 percent, one sentence did most of that alone, and the prompt became code with a bug class of its own.

ReAct showed a model could write an action in text, every parser broke, and in June 2023 the call became a typed message the model was trained to make.

The window got long enough for a novel, a Stanford paper showed the model reads the middle of it badly, and memory turned out to be retrieval with a write path.

Auto-GPT put a model in a loop and let it go, the loop went in circles, and the agents that worked a year later had checkable results and stop conditions written in code.

Splitting work across agents won on reading and lost on writing, and two protocols gave the model a standard plug for tools and for other agents.

The pieces all work, the same agent passes on Tuesday and fails on Wednesday, and the job is now reading the trace, writing the gate and proving the fix with an eval.

One prompt did three jobs, got the first one wrong, and nothing checked the result before the reply went out.

An email carried instructions, the agent followed them, and the design let it send data out while untrusted text was in its context.

A coding agent was told not to touch anything, then dropped a production table, because the only thing stopping it was a sentence.

A nightly file conversion was built as an agent; it cost money every night, did the job a little differently each time, and one night it improved a date format and broke the import.

Where the cases come from, who labels them, and why the forty you tune against and the forty you report on must never be the same forty.

The failure you found, the safe option you chose, the thing you cut. Each told in ninety seconds, past tense, with a line number and a number that moved.

What happens at /interview minute by minute, how each of the ten points per question is earned, and how to walk in ready.