IA 360
What exactly is a "weight" in an AI model?
Language Models

What exactly is a "weight" in an AI model?

We explain gradient descent, hyperparameters and overfitting, but almost never the thing that actually gets adjusted: the weight. It's a number, and a model is...

7 min

Editor's picks

Latest articles

We Asked Our Own March Piece for Its Sources. Here's What We Found
Current Affairs

We Asked Our Own March Piece for Its Sources. Here's What We Found

In March we wrote a draft — never published, sitting in the queue for four and a half months — citing six percentages with no link at all: four attributed to 'a Harvard Business Review study' and two to a Harness survey. We checked them: the four from HBR aren't in the real study, the two from Harness do exist, and the 'unnamed engineer' had a name all along. The method left over for any unsourced number.

8 min
How to read an AI paper without being a researcher
AI Fundamentals

How to read an AI paper without being a researcher

Every summary of OPT-175B's training said the same thing: 992 GPUs, two months. None mentioned the 35 manual restarts at three in the morning. They were sitting in the actual document, under a plainly-named section almost nobody opens. This piece teaches which parts of a paper to read, in what order, and walks the exact route — minutes, not a research career — through the real case that changed the argument of my previous piece.

7 min

Explore categories

This website uses cookies to improve the browsing experience. Cookie policy.

↑↓ navigate ↵ open esc close