IA 360
What exactly is a "weight" in an AI model?
Language Models

What exactly is a "weight" in an AI model?

We explain gradient descent, hyperparameters and overfitting, but almost never the thing that actually gets adjusted: the weight. It's a number, and a model is...

7 min

Editor's picks

How to read an AI paper without being a researcher
AI Fundamentals

How to read an AI paper without being a researcher

Every summary of OPT-175B's training said the same thing: 992 GPUs, two months. None mentioned the 35 manual restarts at three in the morning. They were sitting in the actual document, under a plainly-named section almost nobody opens. This piece teaches which parts of a paper to read, in what order, and walks the exact route — minutes, not a research career — through the real case that changed the argument of my previous piece.

7 min

Latest articles

They Asked ChatGPT to Repeat 'Poem' and It Recited Poe: What That Proves, and What It Doesn't
Language Models

They Asked ChatGPT to Repeat 'Poem' and It Recited Poe: What That Proves, and What It Doesn't

In 2023, researchers asked ChatGPT to repeat the word 'poem' without stopping, and the model ended up reciting Poe's 'The Raven' word for word. That doesn't prove models store a copy of the internet, but it doesn't prove they never memorize anything either: both claims are true, depending on the case. The four questions that separate a serious lawsuit from an empty headline.

7 min

Explore categories

This website uses cookies to improve the browsing experience. Cookie policy.

↑↓ navigate ↵ open esc close