IA 360
What exactly is a "weight" in an AI model?
Language Models

What exactly is a "weight" in an AI model?

We explain gradient descent, hyperparameters and overfitting, but almost never the thing that actually gets adjusted: the weight. It's a number, and a model is...

7 min

Editor's picks

Latest articles

They Asked ChatGPT to Repeat 'Poem' and It Recited Poe: What That Proves, and What It Doesn't
Language Models

They Asked ChatGPT to Repeat 'Poem' and It Recited Poe: What That Proves, and What It Doesn't

In 2023, researchers asked ChatGPT to repeat the word 'poem' without stopping, and the model ended up reciting Poe's 'The Raven' word for word. That doesn't prove models store a copy of the internet, but it doesn't prove they never memorize anything either: both claims are true, depending on the case. The four questions that separate a serious lawsuit from an empty headline.

7 min

Explore categories

This website uses cookies to improve the browsing experience. Cookie policy.

↑↓ navigate ↵ open esc close