Meta puts AGI on its roadmap and plans for 350,000 H100s
Mark Zuckerberg has made artificial general intelligence a goal for Meta. The company expects to have around 350,000 H100 GPUs by the end of 2024, with total capacity equivalent to 600,000 of the chips.
Mark Zuckerberg has placed artificial general intelligence, or AGI, at the center of Meta’s strategy. The CEO announced Thursday that the company is working to develop intelligent systems capable of handling a wide range of tasks and plans to make that technology available responsibly.
The plan comes with an infrastructure investment that is unusual even among the biggest tech companies: Meta expects to have around 350,000 Nvidia H100 GPUs by the end of 2024. Including other types of processors, it estimates that its capacity will be equivalent to around 600,000 H100s, Zuckerberg announced.
What it means for Meta to pursue AGI
Artificial general intelligence remains a goal without a single technical definition. The term is used to describe AI that is not limited to a specific function—such as translating, recommending videos or generating images—but can learn and solve problems across very different fields.
Today’s models already demonstrate broad capabilities: they can write, program, analyze images and answer questions. But they still struggle with complex reasoning, context and reliability. Talking about AGI does not mean Meta has reached that point; it means the company has decided to direct its research and product resources toward that horizon.
Zuckerberg linked that ambition to more immediate services: AI assistants, tools for creators and features for businesses. That is an important detail. Meta is not presenting AGI solely as a laboratory project, but as the technological foundation for strengthening products it already distributes to billions of people, from WhatsApp and Instagram to Facebook.
Why H100s matter so much
H100s are graphics processing units, or GPUs, made by Nvidia. Although they were originally designed to accelerate graphics, they have become the most sought-after hardware for training large AI models: they can perform huge numbers of calculations in parallel, allowing a system to adjust its parameters based on data.
Having 350,000 of these chips does not guarantee better models on its own. High-quality data, researchers, software and effective training methods are also needed. But it does indicate the scale at which Meta wants to compete. Training advanced models requires data centers, networks capable of connecting thousands of processors and vast amounts of energy; infrastructure has become as decisive an advantage as the algorithm itself.
The figure of 600,000 H100 equivalents presumably includes other accelerators Meta already uses, with their performance expressed in a common unit. It should therefore not be read as a literal order for 600,000 H100 chips, but as a measure of total computing capacity.
A race in which Meta wants to preserve openness
Meta enters this phase with Llama 2, its family of language models launched in 2023 and distributed under a license that allows commercial use under certain conditions. Compared with the closed models from companies such as OpenAI and Google, that strategy has made it easier for researchers and businesses to run and adapt Meta’s models in their own systems.
Zuckerberg said Meta would seek to make AGI accessible responsibly. The formulation combines two goals that do not always fit easily together. Opening up models allows more developers to study, adapt and improve them, but it also expands the number of actors capable of using them. The company will have to spell out which parts of its future systems it will release, under what licenses and what limits it will apply to its most capable models.
The announced infrastructure also lays the groundwork for the next generation of Llama, which Meta had previewed for this year. The meaningful leap will not simply be a matter of increasing a model’s size: it will need to produce more useful assistants, more reliable answers and tools that can be integrated into the company’s everyday products.
The cost of competing is changing scale
The announcement confirms that the race for advanced AI is being fought on two fronts. One is scientific: designing models that reason better and make fewer mistakes. The other is industrial: securing chips, building data centers and operating them efficiently.
For users, the most immediate consequence will be the arrival of more AI features in Meta’s apps. For businesses building on its models, the promise is access to a more capable platform. And for the industry, the decision reinforces a reality: frontier projects no longer depend only on a good research idea, but on computing resources at a gigantic scale.