IA 360
Language Models

DeepSeek launches Coder V2, China’s open rival to GPT-4 Turbo

DeepSeek has released Coder V2, an open family of programming and mathematics models based on a mixture-of-experts architecture. Its largest version has 236 billion parameters, though it activates 21 billion per query.

5 min read Leer en español

DeepSeek today released DeepSeek-Coder-V2, a new family of language models designed for programming and mathematics. The Chinese company says its instruction-tuned version comes close to GPT-4 Turbo on several coding benchmarks, with one important distinction for developers and businesses: the model weights are available for open use.

The launch confirms that open models are no longer competing only on simple autocompletion tasks. DeepSeek-Coder-V2 is designed to generate programs, complete repositories, fix bugs, and solve technical problems using natural language—a field previously dominated by closed products from OpenAI, Anthropic, and Google.

A massive model that does not use its full capacity for every response

The main version of DeepSeek-Coder-V2 has 236 billion parameters in total, but activates 21 billion to process each token. A lighter variant has also been released, with 16 billion total parameters and 2.4 billion active parameters.

The difference comes from its mixture-of-experts architecture, or MoE. Rather than using the entire neural network for every word or piece of code, the system selects some of its internal components—the so-called experts—depending on the task. The goal is to combine high overall capacity with a lower inference cost, meaning the cost of using the trained model, than that of a dense model of equivalent size.

That does not mean it is cheap to run on any computer. The 236-billion-parameter version still requires substantial infrastructure. But the design allows cloud providers and companies with their own servers to deploy it using less compute per response than a conventional model of that scale would require.

Code, mathematics, and a long context window

DeepSeek-Coder-V2 is based on DeepSeek-V2 and received additional training on 6 trillion tokens, the units of text and code these systems use to learn patterns. The training set includes source code and mathematical material, two areas that require symbolic precision and stricter instruction-following than a general conversation.

The model supports 338 programming languages and a context window of up to 128,000 tokens. In practice, that capacity makes it possible to feed in long files, documentation, error logs, or large portions of a repository without splitting them into many separate queries.

That matters particularly in software development. An assistant that sees only an isolated function may suggest a seemingly valid fix that is incompatible with the rest of the project. Access to more context does not guarantee that it will understand the entire architecture, but it reduces one of the most visible limitations of today’s coding assistants.

DeepSeek compares its instruction-tuned model with GPT-4 Turbo, Claude 3 Opus, and Gemini 1.5 Pro on programming and mathematical-reasoning tests. In its evaluations, Coder-V2 delivers competitive results against those closed models on several of the tests. As with any benchmark published by the lab itself, it is important to distinguish standardized-test performance from behavior on real-world projects: results can vary depending on the language, the quality of the instructions, and the type of code available in the context.

The open alternative gains ground

The announcement’s significance lies in more than a results table. Open models allow a company to run them on its own infrastructure, adapt the system to its internal tools, and avoid sending sensitive code to an external API. For industries with confidentiality requirements—from banking to enterprise software vendors—that option can be decisive.

They also give researchers and independent developers more latitude to analyze how the model responds, create specialized versions, or integrate it into editors and coding agents. That freedom comes with a trade-off: deploying and maintaining a model of this scale requires technical expertise, GPU memory, and safeguards for reviewing the code it generates.

The release comes as Chinese labs are narrowing the gap in language models, particularly through MoE architectures. DeepSeek had already attracted attention with DeepSeek-V2 by combining performance and efficiency; Coder-V2 brings that strategy to a commercially appealing use case: automating part of the software-engineering workload.

For end users, the immediate consequence will be a wider range of coding assistants, both in cloud services and private deployments. The open question is not just whether DeepSeek-Coder-V2 matches GPT-4 Turbo on a particular test, but how much the cost will fall for access to an advanced model that can read and write code within an organization.

Share this article

This website uses cookies to improve the browsing experience. Cookie policy.