IA 360
Computing

Cognition unveils Devin, an AI agent for end-to-end coding

Startup Cognition has unveiled Devin, an AI agent that takes on coding tasks, creates a plan and works with a terminal, editor and browser. The company says it outperforms other systems on the SWE-bench benchmark.

4 min read Leer en español

Cognition unveiled Devin on Tuesday, an artificial intelligence agent designed to handle software engineering tasks autonomously. It does more than suggest lines of code: the company gives it its own computing environment, complete with a terminal, code editor and browser, so it can research a problem, write a solution, test it and fix errors.

The launch comes as assistants such as GitHub Copilot and ChatGPT have become part of many developers’ workflows. The difference is scope: those tools typically respond to specific requests within a programmer’s workflow, while Devin aims to take on an entire task and return the result.

An agent that can use tools

Cognition describes Devin as an agent—in other words, a system that does more than generate text or code: it decides on a sequence of actions to achieve a goal. Given an assignment, it can draw up a plan, search documentation online, open files in a repository, run commands and check how the program it is modifying behaves.

The system can also ask the user for clarification when it encounters ambiguity. That capability matters in programming: an apparently simple request can conceal requirements around security, compatibility, performance or how an application should be used.

In its demonstration, Cognition showed Devin learning unfamiliar technologies from documentation, fixing bugs in open-source projects and creating a web application. These are common tasks on software teams, although a controlled demonstration is not the same as maintaining a real-world product.

The benchmark: SWE-bench

To support its announcement, Cognition used SWE-bench, a test based on real issues from public GitHub repositories. The challenge is to fix bugs and implement change requests based on descriptions written by repository maintainers, then validate the solution with automated tests.

The company says Devin solved 13.86% of the cases in the test set without assistance. For comparison, Cognition said the previous best result was 1.96%.

The figure is notable, but it needs context. Solving roughly one in seven problems does not make the system a general replacement for a software engineer. SWE-bench measures specific, verifiable issues; professional development also involves understanding business needs, negotiating priorities, reviewing architectural decisions and taking responsibility for a system when it fails.

Even so, the progress matters because it evaluates something more demanding than completing an isolated function: it requires the model to navigate an existing project, interpret a bug and modify the code without breaking other parts.

From copilot to work delegation

Devin’s arrival reflects a shift in the race to automate programming. Over the past two years, the dominant product has been the copilot: a tool that accelerates developers by suggesting code, explaining functions or writing tests. Agents propose a different model: delegating a defined task to them and supervising the result.

That could be useful for fixing repetitive issues, preparing prototypes, updating dependencies or researching bugs with an initial proposal. It could also reduce the time spent on tasks that currently consume hours of navigating documentation, repositories and error logs.

But autonomy introduces practical risks. An agent with access to a terminal can install packages, change configurations or introduce vulnerable dependencies without human review. Code that passes an automated test also is not necessarily maintainable, secure or suitable for a company’s infrastructure.

Cognition, co-founded by competitive programmer Scott Wu, has announced that it will offer early access to Devin. Its real capabilities will be measured outside demonstrations and benchmarks: in projects with ambiguous requirements, legacy systems and code reviews by professionals who will have to decide whether the agent’s solutions deserve to reach production.

Share this article

This website uses cookies to improve the browsing experience. Cookie policy.