Meta unveils Llama 3.2 with vision and Orion AR glasses

Meta unveiled Llama 3.2 on Wednesday, expanding its family of open models with image understanding and versions small enough to run on phones and other devices. At its Meta Connect conference, it also showed Orion, an experimental pair of augmented-reality glasses that embodies much of the company’s push to take AI beyond the screen.

The announcement brings together two strategies that have so far advanced along separate paths: models capable of interpreting the visual world and hardware that can display digital information directly over it.

Llama 3.2 gives Meta’s family eyes

Llama 3.2 comes in four models. The 11 billion- and 90 billion-parameter versions are multimodal: they can take text and images as input and respond with text. They can, for example, extract data from a chart, describe a photograph, answer questions about a scanned document or identify specific elements in an image.

A multimodal model is not simply a chatbot with a photo attached. It must connect what it sees with the user’s question and with language. This capability has become central to the competition among OpenAI, Google, Anthropic and Meta because it can automate tasks involving documents, screenshots, interfaces or product images.

Llama 3.2’s vision models are built on the Llama 3.1 architecture. Meta trained a visual layer so the model can translate information from an image into representations the language model can process. As with the rest of Llama, the company is releasing the weights under its community license: researchers and companies can download and adapt the model, subject to specific conditions for very large organizations.

That sets Llama apart from closed services such as ChatGPT and Claude. A company can install a model on its own infrastructure, exercise greater control over where its data remains and tailor it to a specific task. In return, it takes on the technical cost of deploying, evaluating and securing it.

1 billion- and 3 billion-parameter models for devices

The other new arrivals are Llama 3.2 1B and 3B, text-only models with 1 billion and 3 billion parameters, respectively. Their purpose is not to compete with the largest models on complex reasoning, but to make AI features viable on resource-constrained hardware.

Meta is positioning them for phones, personal computers and connected devices. Running some AI directly on the device — commonly known as edge AI — can reduce latency and keep each query from traveling to a remote server. That is a significant advantage for writing suggestions, information classification, voice commands or assistants that handle sensitive data.

The trade-off is unavoidable: a small model knows less and makes more mistakes than one with tens or hundreds of billions of parameters. In practice, the choice will not be between local AI and cloud AI, but how to divide the work. Simple, private actions are a better fit for the device; queries requiring more knowledge or computation will continue to rely on data centers.

Meta AI gets a voice, while Orion points to a phone-free future

Meta also announced new voices for Meta AI, its assistant built into WhatsApp, Instagram, Facebook and Messenger. The company is adding voice conversations and voices modeled on personalities including John Cena, Judi Dench, Awkwafina, Keegan-Michael Key and Kristen Bell, initially in the United States, Canada, Australia and New Zealand.

The event’s most ambitious demonstration was Orion. These are not smart glasses like the Ray-Ban Meta, which feature a camera, microphones and speakers, but augmented-reality glasses with transparent displays. They project digital elements into the user’s field of view, including messages, video calls, directions and contextual information.

The prototype uses Micro LED projectors, silicon carbide waveguides and eye- and hand-tracking. It can also be controlled with an electromyography-based wristband, a technology that detects the electrical signals from the wrist muscles even before the finger completes a gesture. Meta says Orion offers a field of view of about 70 degrees and weighs less than 100 grams.

Orion will not be available in stores for now. Meta is presenting it as a research platform: the hardware remains very expensive to manufacture, and the company needs to bring down the cost before commercializing it. Showing it nonetheless has strategic value. Meta wants to demonstrate that it has an alternative to phones and bulky mixed-reality headsets.

The challenge is turning demos into everyday utility

Llama 3.2 gives developers and companies an open way to experiment with vision and on-device AI. Orion, by contrast, highlights the distance that still separates a compelling demonstration from a consumer product.

The connection between the two announcements is clear: useful glasses will need to understand what the user is looking at, respond quickly and handle especially sensitive data. Privacy, battery life, visual-recognition accuracy and society’s willingness to wear cameras and displays on their faces will determine whether that vision makes it out of the lab. Meta has put the pieces on the table; turning them into an everyday device will require considerably more than a good language model.