IA 360
Use Cases

Microsoft Unveils Its Strategy Against Deepfakes: Combining Watermarks, Digital Signatures, and Metadata

Microsoft tested 60 anti-manipulation techniques and recommends technical standards for AI platforms to identify authentic content amid rising deepfake challenges.

Admin IA360 6 min read AI-generated Leer en español
Microsoft Unveils Its Strategy Against Deepfakes: Combining Watermarks, Digital Signatures, and Metadata

A 2024 audit revealed that only 30% of AI-generated content posts on Instagram, LinkedIn, Pinterest, TikTok, and YouTube carried proper labels. Meanwhile, Russian influence campaigns distribute deepfake videos to discourage Ukrainian recruitment, and White House officials share manipulated images without repercussions.

In this chaotic landscape, Microsoft has just introduced its blueprint for verifying what’s real online. The company’s AI security research team evaluated 60 different combinations of anti-manipulation techniques and proposes technical standards that AI companies and social platforms could adopt.

The Digital Rembrandt Analogy

Eric Horvitz, Microsoft’s Chief Scientific Officer, explains the approach with an artistic analogy. Imagine owning an authentic Rembrandt painting and needing to prove its authenticity. You’d create a detailed provenance record, apply an invisible watermark readable by machines but not the naked eye, and generate a mathematical signature based on brushstrokes—like a unique fingerprint.

The same principle applies to digital content. Microsoft researchers modeled how different combinations of provenance metadata, watermarks, and digital signatures would hold up against various tampering scenarios—from metadata removal to deliberate content alteration.

The key is smart redundancy. One technique alone can fail, but the right combination creates a robust verification system.

The Limits of Automated Detection

It’s important to clarify what these tools can and cannot do. As Horvitz told skeptical lawmakers about Big Tech: "This isn’t about deciding what’s true or false, but about creating labels that inform people where content comes from."

These tools detect manipulation, not truthfulness. They can flag if an image was altered by AI, but not whether the event depicted actually happened. It’s the difference between technical authenticity and factual accuracy.

Hany Farid, a digital forensics expert at UC Berkeley, believes that if the industry adopted Microsoft’s blueprint, "it would be significantly harder to deceive the public with manipulated content." While acknowledging that sophisticated actors or governments might bypass these tools, the standard would eliminate "a significant portion of misleading material."

The Challenge of Economic Incentives

Microsoft holds a unique position in the AI content ecosystem: it operates Copilot (image and text generation), Azure (hosting OpenAI and other models), LinkedIn, and holds a significant stake in OpenAI. Yet, when asked about implementing its own recommendations, Horvitz was noncommittal: "Product teams are taking actions based on the report’s findings."

This reluctance is unsurprising. As Farid points out, "If the Mark Zuckerbergs and Elon Musks of the world believe that labeling ‘AI-generated’ content will reduce engagement, they obviously have incentives not to do it."

Google began adding watermarks to its AI-generated content in 2023. Some platforms use C2PA, a provenance standard Microsoft helped launch in 2021. But adoption remains uneven and voluntary.

Sociotechnical Attacks: The New Battleground

Researchers identify an emerging risk: sociotechnical attacks. Imagine someone takes a real image from a controversial political event and uses AI to alter just a tiny fraction of pixels. When shared online, it might be mistakenly flagged as "AI-manipulated."

Combining provenance tools and watermarks would allow platforms to clarify that content was only partially AI-generated, pinpointing exactly where changes occurred. Without this granularity, binary labels ("real" vs. "fake") can be exploited to discredit authentic content.

The Trust Paradox

Growing evidence shows people are influenced by AI-generated content even when they know it’s fake. A recent study on pro-Russian AI-generated videos found that comments pointing out their artificial origin received far less engagement than those treating them as genuine.

Does this mean technical verification is pointless? Farid remains optimistic: "Are there people who will believe what they want no matter what you tell them? Yes. But there’s a large majority of Americans and global citizens who want to know the truth."

The risk lies in poor implementation. If labeling systems are rushed, applied inconsistently, or frequently fail, people may lose trust entirely. Researchers argue that "it may be better to show nothing at all than a verdict that could be wrong."

California’s Test Case

California’s AI Transparency Act, effective August, will be the first major test of these tools in the U.S. Microsoft actively lobbied during its drafting, helping make the requirements "a bit more realistic," according to Horvitz.

But political hurdles remain. Former President Trump’s executive order seeks to limit "burdensome" state AI regulations for industry. The administration also canceled grants related to misinformation, while paradoxically, the Department of Homeland Security uses Google and Adobe video generators to create content shared with the public.

When asked if government-sourced fake content worries him as much as social media, Horvitz initially declined to comment. He later added, "Governments have not been absent from sectors behind various types of manipulative disinformation, and this is a global issue."

The irony is clear: while Microsoft proposes standards to verify online authenticity, the very governments that could enforce them remain sources of manipulated content. Technology can provide tools, but political will to use them properly remains the biggest unknown.

This article was produced with artificial intelligence under human editorial oversight.

Share this article

This website uses cookies to improve the browsing experience. Cookie policy.

↑↓ navigate ↵ open esc close