The Deepfake Scam Epidemic: Bad Actors & AI

Here’s the thing about 2025: if someone calls you claiming to be your CEO, your grandmother, or even Elon Musk promising free money, there’s a decent chance you’re talking to a robot. And not the charming, helpful kind—the kind that wants to drain your bank account while sounding exactly like someone you trust.

I’ve been tracking this deepfake scam phenomenon, and frankly, it’s both fascinating and terrifying. More than 1 in 4 executives revealed that their organizations had experienced one or more deepfake incidents targeting financial and accounting data in the 12 months prior, while 50% of all respondents said that they expected a rise in attacks over the following 12 months. Translation: this isn’t some distant sci-fi threat—it’s happening right now, and it’s about to get much worse.

The $25 Million Video Call That Wasn’t

Let’s start with the story that should keep every CFO awake at night. In one of the largest known case this year, a Hong Kong finance worker was duped into transferring more than $25 million to fraudsters using deepfake technology who disguised themselves as colleagues on a video call, authorities told local media in February.

Think about that for a second. This wasn’t some elderly person falling for a Nigerian prince email. This was a finance professional at a major engineering firm, looking at what appeared to be their CFO and colleagues on a video call, being asked to make a routine transfer. However, the rest of the attendees present in that meeting had, in reality, been digitally recreated deepfakes.

The company? British engineering giant Arup, which later confirmed the incident involved “fake voices and images” were used in the incident, adding that “the number and sophistication of these attacks has been rising sharply in recent months”.

This isn’t isolated. Chinese state media reported a similar case in Shanxi province this year involving a female financial employee, who was tricked into transferring 1.86 million yuan ($262,000) to a fraudster’s account after a video call with a deepfake of her boss.

ChatGPT: The Unwitting Accomplice

Here’s where it gets really interesting (and by interesting, I mean deeply concerning). Researchers at the University of Illinois Urbana-Champaign decided to see just how far they could push OpenAI’s ChatGPT-4o into criminal territory. Recently, Richard Fang, Dylan Bowman, and Daniel Kang from UIUC published a new paper in which they described how they abused OpenAI’s latest AI model, called ChatGPT-4o, to fully automate some of the most common scams around. Now, OpenAI’s latest model offers a voice-enabled AI agent, which gave the researchers the idea of trying to pull off a fully automated voice scam. They found ChatGPT-4o does have some safeguards which prevent the tool from being abused this way, but with a few “jailbreaks”, they managed to imitate an IRS agent.

The success rates? Credential theft from Gmail worked 60% of the time, while others like crypto transfers had about 40% success. These scams were also relatively cheap to conduct, costing about $0.75 to $2.51 per successful attempt.

Let me put this in perspective: for less than the cost of a coffee, criminals can now automate voice scams that work more than half the time. The barrier to entry for sophisticated fraud has essentially disappeared.

The Elon Musk Deepfake Industrial Complex

If you’ve spent any time online lately, you’ve probably seen deepfake Elon Musk promising incredible investment returns. In August 2024, The New York Times dubbed deepfake “Musk” “the Internet’s biggest scammer”. Steve Beauchamp, an 82-year-old retiree, told the New York Times that he drained his retirement fund and invested USD $690,000 in such a scam over the course of several weeks, convinced that a video he had seen of Musk was real.

The victim’s description is heartbreaking: “I mean, the picture of him — it was him,” Steve Beauchamp told The New York Times when describing the deepfake video he had seen of Elon Musk… “But as far as the picture, if somebody had said, ‘Pick him out of a lineup,’ that’s him,” said Beauchamp.

This isn’t just about one person losing their retirement savings. “Looked just like Elon Musk, sounded just like Elon Musk and I thought it was him,” Heidi Swan told CBS News in a November 2024 report, describing an ad she saw on Facebook and TikTok that tricked her into sending scammers USD $10,000… “They still sound like Elon Musk,” she told the news publication after rewatching the same videos that had deceived her, despite having since learned that they were fake.

The Tech Behind the Terror

What makes this so dangerous isn’t just the technology—it’s how accessible it’s become. Three seconds of audio is sometimes all that’s needed to produce an 85 percent voice match from the original to a clone. According to Google Trends, searches for “free voice cloning software” rose 120 percent between July 2023 and 2024.

The democratization of deepfake technology means “The public accessibility of these services has lowered the barrier of entry for cyber criminals — they no longer need to have special technological skill sets”.

And it’s not just voice cloning. Real-time video manipulation tools are now being sold on criminal forums. These tools can swap faces and mimic speech during video calls in multiple languages, making it easier for attackers to run scams across borders.

The Numbers Don’t Lie

The statistics are staggering. Fraudsters are increasingly using AI-powered deepfakes for scams, with a 3,000% rise in fraud cases in 2023. The accessibility of generative AI tools has made it easier for criminals to create convincing fake content.

In 2024, businesses faced an average loss of nearly $500,000 due to deepfake-related fraud, with large enterprises experiencing losses up to $680,000. Meanwhile, As of 2024, 53% of financial professionals had experienced attempted deepfake scams.

Perhaps most concerning: Despite AI’s growing prominence, about one in four company leaders had little to no familiarity with deepfake technology… 32 percent of leaders had no confidence their employees would be able to recognize deepfake fraud attempts on their businesses.

Fighting Back (Because We Have To)

So what can we do? First, accept that this isn’t going away. The problem is expected to get worse as the cybersecurity space struggles to catch up to rapidly developing technology, but there are better practices that companies can enact now, experts say.

The solutions aren’t rocket science, but they require discipline. However, the cybersecurity experts told CNBC that firms can bolster defenses to AI-powered threats through improved staff education, cybersecurity testing, and requiring code words and multiple layers of approvals for all transactions — something that could have prevented cases such as Arup’s.

For individuals, the advice is similar: Verify the source: Always double-check the legitimacy of a request or message—especially if you receive it unexpectedly or it seems unusual. If someone claims to be a relative or authority figure, confirm their identity through another trusted means (e.g., by calling your relative’s cell phone directly).

The Bottom Line

We’re in the middle of a fundamental shift in how fraud works. The old rules—”if it sounds too good to be true, it probably is”—don’t apply when the person asking looks, sounds, and acts exactly like someone you trust.

With each passing day, AI deepfakes are becoming more sophisticated and easier to access, causing cases of AI deepfake fraud to proliferate. The question isn’t whether you’ll encounter a deepfake scam—it’s whether you’ll recognize it when you do.

Stay paranoid, verify everything, and remember: in 2024, trust but verify has become trust but verify, then verify again, then call them back on a number you know is real.

Sources:

• Incode – Top 5 Cases of AI Deepfake Fraud From 2024 Exposed
• TechRadar – Experts warn some ChatGPT models can be hacked to launch deepfake scams
• CNBC – Deepfake scams have robbed companies of millions
• Security.org – 2024 Deepfakes Guide and Statistics
• eftsure – Deepfake statistics (2025): 25 new facts for CFOs