On September 9, 2024, a sophisticated deepfake scam disrupted Apple’s “Glowtime” event, leveraging the high-profile occasion to deceive viewers. Scammers created a convincing AI-generated video of Apple CEO Tim Cook, which was broadcasted across multiple live streams. The fraudulent content featured an altered version of Cook promoting a cryptocurrency scam that promised to double investments in Bitcoin and Ethereum. The live stream, which garnered over 355,000 viewers, included a false QR code redirecting users to a malicious website designed to collect cryptocurrency.
The deepfake video, presented as a legitimate part of Apple’s event, aimed to exploit the excitement surrounding the introduction of the new iPhone. The scammers used AI to mimic Cook’s voice and appearance, making the deception appear credible. The website linked from the QR code included a fabricated transaction history to further convince viewers that the scheme was genuine. This level of sophistication in the scam highlights the increasing use of deepfake technology in online fraud.
Once the scam was detected, YouTube took action to remove the fraudulent streams, following user reports and internal review. The platform urged users to report similar content, acknowledging the growing challenge of managing deepfake and other deceptive tactics used by scammers. Despite the swift removal of the videos, the incident illustrates the ongoing vulnerability of popular platforms to such malicious activities.
The rise in deepfake scams has prompted calls for greater regulation and transparency in AI-generated content. According to a recent Bitget report, deepfake-related fraud has surged by 245% this year, leading to approximately $80 billion in losses. In response, new legislative proposals are seeking to mandate that AI providers include origin information in all AI-generated content to help combat these sophisticated scams and enhance accountability in the digital space.
Reference: