Jakarta – Wearing a traditional Indonesian black hat and shirt, President Prabowo Subianto speaks to the camera in an Instagram video, asking his people how he can help them after his election in 2024.
"Who hasn't received aid from me? What are your needs right now?" he appears to ask viewers in the clip posted in November.
But while the Indonesian leader's mouth moves and his eyes blink, the words he utters are part of a fraudulent deepfake scam uncovered by police in February that has swindled Indonesians across 20 provinces.
Those ensnared by the message were asked to contact a WhatsApp number and hand over between 250,000 rupiah and one million rupiah (between S$20 and S$82) as an "administrative fee" to get aid that never materialised.
Since 2024's Indonesian election, experts have warned of a tidal wave of deepfakes – audio, images and video appearing to come from a known person but that are, in fact, the work of scammers using artificial intelligence (AI) tools.
Victims say the hoaxes are so sophisticated that the scams leave others vulnerable to being conned too.
"People should be more careful. Don't be easily fooled by the lure of prizes," said Aryani, 56, who handed over 200,000 rupiah to fraudsters after seeing a deepfake video of a prominent Indonesian businessman.
"I need money, but instead I am asked to send money. They even made video calls with me, as if I were talking directly to them."
During the South-east Asian country's presidential campaign, deepfakes became a prominent tool to spread misinformation both harmful and helpful to candidates.
But now, that technology has fallen into the hands of criminals looking to make cold, hard cash.
Wide circulation
AFP's fact-checkers found that the account behind the Prabowo clip has posted dozens of similar videos appearing to show various high-profile figures, including Indonesian Vice-President Gibran Rakabuming Raka.
Those videos also promote the bogus financial aid.
Police arrested a suspect who pocketed 65 million rupiah from the scam, Indonesian National Cyber Crime Unit director Himawan Bayu Aji told reporters in February.
He said officers detained a second person involved in another scam that also used deepfake technology, without disclosing the amount raised.
AFP Fact Check department's investigation found the spread of such videos had a much wider reach than the two accounts that police announced.
Deepfake videos of the President, a popular former general, were still circulating on social media after the arrests, including dozens on TikTok with the hashtag "Prabowo shares blessings".
At least 22 TikTok accounts had been touting the same fraudulent scheme since Mr Prabowo took office in October, AFP journalists found, with some appearing to take advantage of his recent rise to the presidency.
One account with more than 77,000 followers racked up 7.5 million views on a fabricated video of Mr Prabowo apparently doling out financial assistance.
Another account with thousands of followers has shared 100 videos since January alone, the majority featuring deepfake videos of the President offering cash.
TikTok said it had removed one of the deepfake scam videos and the associated account, adding that it would continue to remove any that violated the platform's community guidelines, which prohibit misleading posts.
Facebook parent Meta did not respond to AFP's request for comment.
AFP, along with more than 100 other fact-checking organisations, is paid by TikTok and Meta to verify social media posts that potentially contain false information.
Mr Aribowo Sasmito, co-founder of Indonesian fact-checking organisation Mafindo, said members of his team were finding new deepfake scams every week because of their prolific spread online.
"We have started to see deepfake videos since last year as AI tools have become more accessible and affordable," he told AFP.
Schemes using deepfakes of prominent figures appear to be on the rise.
Tech billionaire Elon Musk and Canadian Prime Minister Justin Trudeau are among a string of public figures targeted in recent years by sophisticated impersonations to push cash scams.
Mr Aribowo said his team of fact-checkers was working harder than ever to debunk these scams, which use the latest technology available to criminals.
"We noticed the quality of these videos has improved over time. It has become more difficult to distinguish between fake and real videos," he added.
"The challenge is the volume of these scams."