400 institutions hit by AI-powered attacks

CyberCartel, a hacking group with a long history of targeting Latin American businesses, has been using AI agents, including SpaceX's Grok and Anthropic's Claude, to automate attacks on financial institutions such as banks and mobile payment apps. Passwords and customer data have been stolen, while individuals' bank accounts have also been accessed with little input from criminals in the latest example of criminals turning to AI-powered cyberattacks.

While CyberCartel has been an active threat since at least 2012, its new leveraging of the power of AI has leveled up its attacks in recent months. Now, the research shows that the group can attack more businesses at a speed previously not possible when using human-powered hacks. Straiker shared its research with both SpaceX and Anthropic, and both firms are working to lock CyberCartel out of their services. The latter has already been able to block access to Claude.

Chinese lab Moonshot AI's agent has also been used by the hacking group, but Straiker is still trying to get in touch with the company. While it's true that AI models normally have protections in place to prevent them from being used to carry out cyberattacks, they've proven surprisingly easy to bypass. In this case, CyberCartel reportedly simply told the models that they were being used in test environments.

Notably, CyberCartel doesn't appear to be using Anthropic's Mythos for its recent attacks. The company caused a stir earlier this year when it announced the new model, warning that hackers could use it and models like it for attacks like those carried out by CyberCartel.

Its release also saw security teams around the globe rush to address thousands of vulnerabilities that the model had identified. This is far from the first time that Anthropic has been faced with the news that its AI is being used by bad actors.