Earlier this year, an Iran-linked actor used Anthropic’s Claude artificial intelligence model to scrape and analyze data with the aim of helping target U.S. naval forces in the Middle East. A group in Yemen – very likely Iranian-backed Houthi militants – also used Claude to assist with work on guidance systems for ballistic and hypersonic missiles.
These are just some of the revelations about how adversaries and other malign actors have been using one of the premier pieces of AI software being developed in the United States that were contained in a new report Anthropic released late yesterday. The 154-page document also details instances where Claude was used directly and indirectly to support intelligence gathering and surveillance, cyberattacks, influence operations, and even worrisome biological research over the past eight months. In addition to Iran and Yemen, the human actors behind these activities were based in Russia, China, and a host of other countries.
Anthropic has shared details about what it calls the “misuse” of its models in the past, but describes the new report as its “most detailed” to date. The company has clearly been cataloging these case studies, and has assigned each one a control number. Though the entire contents of the report are cause for concern, the explicit attempt to use Claude to target American forces, as well as to develop new higher-end missiles and other military technology, are particular standouts and signs of what’s to come, as we will highlight below.
GTG-30005 is the case study dealing with the targeting of U.S. naval forces, and the summary is as follows:
“In another investigation, we identified and disrupted an Iran-nexus threat actor that used Claude to collect and analyze publicly accessible data to develop targeting recommendations against US naval forces in the region. The threat actor used Claude to compile targeting handbooks, through a Python pipeline the threat actor built with Claude’s assistance, to identify and track naval positions based on open-source information. The compiled material included a roster of US personnel scraped from captions on public military photographs; publicly accessible ship and aircraft transponder identifiers; commercial satellite-imagery query scripts; and an inventory of public websites that exposed US naval movements. The threat actor also directed Claude to compile vulnerability research on shipboard systems, cataloging known CVEs in maritime VSAT terminals, Cisco communications equipment, and industrial control products.”
“We banned the actor’s account, developed detections to reduce the risk of future misuse, and shared threat intelligence with government authorities to disrupt the threat.”
How exactly Anthropic defines the term “nexus” here is not immediately clear, and other entries in its new report also use “state-nexus” in addition to country-based variations. However, in this specific case, an addendum is added to the entry that explicitly says that the same account was separately tied to “domestic mass surveillance” software development work “for Iranian state systems,” clearly pointing to an actor directly linked to the regime in Tehran.
Whether or not any of the data collected and analysed here was directly used to subsequently carry out attacks on U.S. forces is unknown. However, there have been media reports just in recent weeks that Iran has been increasingly trying to strike American warships. Those same reports have raised questions about how the country has been prosecuting those operations given its limited capabilities and capacity to track maritime targets far from its shores. The possibility that Russia or China could be supplying targeting data has been put forward.
The use of AI technology by nation-state armed forces to develop target sets and engage them is already known to be growing globally. The Israel Defense Forces (IDF) have been a pioneer in this regard, but the U.S. military, China’s People’s Liberation Army (PLA), and others are also known to be developing and fielding these capabilities.
U.S. military officials have also voiced increasing concern in recent years about the ability to track the movements and disposition of U.S. military assets and personnel using publicly available pictures and other data. There has been much talk, in turn, about how to balance transparency and operational security.
No comments:
Post a Comment