AI-generated intelligence nearly prompts US action against Chinese ship

The US military came close to launching a potentially dangerous operation against a Chinese vessel in the Middle East after acting on an intelligence report that had been prepared with the help of artificial intelligence (AI), CNN has reported.

According to CNN, the incident happened earlier this spring while the war with Iran was ongoing. The intelligence report claimed that the Chinese vessel was carrying components linked to a nuclear weapons programme.

The report immediately alarmed US military officials, who began preparing to intercept the vessel. Armed personnel reportedly prepared to board the ship, while military aircraft were already airborne as the operation was being planned.

However, officials took a closer look at the intelligence before the operation went ahead and discovered that an analyst from US Special Operations Command had used an AI chatbot while preparing the report.

According to sources cited by CNN, the chatbot had incorrectly identified the ship’s cargo.

The intelligence report was subsequently found to be false, prompting officials to call off the planned operation.

One source described the incident as a serious close call that could have led to a confrontation between the United States and China. The episode has also raised fresh questions about the growing use of AI in military intelligence and targeting.

CNN reported that US military agencies are increasingly using different AI systems, but there is no single, consistent standard across the military for how information produced with AI should be checked before it is used operationally.

The incident highlights a key challenge: AI can process large amounts of information quickly, but an incorrect assessment can have serious consequences when it is used in sensitive military decisions.

The US military has been moving rapidly to expand its use of AI, including in intelligence and targeting.

The reported Chinese-vessel incident is likely to add to the debate over how such systems should be tested, verified and used when human lives and international security are at stake.