Chinese aircraft designers warn of AI hallucination risks in military development

AI-summarized · Neutrality-checked

Engineers at the AVIC Chengdu Aircraft Research and Design Institute, including Zhang Xianzhe, published a paper on June 20 in the journal Information Studies: Theory & Application warning about AI hallucination risks in military development. The designers stated that AI models frequently invented false aircraft specifications, such as combat radius, speed, and radar range, despite the models' capability to quickly mine intelligence data. This warning followed the use of these models in the development of the People's Liberation Army’s J-20 and next-generation J-36 stealth fighters.

Consequences

The reliance on AI for intelligence work could lead to strategic miscalculations if designers continue to receive plausible but inaccurate performance data regarding enemy radar coverage and weapon capabilities. Consequently, defense engineers may be forced to implement stricter verification processes to prevent faulty data from influencing the design of future stealth aircraft.

Sources

Know where. Know why.