Document Type

Report

Publication Date

5-2026

Abstract

In a red teaming exercise where participants used AI to evaluate and revise attack ideas against an adversarial group, results reveal that prompts involve multiple phases of the creative problem-solving process. During the exercise, participants were given a threat scenario and time with an unconstrained AI tool to evaluate an idea and generate a revised one. Input messages from the AI tool were collected and analyzed. In doing so, participants used AI prompts related to three core phases of the creative problem-solving process: information gathering, idea generation, and idea evaluation. This reveals that AI is used for various purposes, above and beyond idea generation. In addition, findings inform us on several patterns in how problem-solvers develop prompts, such as basic search, exploration, clarification, risk assessment, and scenario forecasting.

With the findings in mind, we offer several recommendations for workforce development in the intelligence community (IC). First, training and development are essential for accurate prompt engineering and problem-solving using AI. These efforts will help the current IC workforce embrace AI and optimize digital capabilities. Moreover, offering training and development can attract talent and build a culture for future employees to embrace the use of AI. Second, we suggest the use of a red teaming exercise, or series of exercises, to use AI tools in a controlled environment. Following the exercise, we recommend structured reflection to ensure that lessons learned are internalized and later implemented into employees’ workflows to maximize workforce capabilities. Finally, exercise and trainings can shift perspectives on human-AI teams, or augmented intelligence, to help illustrate that AI enhances human judgement, rather than replaces it. When employees are involved in the development and selection of the tool, they will trust the use in their work and as a second order effect, gain a competitive advantage over adversaries.

Comments

PDF passed Adobe accessibility checker prior to upload. 

Download

Share

COinS