Cogni-Sketch: Enabling Rapidly Formed Human-Agent Coalition Teams Through Extensible Information Exchange

Watch the video

Military / Coalition Issue

There is much potential power to be gained from human-machine teams working together on a variety of situation awareness or problem-solving/understanding tasks. The ability to rapidly introduce, understand, interact with, and configure machine agents is critical, especially in a coalition setting where the machine agents may be unfamiliar. Can we create an approach that enables an efficient and productive human-agent collaborative environment? Can we do so in a way that does not require expensive and time-consuming support from technical specialists and integrators?

Core idea and key achievements

Human-Agent Knowledge Fusion (HAKF) has been defined as an underpinning principle for building such systems, defining the tellability and explainability flows that can enable inter-agent communication and support performance improvement and improved trust.

image info

Creation experimental embodiments of the HAKF principles as an extensible platform named Cogni-sketch to allow information and knowledge sharing between human and machine agents, with each being able to read and write their knowledge to the environment, extend the schema and provide explanations or new local knowledge.

Implications for Defence

An experimental platform to explore options for human-agent teaming and different techniques for interactions. Plug-in architecture supports many forms of extensions, with new machine agents, visualisation types, reasoning systems, import/export and pluggable processes to support or observe team behaviour such as problem-solving.

Next step is to test value to different human-agent teams supporting different business functions. Through hardening and exposure to broader examples, this could become a more permanent capability for specific tasks such as intelligence analysis or situation awareness, and the creation of institutional repositories of task-relevant information.

Readiness & alternative Defence uses

TRL 3/4. The Cogni-sketch code is under active development by IBM UK and has been used in several experiments and use-cases ranging from open-source intelligence analysis to information fusion and agent integration. A secure cloud-based version is available for use on request by DAIS collaborators. Cogni-sketch has been released as open-source on GitHub.

Resources and references


IBM UK, Cardiff University