Rensselaer Polytechnic Institute

Language, Embodiment, Intelligence, Agency

We develop computational cognitive models for AI that can explain, learn, and collaborate. Our research bridges cognitive science, linguistics, and robotics to create trustworthy, human-like intelligent systems.

OntoAgent

The cognitive architecture for intelligent agents with language, embodiment, and agency

OntoAgent provides a comprehensive framework for building agents capable of interpreting multiple input modalities, reasoning about goals and plans, and acting in real or simulated environments—all while maintaining transparency and trustworthiness.

OntoSem

Deep semantic analysis producing ontologically-grounded meaning representations.

OntoGen

Natural language generation from semantic representations to fluent text.

Metacognition

Agents that know what they know and can explain their own reasoning.

Memory & Planning

Episodic memory, knowledge bases, and goal-driven agenda management.

HARMONIC

Human-AI Robotic Team Member Operating with Natural Intelligence and Communication

Our flagship cognitive-robotic architecture integrates OntoAgent with general-purpose robot control systems. HARMONIC enables robots to reason about joint goals, explain their actions, and recognize when to defer to human teammates.

Natural Language

Meaningful, intentional communication grounded in semantic understanding.

Explainability

Transparent causal reasoning that humans can inspect and verify.

Human-Robot Teaming

Coordinated action with mutual trust and shared goal understanding.

Cognitive Control

Integration of high-level reasoning with low-level robot control.