Wednesday, January 4, 2017


The robot in this video is a research platform for testing software for cognitive robotics and human-robot interactions. The knowledge gained from this research will be applied to firefighting robots used on ships. Through a combination of speech and visual recognition, the robot is able to identify trusted individuals, in this case, the human fire-fighting teammate. 

The human is able to provide situational information to the robot by voice and gestural commands. Here, the human partner is telling Octavia the general location of the fire before she enters the compartment. Using two infrared cameras, Octavia is able to localize the fire, allowing her to target it with the compressed air/water backpack.

Ongoing work is focused on improving the naturalness of the interactions so that the human partners can interact with the robot as if it were another human teammate. Additional work is focused on recognizing and characterizing the type and behavior of the fire so that proper extinguishing techniques can be used.