%0 Journal Article %J Adaptive Behavior %D 2016 %T Outline of a sensory-motor perspective on intrinsically moral agents %A Christian Balkenius %A Lola Cañamero %A Philip Pärnamets %A Birger Johansson %A Martin V Butz %A Andreas Olsson %X We propose that moral behaviour of artificial agents could (and should) be intrinsically grounded in their own sensory-motor experiences. Such an ability depends critically on seven types of competencies. First, intrinsic morality should be grounded in the internal values of the robot arising from its physiology and embodiment. Second, the moral principles of robots should develop through their interactions with the environment and with other agents. Third, we claim that the dynamics of moral (or social) emotions closely follows that of other non-social emotions used in valuation and decision making. Fourth, we explain how moral emotions can be learned from the observation of others. Fifth, we argue that to assess social interaction, a robot should be able to learn about and understand responsibility and causation. Sixth, we explain how mechanisms that can learn the consequences of actions are necessary for a robot to make moral decisions. Seventh, we describe how the moral evaluation mechanisms outlined can be extended to situations where a robot should understand the goals of others. Finally, we argue that these competencies lay the foundation for robots that can feel guilt, shame and pride, that have compassion and that know how to assign responsibility and blame. %B Adaptive Behavior %I SAGE %V 24 %P 306–319 %G eng %U https://journals.sagepub.com/doi/10.1177/1059712316667203 %N 5 %R 10.1177/1059712316667203 %0 Book Section %B Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior %D 2007 %T Anticipating Rewards in Continuous Time and Space: A Case Study in Developmental Robotics %A Arnaud J Blanchard %A Lola Cañamero %E Martin V Butz %E Olivier Sigaud %E Giovanni Pezzulo %E Gianluca Baldassarre %X This paper presents the first basic principles, implementation and experimental results of what could be regarded as a new approach to reinforcement learning, where agents—physical robots interacting with objects and other agents in the real world—can learn to anticipate rewards using their sensory inputs. Our approach does not need discretization, notion of events, or classification, and instead of learning rewards for the different possible actions of an agent in all the situations, we propose to make agents learn only the main situations worth avoiding and reaching. However, the main focus of our work is not reinforcement learning as such, but modeling cognitive development on a small autonomous robot interacting with an “adult” caretaker, typically a human, in the real world; the control architecture follows a Perception-Action approach incorporating a basic homeostatic principle. This interaction occurs in very close proximity, uses very coarse and limited sensory-motor capabilities, and affects the “well-being” and affective state of the robot. The type of anticipatory behavior we are concerned with in this context relates to both sensory and reward anticipation. We have applied and tested our model on a real robot. %B Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior %S Lecture Notes in Artificial Intelligence %I Springer %C Berlin, Heidelberg %V 4520 %P 267–284 %@ 978-3-540-74261-6 %G eng %U https://www.springer.com/gp/book/9783540742616 %R 10.1007/978-3-540-74262-3_15