TY - CONF T1 - Biasing Neural Networks Towards Exploration or Exploitation Using Neuromodulation T2 - Proc. 17th International Conference on Artificial Neural Networks (ICANN 2007), Part II Y1 - 2007 A1 - Parussel, Karla A1 - Lola Cañamero ED - de Sá, Joaquim Marques ED - Alexandre, Luís A. ED - Duch, Włodzisław ED - Mandic, Danilo AB - Taking neuromodulation as a mechanism underlying emotions, this paper investigates how such a mechanism can bias an artificial neural network towards exploration of new courses of action, as seems to be the case in positive emotions, or exploitation of known possibilities, as in negative emotions such as predatory fear. We use neural networks of spiking leaky integrate-and-fire neurons acting as minimal disturbance systems, and test them with continuous actions. The networks have to balance the activations of all their output neurons concurrently. We have found that having the middle layer modulate the output layer helps balance the activations of the output neurons. A second discovery is that when the network is modulated in this way, it performs better at tasks requiring the exploitation of actions that are found to be rewarding. This is complementary to previous findings where having the input layer modulate the middle layer biases the network towards exploration of alternative actions. We conclude that a network can be biased towards either exploration of exploitation depending on which layers are being modulated. JF - Proc. 17th International Conference on Artificial Neural Networks (ICANN 2007), Part II T3 - LNCS PB - Springer Berlin Heidelberg CY - Porto, Portugal VL - 4669 SN - 978-3-540-74695-9 UR - https://link.springer.com/chapter/10.1007/978-3-540-74695-9_91 ER - TY - CONF T1 - A Bottom-Up Investigation of Emotional Modulation in Competitive Scenarios T2 - Proc. Second International Conference on Affective Computing and Intelligent Interaction (ACII 2007) Y1 - 2007 A1 - Lola Cañamero A1 - Avila-García, Orlando ED - Ana C R Paiva ED - Rui Prada ED - Rosalind W Picard AB - In this paper, we take an incremental, bottom-up approach to investigate plausible mechanisms underlying emotional modulation of behavior selection and their adaptive value in autonomous robots. We focus in particular on achieving adaptive behavior selection in competitive robotic scenarios through modulation of perception, drawing on the notion of biological hormones. We discuss results from testing our architectures in two different competitive robotic scenarios. JF - Proc. Second International Conference on Affective Computing and Intelligent Interaction (ACII 2007) T3 - Lecture Notes in Computer Science PB - Springer Berlin Heidelberg CY - Lisbon, Portugal VL - 4738 SN - 978-3-540-74888-5 ER - TY - CONF T1 - Building Emotional Artifacts in Social Worlds: Challenges and Perspectives T2 - Emotional and Intelligent II: The Tangled Knot of Social Cognition; Papers from the 2001 AAAI Fall Symposium Y1 - 2001 A1 - Cañamero, Lola D ED - Cañamero, Lola D AB - This paper discusses ideas relative to the construction of emotional artifacts that have to interact in a social world, and in particular with humans. It first examines some of the ways in which emotions can enhance social interactions with artifacts, and some of the challenges posed to the designer. After considering the debate that opposes "shallow" versus "deep" modeling, it sketches some ways in which we can anchor emotions in the architecture of artifacts in order to make emotional interactions meaningful not only to the human, but also to the artifact itself. It finally outlines some of the cognitive capabilities that artifacts should incorporate for their emotions to be properly grounded and to give rise to rich social exchanges with humans. JF - Emotional and Intelligent II: The Tangled Knot of Social Cognition; Papers from the 2001 AAAI Fall Symposium PB - AAAI Press CY - North Falmouth, Massachusetts SN - 978-1-57735-136-8 ER -