BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Bordeaux Neurocampus - ECPv4.9.10//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Bordeaux Neurocampus
X-ORIGINAL-URL:https://www.bordeaux-neurocampus.fr/en/
X-WR-CALDESC:Events for Bordeaux Neurocampus
BEGIN:VTIMEZONE
TZID:Europe/Paris
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:20190331T010000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:20191027T010000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Europe/Paris:20191205T100000
DTEND;TZID=Europe/Paris:20191205T120000
DTSTAMP:20260422T010615
CREATED:20191113T114509Z
LAST-MODIFIED:20191120T135840Z
UID:112840-1575540000-1575547200@www.bordeaux-neurocampus.fr
SUMMARY:Thesis defense - Bhargav Teja Nallapu
DESCRIPTION:Venue : CGFB \nDefended in english \nBhargav Teja Nallapu\nIMN / Labri \nThesis supervisors: Frédéric ALEXANDRE\, Thierry VIEVILLE \n\nA closed loop framework of decision making and learning in primate prefrontal circuits: Computational modeling and Virtual experimentation \n\nAbstract\nThis thesis attempts to build a computational systems-level framework that would help to develop an understanding of the organization of the prefrontal cortex (PFC) and the basal ganglia (BG) systems and their functional interactions in the process of decision-making and goal-directed behaviour in humans. A videogame environment\, Minecraft is used to design experiments to test the framework in an environment that could be more complex and realistic\, if necessary. The framework\, along with virtual experimentation forms a closed-loop architecture for studying the high-level animal behavior. The neural systems framework in this work rests on the network dynamics between the subsystems of PFC and BG. PFC is believed to play a crucial role\, in executive functions like planning\, attention\, goal-directed behavior\, etc. BG are a group of sub-cortical nuclei that have been extensively studied in the field of motor control and action selection. Different regions in the PFC and structures within BG are anatomically organized\, in parallel and segregated loops (each of them referred as a CBG loop). These loops can be\, on a high level\, divided into 3 kinds : limbic loops\, associative loops and sensori-motor loops. \nFirst\, a comprehensive framework with the above mentioned parallel loops is implemented. The emphasis rests on the limbic loops. Therefore the associative and sensori-motor loops are modeled algorithmically\, taking help of the experimentation platform for motor control. As for the limbic loops\, the orbitofrontal cortex (OFC) is the part of a loop for preferences and the anterior cingulate cortex (ACC)\, for internal needs. These loops are formed through their limbic counterpart in BG\, ventral striatum (VS). VS has been widely studied and reported to be encoding various substrates of value\, forming an integral part of value-based decision making. Simplistic scenarios are designed in the virtual environment using the agent and some objects and appetitive rewards in the environment. The limbic loops have been implemented according to existing computational models of decision making in the BG. Thus the framework and the experimental platform stand as a testbed to computational models of specific processes that have to fit in a bigger picture. Next\, we use this framework to study more closely\, the role of OFC in value-guided decision making and goal-directed behavior. As part of this thesis\, several outstanding observations about the role of OFC in behavior have been summarized by consolidating numerous experimental evidences and reviews. \nLastly\, to explain the findings of different roles of lateral and medial regions of OFC\, existing computational architecture of CBG loops\, pavlovian learning in amygdala and multiple evidences of amygdala-OFC-VS interactions are put together into a single model. The learning rules of reinforcement have been adapted to accommodate the appropriate credit assignment (correct outcome to correct chosen stimulus) and the value difference of the choice options. As a result\, several findings from animal experiments studying the separable roles\, were replicated. Difference in choice impairments depending on the value difference between the best and the second best option is one of them. Dissociable roles in Pavlovian Instrumental Transfer were also observed. The investigations into the observed evidences around OFC offer great insight into understanding the very process of decision-making\, value computation in general. By venturing into a realm of bio-inspired adaptive learning in an embodied virtual agent\, describing the principles of motivation\, goal-selection and self-evaluation\, it is highlighted that the field of reinforcement learning and artificial intelligence has a lot to gain from studying the role of prefrontal systems in decision-making. \nKeywords: decision-making\, learning\, prefrontal cortex\, virtual experimentation\, goal-directed behaviour\, computational modeling \nPublications\nPublished pesearch : \nNallapu\, B. and Alexandre\, F. (2018). Cognitive Architecture and Software Environment for the Design and Experimentation of Survival Behaviors in Artificial Agents. In Proceedings of the 10th International Joint Conference on Computational Intelligence – Volume 1: IJCCI\, ISBN 978-989-758-327-8\, pages 152-159. DOI: 10.5220/0006920301520159 \nNallapu B.T.\, Alexandre F. (2018) A Survival Task for the Design and the Assessment of an Autonomous Agent. In: Vouloutsi V. et al. (eds) Biomimetic and Biohybrid Systems. Living Machines 2018. Lecture Notes in Computer Science\, vol 10928. Springer\, Cham \nArticle in preparation : \nNallapu B.T.\, Alexandre F. Interacting roles of lateral and medial Orbitofrontal Cortex in decision-making and learning : A systems-level computational model. \nJury\nNIKOLSKI Macha – CNRS – Président \nCANAMERO Lola – University of Hertfordshire\, U.K – Rapporteur \nBOURET Sebastien – CNRS – Rapporteur \nKHAMASSI Mehdi – CNRS – Examinateur \nCHAKRAVARTHY Srinivasa – I.I.T Madras\, India – Examinateur \nALEXANDRE Frédéric – INRIA – Directeur de thèse \nVIEVILLE Thierry – INRIA – Co-directeur de thèse \n  \n  \n
URL:https://www.bordeaux-neurocampus.fr/en/event/thesis-defense-bhargav-teja-nallapu/
CATEGORIES:Thesis
ATTACH;FMTTYPE=image/jpeg:https://www.bordeaux-neurocampus.fr/wp-content/uploads/2019/11/bhargav-vignette-DSC_5578.jpg
END:VEVENT
END:VCALENDAR