Home Research Project Details Homeostasis Learning
Personal tools

Homeostasis Learning

Contact person:  Kolodziejski, Christoph 

Computational Neuroscience

In general organisms will try to maintain homeostastis responding to a disturbance with a compensatory reaction (often a reflex). The pain on touching a hot surface is usually followed by a withdrawal reflex. Due to the fact that all more advanced creatures possess far-sensors, which react to distance signals (like heat-radiation), animals can learn the correlation between an earlier occurring far-sensor signal and the corresponding – later occurring – near-sensor event. In our example one would like to learn the conjunction that heat-radiation predicts pain, which is a causal coupled temporal sequence of sensor events. Hence such a mechanism serves to learn predicting the environment of the animal/agent in a better way (predictive learning) and as a result the animal/agent will have learned anticipatory disturbance compensation.

Computational Neuroscience Over the years we have developed several algorithms for correlation based temporal sequence learning (ISO, ICO, ISO3-learning), which represent a form of differential Hebbian learning related to spike timing-dependent plasticity (STDP). Note these algorithms – different from conventional reinforcement learning – converge to stable synaptic weights as the consequence of a pure input-condition (input control).











Arm Rotate
Deflection of a mechanical arm disturbed by  a second one. After learning the deviation vanishes (taken from the ICO-Paper)

Currently we are using these algorithms for two sub-projects

Arm Rotate 1) To learn load compensation at a multi-joint robot arm, where the movement of one joint will lead to a predictable (hence learnable) torque change at the other joints. Here it is of importance to learn the “right degree” of compensation, which corresponds to a learned forward model of the system. To this end we are employing recruitment mechanisms similar to those used at real muscles.
Runbot_F2.jpg 2) Furthermore we are using the same learning algorithms to improve the dynamic stability of our fast biped walking robot “RunBot”, which is currently the fastest biped walker existing, attaining a relative speed of 3.5 leg-length per second (human record walkers arrive at about 4-4.5 leg-length per second)

Main cooperation partners:


Belongs to Group(s):
Computational Neuroscience

Members working within this Project:
Kolodziejski, Christoph 

Selected Publication(s):

Kulvicius, T, Porr, B, and Wörgötter, F (submitted).
Chaining learning architectures in a simple closed-loop behavioural context.
Biol Cybern:,. download file

Kolodziejski, C, Porr, B, and Wörgötter, F (2008).
Mathematical properties of neuronal TD-rules and differential Hebbian learning: a comparison
Biological Cybernetics 98(3):259-272.

Kolodziejski, C, Porr, B, and Wörgötter, F (2007).
Anticipative adaptive muscle control: Forward modeling with self-induced disturbances and recruitment
In: . In: . Proceedings of the sixteenth annual computational neuroscience meeting CNS*2007, Toronto. download file

Kulvicius, T, Porr, B, and Wörgötter, F (2007).
Development of Receptive Fields in a Closed-Loop Behavioural System
Neurocomputing in press. download file

Porr, B, and Wörgötter, F (2007).
Learning with Relevance: Using a third factor to stabilize Hebbian learning.
Neural Comp in press:,. download file

Porr, B, and Wörgötter, F (2007).
Fast heterosynaptic learning in a robot food retrieval task inspired by the limbic system.
Biosystems in press:,. download file

Porr, B, Kulvicius, T, and Wörgötter, F (2007).
Improved stability and convergence with three factor learning
Neurocomputing in press. download file

Wörgötter, F, and Porr, B (2007).
Reinforcement Learning
Scholarpedia http://www.scholarpedia.org/article/Reinforcement_Learning.

Kolodziejski, C, Porr, B, and Wörgötter, F (2006).
Fast, flexible and adaptive motor control achieved by pairing neuronal learning with recruitment
In: . Proceedings of the fifteenth annual computational neuroscience meeting CNS*2006, Edinburgh. download file

Porr, B, and Wörgötter, F (2006).
Strongly improved stability and faster convergence of temporal sequence learning by utilising input correlations only
Neural Comp. 18(6):1380-1412. download file

Porr, B, Egerton, A, and Wörgötter, F (2006).
Towards closed loop information: Predictive information
Constructivist Foundations 1(2):83-90. download file

Thompson, MA, Porr, B, and Wörgötter, F (2006).
Stabilising Hebbian learning with a third factor in a food retrieval task
SAB, Rome in press. download file

Wörgötter, F, Kolodziejski, C, and Porr, B (2006).
Comparing neuronal approaches for temporal sequence learning
Natural Computing (in press).

Wörgötter, F, and Porr, B (2005).
Temporal sequence learning, prediction and control - A review of different models and their relation to biological mechanisms
Neural Comp. 17:245–319. download file

Porr, B, and Wörgötter, F (2003).
Isotropic sequence order learning
Neural Comp. 15:831-864. download file

Porr, B, and Wörgötter, F (2003).
Learning a forward model of a reflex
Advances in Neural Information Processing Systems 15. download file

Porr, B, and Wörgötter, F (2003).
Isotropic sequence order learning in a closed loop behavioural system
Roy. Soc. Phil. Trans. Mathematical, Physical & Engineering Sciences 361(1811):2225--2244. download file

Porr, B, v Ferber, C, and Wörgötter, F (2003).
ISO-learning approximates a solution to the inverse controller problem in an unsupervised behavioural paradigm
Neural Comp. 15:865-884. download file

Porr, B, and Wörgötter, F (2002).
Isotropic sequence order learning in a closed loop behavioural system
Proceedings of the EPSRC/BBSRC International Workshop - Biologically-Inspired Robotics: The Legacy of W. Grey Walter 2002 in Bristol, HP technical report.

Porr, B, and Wörgötter, F (2002).
Isotropic sequence order learning using a novel linear algorithm in a closed loop behavioural system
BioSystems 67(1-3):195-202. download file

Porr, B, and Wörgötter, F (2002).
Predictive learning in rate-coded neural networks: A theoretical approach towards classical conditioning
Neurocomputing 44-46:585-590. download file

Porr, B, and Wörgötter, F (2001).
Temporal hebbian learning in rate-coded neural networks: A theoretical approach towards classical conditioning
Proc. Artificial Neural Networks, ICANN 2001 Vienna, Springer:1115-1120". download file