BI 036 Roshan Cools: Cognitive Control and Dopamine

Show notes:

Free Video Series: Open Questions in AI and Neuroscience:

Roshan and I discuss her work on the role of dopamine on our meta-control of cognition (cognitive control) in the basal ganglia and prefrontal cortex, the role of dopamine in reinforcement learning, how artificial intelligence might incorporate principles of neuromodulation to improve algorithms, being a woman in science, and much more.

[Skynet_the_AI]

I absolutely loved this podcast. My first time listening to your channel. The Youtube Algorithms strikes, on "time", as always... by the way, speaking of on "time", sorry as i am hearing your "annoying advertisements" line. And hear i am... 3, 4, 5 comments later. Just wanted to give this heart-felt thought. Thank You.

[greencoder]

*Personal Notes*

*Definition of Cognitive Control*
The ability to obtain goals while resisting distractions, temptations and uprising impulses.

*The Role of Neuromodulators in Evolution*
AI currently does not focus on neuromodulators.
Single-Celled organisms communicated with chemicals and still do so when forming multicellular orgasims.
neuromodulators could serve as communication between groups of cells.

*Communication serving Adaptation*
Neurotransmitters might dynamically regulate tradeoffs like focus vs flexibility.

*Mechanisms of Dopamine*
Effects of dopaminergic substances depends on the baseline level per brain region.

In attractor modles, dopamine modulates the gain, changing the depth of the energy wells, reducing likelyhood of having the prefrontal cortex network's active representation getting changed by new input.

In gating models for working memory, dopamine alters the selection for new inputs and suppression of old representations, rather than altering the memory of existing representations.

Dopamine might indirectly influence basal ganglia, altering cost and benefit evaluation.

*Outlook*
Current cognitive models need to be further formalized to allow for predictions and progress.
Dopamines role is not fully understood in terms of a reinforcment learning chemical linked to uncertainty and prediciton error.


*Philosophical Notes*
Prioritization requires a target.

Tradeoffs have dynamic Optima, depending on the environment.
Too much focus is not suited for a volatile environment requiring flexibility for adaptation.

Is unlimited meta-control optimal, if the meta-controller can reduce focus on lower levels of hierarchy?
What limits cognitive control?
Is there a cost to cognitive control?
Should flexibility only be activated in a controlled manner?


The human brain being able to solve certain agi problems in a highly energy-efficient manner hint at the fact that (besides hardware differences) the algorithmic and structural nature of the human brain has not yet been properly understood and implemented. Nonetheless, it's uncertain which tradeoffs loose and gain relevance given the unbounded access to resources and ultimately near-unlimited lifespan of artificial organisms.

[xstreamlymental]

At 40:00, finding the right balance between focus and flexibility is akin to the explore vs exploit problem, and I’m guessing still dependent on the statistics of the environment? I can imagine environments where it is beneficial to be always flexible

[Skynet_the_AI]

55:58 & 56:01 - an inside joke to "m y s e l f " (y o u
k n o w) lead me to yet, A N O T H E R "Boom!" moment, as i hear the suttle, yet distinct sound of a nose inhale... sniff. Bo Knows aka Bo Nose
🤯😉🤧🧠

[Skynet_the_AI]

I k n o w Y O U k n o w, t h a t W E K N O W!

[keghnfeem]

The move clans.


A organism is a clan of many units, cells, and groups of clans of organs.


All are working together. But the bickering in the clan of cells does not go away.
Just as in any organisation or neighborhood others will complain.


When the human body take a extreme action the blood sugar drops and lactic acid increases. Cells of the clan complain
that glucose is being taken away. So the brain has to bribe them with opiates reward to keep them quite. Or with some other
chemical that cause the skin to tingle. This will keep the muscles quite but the skin doing nothing will feel double reward.

[Skynet_the_AI]

Y o u k n o w I k n o w, t h a t Y o u k n o w . . .