Motivation, reward and anhedonia

يَٰٓأَيُّهَا ٱلَّذِينَ ءَامَنُوٓاْ إِذَا تَدَايَنتُم بِدَيۡنٍ إِلَىٰٓ أَجَلࣲ مُّسَمࣰّ ى فَٱكۡتُبُوهُۚ وَلۡيَكۡتُب بَّيۡنَكُمۡ كَاتِبُۢ بِٱلۡعَدۡلِۚ وَلَا يَأۡبَ كَاتِبٌ أَن يَكۡتُبَ كَمَا عَلَّمَهُ ٱللَّهُۚ فَلۡيَكۡتُبۡ وَلۡيُمۡلِلِ ٱلَّذِي عَلَيۡهِ ٱلۡحَقُّ وَلۡيَتَّقِ ٱللَّهَ رَبَّهُۥ وَلَا يَبۡخَسۡ مِنۡهُ شَيۡـࣰٔ اۚ فَإِن كَانَ ٱلَّذِي عَلَيۡهِ ٱلۡحَقُّ سَفِيهًا أَوۡ ضَعِيفًا أَوۡ لَا يَسۡتَطِيعُ أَن يُمِلَّ هُوَ فَلۡيُمۡلِلۡ وَلِيُّهُۥ بِٱلۡعَدۡلِۚ وَٱسۡتَشۡهِدُواْ شَهِيدَيۡنِ مِن رِّجَالِكُمۡۖ فَإِن لَّمۡ يَكُونَا رَجُلَيۡنِ فَرَجُلࣱ وَٱمۡرَأَتَانِ مِمَّن تَرۡضَوۡنَ مِنَ ٱلشُّهَدَآءِ أَن تَضِلَّ إِحۡدَىٰهُمَا فَتُذَكِّرَ إِحۡدَىٰهُمَا ٱلۡأُخۡرَىٰۚ وَلَا يَأۡبَ ٱلشُّهَدَآءُ إِذَا مَا دُعُواْۚ وَلَا تَسۡـَٔمُوٓاْ أَن تَكۡتُبُوهُ صَغِيرًا أَوۡ كَبِيرًا إِلَىٰٓ أَجَلِهِۦۚ ذَٰلِكُمۡ أَقۡسَطُ عِندَ ٱللَّهِ وَأَقۡوَمُ لِلشَّهَٰدَةِ وَأَدۡنَىٰٓ أَلَّا تَرۡتَابُوٓاْ إِلَّآ أَن تَكُونَ تِجَٰرَةً حَاضِرَةࣰ تُدِيرُونَهَا بَيۡنَكُمۡ فَلَيۡسَ عَلَيۡكُمۡ جُنَاحٌ أَلَّا تَكۡتُبُوهَاۗ وَأَشۡهِدُوٓاْ إِذَا تَبَايَعۡتُمۡۚ وَلَا يُضَآرَّ كَاتِبࣱ وَلَا شَهِيدࣱۚ وَإِن تَفۡعَلُواْ فَإِنَّهُۥ فُسُوقُۢ بِكُمۡۗ وَٱتَّقُواْ ٱللَّهَۖ وَيُعَلِّمُكُمُ ٱللَّهُۗ وَٱللَّهُ بِكُلِّ شَيۡءٍ عَلِيمࣱ‏

You who believe, when you contract a debt for a stated term, put it down in writing: have a scribe write it down justly between you. No scribe should refuse to write: let him write as God has taught him, let the debtor dictate, and let him fear God, his Lord, and not diminish [the debt] at all. If the debtor is feeble-minded, weak, or unable to dictate, then let his guardian dictate justly. Call in two men as witnesses. If two men are not there, then call one man and two women out of those you approve as witnesses, so that if one of the two women should forget the other can remind her. Let the witnesses not refuse when they are summoned. Do not disdain to write the debt down, be it small or large, along with the time it falls due: this way is more equitable in God’s eyes, more reliable as testimony, and more likely to prevent doubts arising between you. But if the merchandise is there and you hand it over, there is no blame on you if you do not write it down. Have witnesses present whenever you trade with one another, and let no harm be done to either scribe or witness, for if you did cause them harm, it would be a crime on your part. Be mindful of God, and He will teach you: He has full knowledge of everything

O you who believe when you contract when you are dealing with a debt such as in prepayment for future delivery of goods or a loan one upon another for a stated a known term write it down as confirmation and security against any dispute; and let a writer write it the contract of debt down between you justly accurately not increasing or decreasing the amount or the terms; and let not any writer refuse to write it down if he is requested for such a task as God has taught him the kāf of ka-mā ‘as’ is semantically connected to the verb ya’ba ‘refuse’ that is just as He has given him the advantage of knowing how to write he should not be niggardly in this respect; so let him write repeated for emphasis and let the debtor dictate to the one writing the contract for he is the one being witnessed and must be fully aware of his obligations; and let him fear God his Lord when dictating and not dimi

O you who believe! When you contract a debt for a fixed period, write it down. Let a scribe write it down in justice between you. Let not the scribe refuse to write, as Allah has taught him, so let him write. Let him (the debtor) who incurs the liability dictate, and he must have Taqwa of Allah, his Lord, and diminish not anything of what he owes. But if the debtor is of poor understanding, or weak, or is unable to dictate for himself, then let his guardian dictate in justice. And get two witnesses out of your own men. And if there are not two men (available), then a man and two women, such as you agree for witnesses, so that if one of them (two women) errs, the other can remind her. And the witnesses should not refuse when they are called (for evidence). You should not become weary to write it (your contract), whether it be small or big, for its fixed term, that is more just with Allah;

حَدَّثَنَا هَدَّابُ بْنُ خَالِدٍ، حَدَّثَنَا حَمَّادُ بْنُ سَلَمَةَ، ح وَحَدَّثَنِي زُهَيْرُ بْنُ حَرْبٍ، حَدَّثَنَا مُعَاذُ بْنُ مُعَاذٍ الْعَنْبَرِيُّ، ح وَحَدَّثَنِي مُحَمَّدُ بْنُ عَبْدِ الأَعْلَى، حَدَّثَنَا الْمُعْتَمِرُ، ح وَحَدَّثَنَا إِسْحَاقُ، بْنُ إِبْرَاهِيمَ أَخْبَرَنَا جَرِيرٌ، كُلُّهُمْ عَنْ سُلَيْمَانَ التَّيْمِيِّ، ح وَحَدَّثَنَا أَبُو كَامِلٍ، فُضَيْلُ بْنُ حُسَيْنٍ - وَاللَّفْظُ لَهُ - حَدَّثَنَا يَزِيدُ بْنُ زُرَيْعٍ، حَدَّثَنَا التَّيْمِيُّ، عَنْ أَبِي عُثْمَانَ، عَنْ أُسَامَةَ بْنِ زَيْدٍ، قَالَ قَالَ رَسُولُ اللَّهِ صلى الله عليه وسلم ‏ "‏ قُمْتُ عَلَى بَابِ الْجَنَّةِ فَإِذَا عَامَّةُ مَنْ دَخَلَهَا الْمَسَاكِينُ وَإِذَا أَصْحَابُ الْجَدِّ مَحْبُوسُونَ إِلاَّ أَصْحَابَ النَّارِ فَقَدْ أُمِرَ بِهِمْ إِلَى النَّارِ وَقُمْتُ عَلَى بَابِ النَّارِ فَإِذَا عَامَّةُ مَنْ دَخَلَهَا النِّسَاءُ ‏"‏ ‏.‏

Usama b. Zaid reported that Allah's Messenger (way peace be upon him) said:I stood at the door of Paradise and I found that the overwhelming majority of those who entered therein was that of poor persons and the wealthy persons were detained to get into that. The denizens of Hell were commanded to get into Hell, and I stood upon the door of Fire and the majority amongst them who entered there was that of women

حَدَّثَنَا أَبُو كُرَيْبٍ، حَدَّثَنَا أَبُو أُسَامَةَ، عَنْ سَعِيدِ بْنِ أَبِي عَرُوبَةَ، سَمِعَ أَبَا رَجَاءٍ، عَنِ ابْنِ عَبَّاسٍ، قَالَ قَالَ رَسُولُ اللَّهِ صلى الله عليه وسلم فَذَكَرَ مِثْلَهُ ‏.‏

This hadith is narrated likewise through another chain of transmitters

حَدَّثَنَا عَبْدُ اللَّهِ بْنُ مَسْلَمَةَ بْنِ قَعْنَبٍ، حَدَّثَنَا سُلَيْمَانُ، - يَعْنِي ابْنَ بِلاَلٍ - عَنْ جَعْفَرٍ، عَنْ أَبِيهِ، عَنْ جَابِرِ بْنِ عَبْدِ اللَّهِ، أَنَّ رَسُولَ اللَّهِ صلى الله عليه وسلم مَرَّ بِالسُّوقِ دَاخِلاً مِنْ بَعْضِ الْعَالِيَةِ وَالنَّاسُ كَنَفَتَهُ فَمَرَّ بِجَدْىٍ أَسَكَّ مَيِّتٍ فَتَنَاوَلَهُ فَأَخَذَ بِأُذُنِهِ ثُمَّ قَالَ ‏"‏ أَيُّكُمْ يُحِبُّ أَنَّ هَذَا لَهُ بِدِرْهَمٍ ‏"‏ ‏.‏ فَقَالُوا مَا نُحِبُّ أَنَّهُ لَنَا بِشَىْءٍ وَمَا نَصْنَعُ بِهِ قَالَ ‏"‏ أَتُحِبُّونَ أَنَّهُ لَكُمْ ‏"‏ ‏.‏ قَالُوا وَاللَّهِ لَوْ كَانَ حَيًّا كَانَ عَيْبًا فِيهِ لأَنَّهُ أَسَكُّ فَكَيْفَ وَهُوَ مَيِّتٌ فَقَالَ ‏"‏ فَوَاللَّهِ لَلدُّنْيَا أَهْوَنُ عَلَى اللَّهِ مِنْ هَذَا عَلَيْكُمْ ‏"‏ ‏.‏

Jabir b. Abdullah reported that Allah's Apostle (ﷺ) happened to walk through the bazar coming from the side of 'Aliya and the people were on both his sides. There he found a dead lamb with very short ears. He took hold of his ear and said:Who amongst you would like to have this for a dirham? They said: We do not like to have it even for less than that as it is of no use to us. He said: Do you wish to have it (free of any cost)? They said: By Allah, even if it were alive (we would not have liked to possess that), for there is defect in it as its ear is very short; now it is dead also. Thereupon Allah's Messenger (ﷺ) said: By Allah, this world is more insignificant in the eye of Allah than it (this dead lamb) is in your eye

حَدَّثَنِي مُحَمَّدُ بْنُ الْمُثَنَّى الْعَنَزِيُّ، وَإِبْرَاهِيمُ بْنُ مُحَمَّدِ بْنِ عَرْعَرَةَ السَّامِيُّ، قَالاَ حَدَّثَنَا عَبْدُ الْوَهَّابِ، - يَعْنِيَانِ الثَّقَفِيَّ - عَنْ جَعْفَرٍ، عَنْ أَبِيهِ، عَنْ جَابِرٍ، عَنِ النَّبِيِّ صلى الله عليه وسلم ‏.‏ بِمِثْلِهِ غَيْرَ أَنَّ فِي حَدِيثِ الثَّقَفِيِّ فَلَوْ كَانَ حَيًّا كَانَ هَذَا السَّكَكُ بِهِ عَيْبًا ‏.‏

Jabir reported Allah's Apostle (ﷺ) narrating a hadith like this with a slight variation of wording

حَدَّثَنَا الْمَكِّيُّ بْنُ إِبْرَاهِيمَ، أَخْبَرَنَا عَبْدُ اللَّهِ بْنُ سَعِيدٍ ـ هُوَ ابْنُ أَبِي هِنْدٍ ـ عَنْ أَبِيهِ، عَنِ ابْنِ عَبَّاسٍ ـ رضى الله عنهما ـ قَالَ قَالَ النَّبِيُّ صلى الله عليه وسلم ‏ "‏ نِعْمَتَانِ مَغْبُونٌ فِيهِمَا كَثِيرٌ مِنَ النَّاسِ، الصِّحَّةُ وَالْفَرَاغُ ‏"‏‏.‏ قَالَ عَبَّاسٌ الْعَنْبَرِيُّ حَدَّثَنَا صَفْوَانُ بْنُ عِيسَى، عَنْ عَبْدِ اللَّهِ بْنِ سَعِيدِ بْنِ أَبِي هِنْدٍ، عَنْ أَبِيهِ، سَمِعْتُ ابْنَ عَبَّاسٍ، عَنِ النَّبِيِّ صلى الله عليه وسلم مِثْلَهُ‏.‏

Narrated Ibn `Abbas:The Prophet (ﷺ) said: "There are two blessings that many people are deceived into losing: health and free time

حَدَّثَنِي أَحْمَدُ بْنُ الْمِقْدَامِ، حَدَّثَنَا الْفُضَيْلُ بْنُ سُلَيْمَانَ، حَدَّثَنَا أَبُو حَازِمٍ، حَدَّثَنَا سَهْلُ بْنُ سَعْدٍ السَّاعِدِيُّ، كُنَّا مَعَ رَسُولِ اللَّهِ صلى الله عليه وسلم فِي الْخَنْدَقِ وَهْوَ يَحْفِرُ وَنَحْنُ نَنْقُلُ التُّرَابَ وَيَمُرُّ بِنَا فَقَالَ ‏ "‏ اللَّهُمَّ لاَ عَيْشَ إِلاَّ عَيْشُ الآخِرَهْ، فَاغْفِرْ لِلأَنْصَارِ وَالْمُهَاجِرَهْ ‏"‏‏.‏ تَابَعَهُ سَهْلُ بْنُ سَعْدٍ عَنِ النَّبِيِّ صلى الله عليه وسلم مِثْلَهُ‏.‏

Narrated Sahl bin Sa`d As-Sa`idi:We were in the company of Allah's Messenger (ﷺ) in (the battle of) Al-Khandaq, and he was digging the trench while we were carrying the earth away. He looked at us and said, "O Allah! There is no life worth living except the life of the Hereafter, so (please) forgive the Ansar and the Emigrants

ومن آدابه: أن لا يمتلئ من الطعام فى الليل، بل يأكل بمقدار، فانه ما ملأ ابن آدم وعاء شرا من بطن. ومتى شبع أول الليل لم ينتفع بنفسه فى باقيه، وكذلك إذا شبع وقت السحر لم ينتفع بنفسه إلى قريب من الظهر، لأن كثرة الأكل تورث الكسل والفتور، ثم يفوت المقصود من الصيام بكثرة الأكل، لأن المراد منه أن يذوق طعم الجوع، ويكون تاركا للمشتهى.

بين القبض والبسط أي ينقطع إلى صحبة الحال وهو الوارد الذي يرد على القلب من تأثيره بالمعاملة السالب لوصف الكسل والفتور الجالب له إلى مرافقة الرفيق الأعلى الذين أنعم الله عليهم فينتقل من مقام العلم إلى مقام الكشف ومن مقام رسوم الأعمال إلى مقام حقائقها وأذواقها ومواجيدها وأحوالها فيترقى من الإسلام إلى الإيمان ومن الإيمان إلى الإحسان

فحقيقة التعظيم للامر والنهي ان لا يعارضا بترخص جاف ولا يعرضا لتشديد غال فان المقصود هو الصراط المستقيم الموصل إلى الله عز وجل بسالكه وما امر الله عز وجل بأمر الا وللشيطان فيه نزغتان اما تقصير وتفريط واما افراط وغلو فلا يبالي بما ظفر من العبد من الخطيئتين فانه ياتي إلى قلب العبد فيستامه فان وجد فيه فتورا وتوانيا وترخيصا اخذه من هذه الخطة فثبطه واقعده وضربه بالكسل والتواني والفتور وفتح له باب التاويلات والرجاء وغير ذلك حتى ربما ترك العبد المامور جملة

العزيمة فيصدقه في عزمه وفي فعله قال تعالى فإذا عزم الأمر فلو صدقوا الله لكان خيرا لهم فسعادته في صدق العزيمة وصدق الفعل فصدق العزيمة جمعها وجزمها وعدم التردد فيها بل تكون عزيمة لا يشوبها تردد ولا تلوم فإذا صدقت عزيمته بقى عليه صدق الفعل وهو استفراغ الوسع وبذل الجهد فيه وأن لا يتخلف عنه بشيء من ظاهره وباطنه فعزيمة القصد تمنعه من ضعف الإرادة والهمة وصدق الفعل يمنعه من الكسل والفتور ومن صدق الله في جميع أموره صنع الله له فوق ما يصنع لغيره وهذا الصدق معنى يلتئم من صحة الإخلاص وصدق التوكل فأصدق الناس من صح إخلاصه وتوكله

فالإيمان بالصفات ومعرفتها وإثبات حقائقها وتعلق القلب بها وشهوده لها هو مبدأ الطريق ووسطه وغايته وهو روح السالكين وحاديهم إلى الوصول ومحرك عزماتهم إذا فتروا ومثير هممهم إذا قصروا فإن سيرهم إنما هو على الشواهد فمن كان لا شاهد له فلا سير له ولا طلب ولا سلوك له وأعظم الشواهد صفات محبوبهم ونهاية مطلوبهم وذلك هو العلم الذي رفع لهم في السير فشمروا إليه كما قالت عائشة رضي الله عنها من رأى رسول الله فقد رآه غاديا رائحا لم يضع لبنة على لبنة ولكن رفع له علم فشمر إليه ولا يزال العبد في التواني والفتور والكسل حتى يرفع الله عز وجل له بفضله ومنه علما يشاهده بقلبه فيشمر إليه ويعمل عليه

قال الله تعالى : ففروا إلى الله الذاريات : 50 ] وحقيقة الفرار : الهرب من شيء إلى شيء وهو نوعان : فرار السعداء وفرار الأشقياء ففرار السعداء : الفرار إلى الله عز وجل وفرار الأشقياء : الفرار منه لا إليه وأما الفرار منه إليه : ففرار أوليائه قال ابن عباس في قوله تعالى : ففروا إلى الله الذاريات : 50 ] : فروا منه إليه واعملوا بطاعته وقال سهل بن عبدالله : فروا مما سوى الله إلى الله وقال آخرون : اهربوا من عذاب الله إلى ثوابه بالإيمان والطاعة وقال صاحب المنازل : هو الهرب مما لم يكن إلى من لم يزل وهو على ثلاث درجات : فرار العامة من الجهل إلى العلم عقدا وسعيا ومن الكسل إلى التشمير جدا وعزما ومن الضيق إلى السعة ثقة ورجاء يريد بما لم يكن الخلق وبما لم يزل الحق وقوله : فرار العامة : من الجهل إلى العلم عقدا وسعيا الجهل نوعان : عدم العلم بالحق النافع وعدم العمل بموجبه ومقتضاه فكلاهما جهل لغة وعرفا وشرعا وحقيقة قال موسى : أعوذ بالله أن أكون من الجاهلين البقره : 67 ] لما قال له قومه : أتتخذنا هزوا البقره :

Anhedonia as a central factor in depression: Neural mechanisms revealed from preclinical to clinical evidence.: Anhedonia is one of the core symptoms of major depressive disorder (MDD), which is often inadequately treated by traditional antidepressants. The modern framework of anhedonia extends the definition from impaired consummatory pleasure or interest in rewards to a broad spectrum of deficits that impact functions such as reward anticipation, approach motivation, effort expenditure, reward valuation, expectation, and reward-cue association learning. Substantial preclinical and clinical research has

How to improve reward sensitivity - Predictors of long-term effects of a randomized controlled online intervention trial.: Background: Reward sensitivity is a central maintaining factor of depression. Current treatments fail at sufficiently and reliably modifying reward processing. Therefore, we employed interventions targeting reward sensitivity and evaluated the long-term efficacy of different online interventions, additionally exploring predictors of changes in reward sensitivity. Methods: This four-arm randomized controlled trial (RCT) tested the long-term stability of treatment effects during a four-month follo

Effectiveness of behavioral activation and mindfulness in increasing reward sensitivity and reducing depressive symptoms - A randomized controlled trial.: Reward insensitivity is a potential key mechanism regarding the maintenance of depression. However, there is a lack of research examining and comparing the effectiveness of different psychological interventions in modifying reward insensitivity. This four-arm randomized controlled trial (RCT) investigated a two-week online intervention. After screening for eligibility, a total of 336 participants were randomized, and 224 participated per-protocol. Participants were assigned to either a) behavior

'We pledge to improve the health of our entire community': Improving health worker motivation and performance in Bihar, India through teamwork, recognition, and non-financial incentives.: Background: Motivation is critical to health worker performance and work quality. In Bihar, India, frontline health workers provide essential health services for the state's poorest citizens. Yet, there is a shortfall of motivated and skilled providers and a lack of coordination between two cadres of frontline health workers and their supervisors. CARE India developed an approach aimed at improving health workers' performance by shifting work culture and strengthening teamwork and motivation. Th

A systematic review and meta-analysis of the effort-reward imbalance model of workplace stress with indicators of immune function.: Objective: Despite considerable research into associations between the effort reward imbalance (ERI) model and various health outcomes over the past 20years, the underlying mechanisms responsible for the association remain unclear. Recently, ERI investigations have examined associations with immune sub-systems (e.g., leukocytes, cytokines and immunoglobulins). Synthesis of the amalgamated research evidence will aid clarity to this field of enquiry. We conducted a meta-analysis and reviewed the a

The utility of monetary contingency contracts for weight loss: a systematic review and meta-analysis.: Financial incentives to improve health have received increasing attention, but are subject to ethical concerns. Monetary Contingency Contracts (MCCs), which require individuals to deposit money that is refunded contingent on reaching a goal, are a potential alternative strategy. This review evaluates systematically the evidence for weight loss-related MCCs. Randomised controlled trials testing the effect of weight loss-related MCCs were identified in online databases. Random-effects meta-analyse

Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment.

Significant evidence supports the view that dopamine shapes learning by encoding reward prediction errors. However, it is unknown whether striatal targets receive tailored dopamine dynamics based on regional functional specialization. Here, we report wave-like spatiotemporal activity patterns in dopamine axons and release across the dorsal striatum. These waves switch between activational motifs and organize dopamine transients into localized clusters within functionally related striatal subregions. Notably, wave trajectories were tailored to task demands, propagating from dorsomedial to dorsolateral striatum when rewards are contingent on animal behavior and in the opponent direction when rewards are independent of behavioral responses. We propose a computational architecture in which striatal dopamine waves are sculpted by inference about agency and provide a mechanism to direct credit…

matched on Reward (mesh)

Dopamine facilitates associative memory encoding in the entorhinal cortex.

Mounting evidence shows that dopamine in the striatum is critically involved in reward-based reinforcement learning1,2. However, it remains unclear how dopamine reward signals influence the entorhinal-hippocampal circuit, another brain network that is crucial for learning and memory3-5. Here, using cell-type-specific electrophysiological recording6, we show that dopamine signals from the ventral tegmental area and substantia nigra control the encoding of cue-reward association rules in layer 2a fan cells of the lateral entorhinal cortex (LEC). When mice learned novel olfactory cue-reward associations using a pre-learned association rule, spike representations of LEC fan cells grouped newly learned rewarded cues with a pre-learned rewarded cue, but separated them from a pre-learned unrewarded cue. Optogenetic inhibition of fan cells impaired the learning of new associations while sparing …

matched on Reward (mesh)

Dopamine release in the nucleus accumbens core signals perceived saliency.

A large body of work has aimed to define the precise information encoded by dopaminergic projections innervating the nucleus accumbens (NAc). Prevailing models are based on reward prediction error (RPE) theory, in which dopamine updates associations between rewards and predictive cues by encoding perceived errors between predictions and outcomes. However, RPE cannot describe multiple phenomena to which dopamine is inextricably linked, such as behavior driven by aversive and neutral stimuli. We combined a series of behavioral tasks with direct, subsecond dopamine monitoring in the NAc of mice, machine learning, computational modeling, and optogenetic manipulations to describe behavior and related dopamine release patterns across multiple contingencies reinforced by differentially valenced outcomes. We show that dopamine release only conforms to RPE predictions in a subset of learning scen…

matched on Reward (mesh)

Attenuated Directed Exploration during Reinforcement Learning in Gambling Disorder.

Gambling disorder (GD) is a behavioral addiction associated with impairments in value-based decision-making and behavioral flexibility and might be linked to changes in the dopamine system. Maximizing long-term rewards requires a flexible trade-off between the exploitation of known options and the exploration of novel options for information gain. This exploration-exploitation trade-off is thought to depend on dopamine neurotransmission. We hypothesized that human gamblers would show a reduction in directed (uncertainty-based) exploration, accompanied by changes in brain activity in a fronto-parietal exploration-related network. Twenty-three frequent, non-treatment seeking gamblers and twenty-three healthy matched controls (all male) performed a four-armed bandit task during functional magnetic resonance imaging (fMRI). Computational modeling using hierarchical Bayesian parameter estimat…

matched on Reward (mesh)

Ageing is associated with disrupted reinforcement learning whilst learning to help others is preserved.

Reinforcement learning is a fundamental mechanism displayed by many species. However, adaptive behaviour depends not only on learning about actions and outcomes that affect ourselves, but also those that affect others. Using computational reinforcement learning models, we tested whether young (age 18-36) and older (age 60-80, total n = 152) adults learn to gain rewards for themselves, another person (prosocial), or neither individual (control). Detailed model comparison showed that a model with separate learning rates for each recipient best explained behaviour. Young adults learned faster when their actions benefitted themselves, compared to others. Compared to young adults, older adults showed reduced self-relevant learning rates but preserved prosocial learning. Moreover, levels of subclinical self-reported psychopathic traits (including lack of concern for others) were lower in older…

matched on Reward (mesh)

Greater decision uncertainty characterizes a transdiagnostic patient sample during approach-avoidance conflict: a computational modelling approach.

Background: Imbalances in approach-avoidance conflict (AAC) decision-making (e.g., sacrificing rewards to avoid negative outcomes) are considered central to multiple psychiatric disorders. We used computational modelling to examine 2 factors that are often not distinguished in descriptive analyses of AAC: decision uncertainty and sensitivity to negative outcomes versus rewards (emotional conflict). Methods: A previously validated AAC task was completed by 478 participants, including healthy controls (n = 59), people with substance use disorders (n = 159) and people with depression and/or anxiety disorders who did not have substance use disorders (n = 260). Using an active inference model, we estimated individual-level values for a model parameter that reflected decision uncertainty and another that reflected emotional conflict. We also repeated analyses in a subsample (59 healthy control…

matched on Reward (mesh)

Association of Inflammatory Activity With Larger Neural Responses to Threat and Reward Among Children Living in Poverty.

Objective: Children exposed to severe, chronic stress are vulnerable to mental and physical health problems across the lifespan. To explain how these problems develop, the neuroimmune network hypothesis suggests that early-life stress initiates a positive feedback loop between peripheral inflammatory cells and networked brain regions involved in threat and reward processing. The authors sought to test this hypothesis by studying a sample of urban children from diverse socioeconomic backgrounds. Methods: The authors examined the basic predictions of the neuroimmune network hypothesis in 207 children (mean age=13.9 years, 63% female; 33% Black; 30% Hispanic), focusing on poverty as a stressor. The children had fasting blood drawn to quantify five inflammatory biomarkers-C-reactive protein, tumor necrosis factor-α, and interleukins-6, -8, and -10-which were averaged to form a composite scor…

matched on Reward (mesh)

More Later: Delay of Gratification and Thought About the Future in Children.

We investigated whether individual differences in future time perception and the detail with which future events are imagined are related to children's delay of gratification. We administered a delay choice task (real rewards), a delay discounting task (hypothetical rewards), a novel future time perception measure, an episodic future thinking (EFT) interview and IQ measures to a sample of 7- to 11-year-olds (N = 132) drawn from a urban predominately white population in N. Ireland. We found a strong correlation between delay choice and delay discounting. Future time perception and EFT were related to delay discounting, however only the relation with future time perception survived controlling for age and IQ. Children who showed greater compression of future time periods were the steepest discounters.

matched on Reward (mesh)

Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards.

Optogenetic activation of serotonergic neurons in the dorsal raphe nucleus (DRN) enhances patience when waiting for future rewards, and this effect is maximized by both high probability and high timing uncertainty of reward. Here, we explored which serotonin projection areas contribute to these effects using optogenetic axon terminal stimulation. We found that serotonin stimulation in the orbitofrontal cortex (OFC) is nearly as effective as that in the DRN for promoting waiting, while in the nucleus accumbens, it does not promote waiting. We also found that serotonin stimulation in the medial prefrontal cortex (mPFC) promotes waiting only when the timing of future rewards is uncertain. Our Bayesian decision model of waiting assumed that the OFC and mPFC calculate the posterior probability of reward delivery separately. These results suggest that serotonin in the mPFC affects evaluation o…

matched on Reward (mesh)

Delayed gratification in New Caledonian crows and young children: influence of reward type and visibility.

Self-control underlies cognitive abilities such as decision making and future planning. Delay of gratification is a measure of self-control and involves obtaining a more valuable outcome in the future by tolerating a delay or investing a greater effort in the present. Contextual issues, such as reward visibility and type, may influence delayed gratification performance, although there has been limited comparative investigation between humans and other animals, particularly non-primate species. Here, we adapted an automated 'rotating tray' paradigm used previously with capuchin monkeys to test for delay of gratification ability that requires little pre-test training, where the subject must forgo an immediate, less preferred reward for a delayed, more preferred one. We tested New Caledonian crows and 3-5-year-old human children. We manipulated reward types to differ in quality or quantity …

matched on Reward (mesh)

Measuring habit formation through goal-directed response switching.

Reward-learning theory views habits as stimulus-response links formed through extended reward training. Accordingly, animal research has shown that actions that are initially goal-directed can become habitual after operant overtraining. However, a similar demonstration is absent in human research, which poses a serious problem for translational models of behavior. We propose that response-time (RT) switch cost after operant training can be used as a new, reliable marker for the operation of the habit system in humans. Using a new method, we show that RT switch cost demonstrates the properties that would be expected of a habitual behavior: (a) it increases with overtraining, (b) it increases when rewards are larger, and (c) it increases when time pressure is added to the task, thereby hindering the competing goal-directed system. These results offer a promising new pathway for studying th…

matched on Reward (mesh)

Dopaminergic and Prefrontal Basis of Learning from Sensory Confidence and Reward Value.

Deciding between stimuli requires combining their learned value with one's sensory confidence. We trained mice in a visual task that probes this combination. Mouse choices reflected not only present confidence and past rewards but also past confidence. Their behavior conformed to a model that combines signal detection with reinforcement learning. In the model, the predicted value of the chosen option is the product of sensory confidence and learned value. We found precise correlates of this variable in the pre-outcome activity of midbrain dopamine neurons and of medial prefrontal cortical neurons. However, only the latter played a causal role: inactivating medial prefrontal cortex before outcome strengthened learning from the outcome. Dopamine neurons played a causal role only after outcome, when they encoded reward prediction errors graded by confidence, influencing subsequent choices. …

matched on Reward (mesh)

Children Delay Gratification for Cooperative Ends.

To cooperate effectively, both in small-scale interactions and large-scale collective-action problems, people frequently have to delay gratification (i.e., resist short-term temptations in favor of joint long-term goals). Although delay-of-gratification skills are commonly considered critical in children's social-cognitive development, they have rarely been studied in the context of cooperative decision-making. In the current study, we therefore presented pairs of children (N = 207 individuals) with a modified version of the famous marshmallow test, in which children's outcomes were interdependently linked such that the children were rewarded only if both members of the pair delayed gratification. Children from two highly diverse cultures (Germany and Kenya) performed substantially better than they did on a standard version of the test, suggesting that children are more willing to delay …

matched on Reward (mesh)

Instrumental learning in a mouse model for obsessive-compulsive disorder: Impaired habit formation in Sapap3 mutants.

It has been hypothesized that maladaptive habit formation contributes to compulsivity in psychiatric disorders such as obsessive-compulsive disorder (OCD). Here, we used an established animal model of OCD, Sapap3 knockout mice (SAPAP3-/-), to investigate the balance of goal-directed and habitual behavior in compulsive individuals and if altered habit formation is associated with compulsive-like behavior. We subjected 24 SAPAP3-/- and 24 wildtype littermates (WT) to two different schedules of reinforcement in a within-subjects design: a random-ratio (RR) schedule to promote goal-directedness, and a random-interval (RI) schedule, known to facilitate habitual responding. SAPAP3-/- acquired responding under both schedules, but showed lower response rates and fewer attempts to collect food pellets than WT, indicative of altered reward processing. As expected, WT were sensitive to sensory-spec…

matched on Reward (mesh)

Dopamine-Evoked Synaptic Regulation in the Nucleus Accumbens Requires Astrocyte Activity.

Dopamine is involved in physiological processes like learning and memory, motor control and reward, and pathological conditions such as Parkinson's disease and addiction. In contrast to the extensive studies on neurons, astrocyte involvement in dopaminergic signaling remains largely unknown. Using transgenic mice, optogenetics, and pharmacogenetics, we studied the role of astrocytes on the dopaminergic system. We show that in freely behaving mice, astrocytes in the nucleus accumbens (NAc), a key reward center in the brain, respond with Ca2+ elevations to synaptically released dopamine, a phenomenon enhanced by amphetamine. In brain slices, synaptically released dopamine increases astrocyte Ca2+, stimulates ATP/adenosine release, and depresses excitatory synaptic transmission through activation of presynaptic A1 receptors. Amphetamine depresses neurotransmission through stimulation of ast…

matched on Reward (mesh)

Excitatory transmission from ventral pallidum to lateral habenula mediates depression.

Objectives: Lateral habenula (LHb) is a key brain structure for mediating behavioural responses to aversive stimuli. It receives presynaptic inputs from ventral pallidum (VP) which relates to reward, motivation and hedonics. This study investigated the role of glutamatergic VP-LH projection in negative emotions and depression-like behaviour. Methods: The glutamatergic VP-LHb circuits in Vglut2-Cre mice were activated or inhibited using optogenetic manipulation. Real time place aversion test was performed to access aversive behaviour. Mice underwent chronic social defeat stress or subthreshold social defeat stress paradigm. Then social interaction test and tail suspension test were carried out to evaluate the stress-induced depression-like behaviours. Results: Activation of VP-LHb glutamatergic projections induced aversive behaviour in the real time place aversion test. Activation of this…

matched on Reward (mesh)

Ugandan Jajjas: Antecedents and rewards of caring for grandchildren in the context of HIV.

Aims and objectives: The findings presented in this manuscript address two key research questions: (a) What factors contribute to the initiation and maintenance of the caregiving role as performed by the grandparent-caregivers; and (b) What are the perceived benefits of caregiving as reported by grandparent-caregivers? Background: Grandparents in sub-Saharan Africa have cared for their grandchildren for generations, yet little is known about this role in the context of the HIV epidemic. Although the impact of the epidemic is overwhelmingly negative, specifically in Uganda, knowledge of familial context and underlying motivations and rewards that incentivise grandparent-caregivers remains limited in the literature. Methods: Using a constructivist grounded theory approach, we explored the experiences of 32 Ugandan grandparents of grandchildren affected by HIV. Data were collected using a s…

matched on Reward (mesh)

Dopamine D2 receptors in discrimination learning and spine enlargement.

Dopamine D2 receptors (D2Rs) are densely expressed in the striatum and have been linked to neuropsychiatric disorders such as schizophrenia1,2. High-affinity binding of dopamine suggests that D2Rs detect transient reductions in dopamine concentration (the dopamine dip) during punishment learning3-5. However, the nature and cellular basis of D2R-dependent behaviour are unclear. Here we show that tone reward conditioning induces marked stimulus generalization in a manner that depends on dopamine D1 receptors (D1Rs) in the nucleus accumbens (NAc) of mice, and that discrimination learning refines the conditioning using a dopamine dip. In NAc slices, a narrow dopamine dip (as short as 0.4 s) was detected by D2Rs to disinhibit adenosine A2A receptor (A2AR)-mediated enlargement of dendritic spines in D2R-expressing spiny projection neurons (D2-SPNs). Plasticity-related signalling by Ca2+/calmod…

matched on Reward (mesh)

Amygdala-Midbrain Connections Modulate Appetitive and Aversive Learning.

The central amygdala (CeA) orchestrates adaptive responses to emotional events. While CeA substrates for defensive behaviors have been studied extensively, CeA circuits for appetitive behaviors and their relationship to threat-responsive circuits remain poorly defined. Here, we demonstrate that the CeA sends robust inhibitory projections to the lateral substantia nigra (SNL) that contribute to appetitive and aversive learning in mice. CeA→SNL neural responses to appetitive and aversive stimuli were modulated by expectation and magnitude consistent with a population-level salience signal, which was required for Pavlovian conditioned reward-seeking and defensive behaviors. CeA→SNL terminal activation elicited reinforcement when linked to voluntary actions but failed to support Pavlovian associations that rely on incentive value signals. Consistent with a disinhibitory mechanism, CeA inputs…

matched on Reward (mesh)

The role of D2 dopamine receptors in oxytocin induced place preference and anxiolytic effect.

Neuropeptide oxytocin (OT) is involved in the regulation of social and non-social behaviour. The central nucleus of amygdala (CeA), part of the limbic system, plays an important role in learning, memory, anxiety and reinforcing mechanisms. CeA has been shown to be rich in OT receptors in rodents. Our previous findings indicated that OT in the rat CeA has a dose dependent rewarding and anxiolytic effect. The aim of our present study was to examine in the CeA the possible interaction of OT and D2 dopamine (DA) receptor antagonist Sulpiride on reinforcement in place preference test and on anxiety in elevated plus maze test. Wistar rats were microinjected bilaterally with 10 ng OT. In different group of animals 4 μg D2 DA receptor antagonist was applied. Other animals received D2 DA receptor antagonist 15 min before 10 ng OT treatment or vehicle solution into the CeA. Rats receiving 10 ng OT…

matched on Reward (mesh)

Cognitive dynamics of intertemporal choice in gambling disorder.

Gambling Disorder (GD) is a behavioral addiction characterized by the persistence of recurrent gambling behaviors despite serious adverse consequences. One of the key features of GD is a marked inability to delay gratification and an overall impairment of decision-making mechanisms. Indeed, in intertemporal choice (ITC) tasks, GD patients usually display a marked tendency to prefer smaller-sooner over larger-later rewards (temporal discounting, TD). However, ITC represents a highly verbal/explicit measure, and as such it might not be sensitive to implicit decision biases. Here we sought to uncover the implicit mechanisms underlying the ITC impairment in GD by employing the process-tracing method of mouse kinematics. To this aim, we collected and analyzed ITCs and kinematics measures from 24 GD patients and 23 matched healthy control participants (HC). In line with the relevant literature…

matched on Reward (mesh)

Humans primarily use model-based inference in the two-stage task.

Distinct model-free and model-based learning processes are thought to drive both typical and dysfunctional behaviours. Data from two-stage decision tasks have seemingly shown that human behaviour is driven by both processes operating in parallel. However, in this study, we show that more detailed task instructions lead participants to make primarily model-based choices that have little, if any, simple model-free influence. We also demonstrate that behaviour in the two-stage task may falsely appear to be driven by a combination of simple model-free and model-based learning if purely model-based agents form inaccurate models of the task because of misconceptions. Furthermore, we report evidence that many participants do misconceive the task in important ways. Overall, we argue that humans formulate a wide variety of learning models. Consequently, the simple dichotomy of model-free versus m…

matched on Reward (mesh)

Dopamine role in learning and action inference.

This paper describes a framework for modelling dopamine function in the mammalian brain. It proposes that both learning and action planning involve processes minimizing prediction errors encoded by dopaminergic neurons. In this framework, dopaminergic neurons projecting to different parts of the striatum encode errors in predictions made by the corresponding systems within the basal ganglia. The dopaminergic neurons encode differences between rewards and expectations in the goal-directed system, and differences between the chosen and habitual actions in the habit system. These prediction errors trigger learning about rewards and habit formation, respectively. Additionally, dopaminergic neurons in the goal-directed system play a key role in action planning: They compute the difference between a desired reward and the reward expected from the current motor plan, and they facilitate action …

matched on Reward (mesh)

The right temporoparietal junction enables delay of gratification by allowing decision makers to focus on future events.

Studies of neural processes underlying delay of gratification usually focus on prefrontal networks related to curbing affective impulses. Here, we provide evidence for an alternative mechanism that facilitates delaying gratification by mental orientation towards the future. Combining continuous theta-burst stimulation (cTBS) with functional neuroimaging, we tested how the right temporoparietal junction (rTPJ) facilitates processing of future events and thereby promotes delay of gratification. Participants performed an intertemporal decision task and a mental time-travel task in the MRI scanner before and after receiving cTBS over the rTPJ or the vertex (control site). rTPJ cTBS led to both stronger temporal discounting for longer delays and reduced processing of future relative to past events in the mental time-travel task. This finding suggests that the rTPJ contributes to the ability t…

matched on Reward (mesh)

Self-Controlled Choice Arises from Dynamic Prefrontal Signals That Enable Future Anticipation.

Self-control allows humans the patience necessary to maximize reward attainment in the future. Yet it remains elusive when and how the preference to self-controlled choice is formed. We measured brain activity while female and male humans performed an intertemporal choice task in which they first received delayed real liquid rewards (forced-choice trial), and then made a choice between the reward options based on the experiences (free-choice trial). We found that, while subjects were awaiting an upcoming reward in the forced-choice trial, the anterior prefrontal cortex (aPFC) tracked a dynamic signal reflecting the pleasure of anticipating the future reward. Importantly, this prefrontal signal was specifically observed in self-controlled individuals, and moreover, interregional negative coupling between the prefrontal region and the ventral striatum (VS) became stronger in those individu…

matched on Reward (mesh)