Faculty Bibliography

Drug addiction is associated with a relative devaluation of natural or socially-valued reinforcers that are unable to divert addicts from seeking and consuming the drug. Prior to protracted drug exposure, most rats prefer natural rewards, such as saccharin, over cocaine. However, a subpopulation of animals prefer cocaine over natural rewards and are thought to be vulnerable to addiction. Specific behavioural traits have been associated with different dimensions of drug addiction. For example, anxiety predicts loss of control over drug intake whereas sensation seeking and sign-tracking are markers of a greater sensitivity to the rewarding properties of the drug. However, how these behavioural traits predict the disinterest for natural reinforcers remain unknown. In a population of rats, we identified sensation seekers (HR) on the basis of elevated novelty-induced locomotor reactivity, high anxious rats (HA) based on the propensity to avoid open arms in an elevated-plus maze and sign-trackers (ST) that are prone to approach, and interaction with, reward-associated stimuli. Rats were then tested on their preference for saccharin over cocaine in a discrete-trial choice procedure. We show that HR rats display a greater preference for saccharin over cocaine compared to ST and HA whereas the motivation for the drug was comparable between the three groups. The present data suggest that high locomotor reactivity to novelty, or sensation seeking, by predisposing to an increased choice towards non-drug rewards at early stages of drug use history, may prevent the establishment of chronic cocaine use.Neuropsychopharmacology accepted article preview online, 14 August 2014; doi:10.1038/npp.2014.204.

This protocol details a free-operant avoidance paradigm that has been developed to evaluate the relative contribution of different sources of reinforcement of avoidance behavior that may play an important role in the development and maintenance of human anxiety disorders. The task enables the assessment of the effects of safety cues that signal a period free from danger on lever-press avoidance behavior. Avoidance behavior trained using this protocol has been shown to be sensitive to both behavioral and pharmacological manipulations and has been optimized so that it takes approximately 1 month for rats to perform at high levels of stable avoidance responding. (c) 2015 by John Wiley & Sons, Inc.

BACKGROUND: N-methyl-d-aspartate receptor (NMDAR) dysfunction is thought to contribute to the pathophysiology of schizophrenia. Accordingly, NMDAR antagonists such as phencyclidine (PCP) are used widely in experimental animals to model cognitive impairment associated with this disorder. However, it is unclear whether PCP disrupts the structural integrity of brain areas relevant to the profile of cognitive impairment in schizophrenia. METHODS: Here we used high-resolution magnetic resonance imaging and voxel-based morphometry to investigate structural alterations associated with sub-chronic PCP treatment in rats. RESULTS: Sub-chronic exposure of rats to PCP (5mg/kg twice daily for 7 days) impaired sustained visual attention on a 5-choice serial reaction time task, notably when the attentional load was increased. In contrast, sub-chronic PCP had no significant effect on the attentional filtering of a pre-pulse auditory stimulus in an acoustic startle paradigm. Voxel-based morphometry revealed significantly reduced grey matter density bilaterally in the hippocampus, anterior cingulate cortex, ventral striatum, and amygdala. PCP-treated rats also exhibited reduced cortical thickness in the insular cortex. CONCLUSIONS: These findings demonstrate that sub-chronic NMDA receptor antagonism is sufficient to produce highly-localized morphological abnormalities in brain areas implicated in the pathogenesis of schizophrenia. Furthermore, PCP exposure resulted in dissociable impairments in attentional function.

Safety signals provide "relief" through predicting the absence of an aversive event. At issue is whether these signals also act as instrumental reinforcers. Four experiments were conducted using a free-operant lever-press avoidance paradigm in which each press avoided shock and was followed by the presentation of a 5-sec auditory safety signal. When given a choice between two levers in Experiment 1, both avoiding shock, rats preferentially responded on the lever that produced the safety signal as feedback, even when footshock was omitted. Following avoidance training with a single lever in Experiment 2, removal of the signal led to a decrease in avoidance responses and an increase in responses during the safety period normally denoted by the signal. These behavioral changes demonstrate the dual conditioned reinforcing and fear inhibiting properties of the safety signal. The associative processes that support the reinforcing properties of a safety signal were tested using a novel revaluation procedure. Prior experience of systemic morphine during safety signal presentations resulted in an increased rate of avoidance responses to produce the safety signal during a drug-free extinction test, a finding not seen with d-amphetamine in Experiment 3. Morphine revaluation of the safety signal was repeated in Experiment 4 followed by a drug-free extinction test in which responses did not produce the signal for the first 10 min of the session. Instrumental avoidance in the absence of the signal was shown to be insensitive to prior signal revaluation, suggesting that the signal reinforces free-operant avoidance behavior through a habit-like mechanism.

BACKGROUND: The factors contributing to the development and severity of obsessive-compulsive spectrum disorders such as obsessive-compulsive disorder, Tourette's syndrome, pathological gambling, and addictions remain poorly understood, limiting the development of therapeutic and preventive strategies. Recent evidence indicates that impulse-control deficits may contribute to the severity of compulsivity in several of these disorders. This suggests that impulsivity may be a transnosological endophenotype of vulnerability to compulsivity. However, the precise nature of the link between impulsivity and compulsivity in anxiety-related compulsive disorders remains unknown. METHODS: We investigated the relationship between impulsivity and the development of a compulsive behavior in rats, which captures the hallmarks of compulsivity as defined in the DSM-IV--namely, that it is maladaptive, excessive, repetitive, and anxiolytic. RESULTS: We demonstrate that a high-impulsivity trait, as measured in the five-choice serial reaction time task, predicts an increased propensity to develop compulsivity as measured in a schedule-induced polydipsia procedure. Trait impulsivity and compulsivity were nonlinearly related. This impulsivity-compulsivity relationship was lost after the development of compulsivity or under chronic treatment with atomoxetine, a noradrenergic reuptake inhibitor used to treat attention-deficit/hyperactivity disorder. Atomoxetine treatment both decreased impulsivity and prevented the development of compulsivity in high-impulsive animals. CONCLUSIONS: These observations provide insight into the reciprocal influence of impulsivity and compulsivity in compulsive disorders and suggest that atomoxetine may be a useful treatment for patients suffering from obsessive-compulsive spectrum disorders with high impulsivity.

Excessive checking is a common, debilitating symptom of obsessive-compulsive disorder (OCD). In an established rodent model of OCD checking behaviour, quinpirole (dopamine D2/3-receptor agonist) increased checking in open-field tests, indicating dopaminergic modulation of checking-like behaviours. We designed a novel operant paradigm for rats (observing response task (ORT)) to further examine cognitive processes underpinning checking behaviour and clarify how and why checking develops. We investigated i) how quinpirole increases checking, ii) dependence of these effects on D2/3 receptor function (following treatment with D2/3 receptor antagonist sulpiride) and iii) effects of reward uncertainty. In the ORT, rats pressed an 'observing' lever for information about the location of an 'active' lever that provided food reinforcement. High- and low-checkers (defined from baseline observing) received quinpirole (0.5mg/kg, 10 treatments) or vehicle. Parametric task manipulations assessed observing/checking under increasing task demands relating to reinforcement uncertainty (variable response requirement and active-lever location switching). Treatment with sulpiride further probed the pharmacological basis of long-term behavioural changes. Quinpirole selectively increased checking, both functional observing lever presses (OLPs) and non-functional extra OLPs (EOLPs). The increase in OLPs and EOLPs was long-lasting, without further quinpirole administration. Quinpirole did not affect the immediate ability to use information from checking. Vehicle and quinpirole-treated rats (VEH and QNP respectively) were selectively sensitive to different forms of uncertainty. Sulpiride reduced non-functional EOLPs in QNP rats but had no effect on functional OLPs. These data have implications for treatment of compulsive checking in OCD, particularly for serotonin-reuptake-inhibitor treatment-refractory cases, where supplementation with dopamine receptor antagonists may be beneficial.

Safety signals (SSs) have been shown to reinforce instrumental avoidance behavior due to their ability to signal the absence of an aversive event; however, little is known of their neural mediation. This study investigated whether infusions of d-amphetamine in the nucleus accumbens (Nac), previously shown to potentiate responding for appetitive conditioned reinforcers (CRfs), also regulate avoidance responding for a SS. Rats were trained on a free-operant task in which lever-press responses avoided shock and were reinforced with an auditory SS. Rats were then cannulated in the Nac core (NacC) or shell (NacS) and infused with d-amphetamine and, in separate NacS groups, other drugs, before extinction sessions with the SS present or absent following responding. Selective effects of d-amphetamine were found in the NacS, but not in the NacC, when the SS was present in the session. A significant increase in response rate during the presentation of the SS reflected a disruption of its fear-inhibiting properties. In parallel, a decrease in avoidance response rate reflected the reduced influence of the SS as a CRf. Inactivation of the NacS reduced avoidance responding only when the SS was present in the session, whereas the D1-D2 DA receptor antagonist alpha-flupenthixol reduced responding both before and during the SS regardless of the presence of the SS. Atomoxetine (ATO), a selective noradrenaline reuptake inhibitor, had no effect on responding. These results indicate a role for the NacS in the mediation of the conditioned reinforcing properties of a SS. These effects appear to be modulated by dopaminergic mechanisms but seem distinct from those previously reported with food-related CRfs.

RATIONALE: Serotonin-1A (5-HT1A) receptors modulate the stress response and have been implicated in the etiology and treatment of depression and anxiety disorders. A reduction in postsynaptic 5-HT1A receptor function in limbic areas has consistently been observed following exposure to chronic stress. OBJECTIVES: To investigate the hypothesis that increased activation of 5-HT1A receptors in rats having reduced 5-HT function may improve stress adaptation and the behavioral sequelae commonly associated with chronic stress. METHODS: One hundred forty-four Sprague-Dawley rats received injections of para-chlorophenylalanine to partially deplete 5-HT then were given daily systemic pretreatment with the 5-HT1A receptor agonist, 8-hydroxy-2- (di-n-propylamino) tetralin (8-OH-DPAT), the antagonist, WAY 100635, or vehicle prior to either restraint stress (6 h/day for 10 daily sessions) or control conditions. Anxiety- and depressive-like behaviors were then assessed using the open field and sucrose preference tests. Protein level of hippocampal glucocorticoid receptors (GR) and mineralocorticoid receptors was detected by immunohistochemistry and brain-derived neurotrophic factor (BDNF) was determined by in situ hybridization. RESULTS: 8-OH-DPAT pretreatment prior to stress exposure attenuated later stress-induced anxiety- and depression-like behaviors and increased GR and BDNF mRNA expression in the hippocampus relative to vehicle- and WAY 100635-pretreated, stressed animals. CONCLUSION: The stress-related impairments associated with 5-HT deficiency can be improved by 8-OH-DPAT pretreatment prior to stress exposure and are associated with an augmentation of GR-like immunoreactivity and BDNF mRNA expression in the hippocampus. It suggested that selective activation of 5-HT1A receptors may be a potential treatment strategy for stress-related disorders such as anxiety and depression.

The associative processes that support free-operant instrumental avoidance behavior are still unknown. We used a revaluation procedure to determine whether the performance of an avoidance response is sensitive to the current value of the aversive, negative reinforcer. Rats were trained on an unsignaled, free-operant lever press avoidance paradigm in which each response avoided or escaped shock and produced a 5 s feedback stimulus. The revaluation procedure consisted of noncontingent presentations of the shock in the absence of the lever either paired or unpaired with systemic morphine and in a different cohort with systemic d-amphetamine. Rats were then tested drug free during an extinction test. In both the d-amphetamine and morphine groups, pairing of the drug and shock decreased subsequent avoidance responding during the extinction test, suggesting that avoidance behavior was sensitive to the current incentive value of the aversive negative reinforcer. Experiment 2 used central infusions of D-Ala(2), NMe-Phe(4), Gly-ol(5)]-enkephalin (DAMGO), a mu-opioid receptor agonist, in the periacqueductal gray and nucleus accumbens shell to revalue the shock. Infusions of DAMGO in both regions replicated the effects seen with systemic morphine. These results are the first to demonstrate the impact of revaluation of an aversive reinforcer on avoidance behavior using pharmacological agents, thereby providing potential therapeutic targets for the treatment of avoidance behavior symptomatic of anxiety disorders.

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu) meeting. A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits.