Evidence for impulsivity in the Spontaneously Hypertensive Rat drawn from complementary response-withholding tasks
© Sanabria and Killeen; licensee BioMed Central Ltd. 2008
Received: 27 September 2007
Accepted: 08 February 2008
Published: 08 February 2008
The inability to inhibit reinforced responses is a defining feature of ADHD associated with impulsivity. The Spontaneously Hypertensive Rat (SHR) has been extolled as an animal model of ADHD, but there is no clear experimental evidence of inhibition deficits in SHR. Attempts to demonstrate these deficits may have suffered from methodological and analytical limitations.
We provide a rationale for using two complementary response-withholding tasks to doubly dissociate impulsivity from motivational and motor processes. In the lever-holding task (LHT), continual lever depression was required for a minimum interval. Under a differential reinforcement of low rates schedule (DRL), a minimum interval was required between lever presses. Both tasks were studied using SHR and two normotensive control strains, Wistar-Kyoto (WKY) and Long Evans (LE), over an overlapping range of intervals (1 – 5 s for LHT and 5 – 60 s for DRL). Lever-holding and DRL performance was characterized as the output of a mixture of two processes, timing and iterative random responding; we call this account of response inhibition the Temporal Regulation (TR) model. In the context of TR, impulsivity was defined as a bias toward premature termination of the timed intervals.
The TR model provided an accurate description of LHT and DRL performance. On the basis of TR parameter estimates, SHRs were more impulsive than LE rats across tasks and target times. WKY rats produced substantially shorter timed responses in the lever-holding task than in DRL, suggesting a motivational or motor deficit. The precision of timing by SHR, as measured by the variance of their timed intervals, was excellent, flouting expectations from ADHD research.
This research validates the TR model of response inhibition and supports SHR as an animal model of ADHD-related impulsivity. It indicates, however, that SHR's impulse-control deficit is not caused by imprecise timing. The use of ad hoc impulsivity metrics and of WKY as control strain for SHR impulsivity are called into question.
Attention Deficit Hyperactivity Disorder (ADHD) is characterized by age-inappropriate levels of inattention, impulsivity, and hyperactivity . The most heavily cited theoretical account of ADHD claims that "the essential impairment in ADHD is a deficit involving response inhibition" . Inhibition, according to Barkley's theory, comprises three processes: (a) Inhibiting the initiation of responses that have been reinforced in the past but that are currently inappropriate; for example, restraining from playing in classroom; (b) Discontinuing ongoing responses that are no longer functional, as when loud talking is halted at the beginning of a lecture; (c) Initiation and maintenance of behaviors that compete with the proscribed response, as opening a conversation could distract from the temptation to skip lines, or to respond aggressively. According to this theory , deficits in response inhibition yield the executive functioning profile that characterizes ADHD. Most current models of ADHD regularly compare their claims against those of the executive functions model, whether or not they subscribe to it [3–7].
The ability to inhibit reinforced responses is widely studied using the Differential Reinforcement of Low rates (DRL) preparation in both humans [8–13] and animals [14–18]. In DRL, a response (pressing a button or a lever) is reinforced only after a specified interval has elapsed since the last response. Premature responses are often labeled impulsive. The opposite of impulsivity, self control, is typically measured as efficiency: the proportion of inter-response times (IRT) longer than the target interval. It is important to note that efficiency does not differentiate between IRTs that are just longer than the target interval from those much longer; such very long lapses may result from task delinquency rather than self-control, and, by decreasing the rate of reinforcement, are themselves a source of inefficiency.
The relation between DRL efficiency and ADHD is unclear. Gordon  found that 6–8 year old boys rated as hyperactive by their teachers were less efficient in DRL with a 6-s target interval (DRL 6 s) than was a control group. Mancebo  found similar results using DRL 5 s. With sufficient training, however, children with ADHD in Mancebo's study acquired behavioral strategies that brought their performance up to the level of control children (see also ). In contrast, Daugherty and Quay , and Avila and colleagues  did not find a correlation between DRL efficiency and ratings of ADHD symptoms in school-age children. Despite these disagreements, Gordon's procedure is widely used for diagnosing impulsivity in ADHD .
Assays of impulsivity based on DRL in the Spontaneously Hypertensive Rat (SHR), an animal model of ADHD, have also been problematic. Bull and colleagues  showed that SHR were more efficient than Sprague-Dawley (CD) rats in DRL 60 s, suggesting that SHR were less impulsive than a conventional laboratory strain of rats – if indeed inefficiency is a valid measure of impulsivity. Using DRL 72 s, van den Bergh and colleagues  concluded that Wistar (WST) rats, another conventional laboratory strain, were not more efficient than SHR. Furthermore, these authors did not observe significant improvements in SHR performance when the rats were administered methylphenidate, a drug shown to enhance inhibitory control of ADHD patients [24, 25]. Using a modified version of DRL which controlled for rate of reinforcement, Sagvolden and Berger  found that SHR responded more than WKY, but it is unclear whether or not the mean waiting time was substantially shorter for SHR than for WKY.
There are various potential explanations for the failure to detect impulsivity in SHR using DRL. It is possible that SHR do not display the kind of impulsivity that characterizes ADHD, despite analogous performance of SHR and children with ADHD in other behavioral tasks [27–29]. Another possibility is that the DRL task does not elicit ADHD-related impulsivity, as suggested by some reports [11, 12]. In this paper we consider two alternative accounts of performance in DRL. Both accounts are consistent with the characterization of SHR as a valid animal model of ADHD, and with evidence that response-withholding tasks like DRL tap into ADHD-related impulsivity.
Impulsivity and incentive motivation in DRL
Failure to detect abnormal levels of impulsivity in SHR may be related to the sensitivity of DRL performance to incentive motivation : A subject that is not motivated to complete the DRL task may engage in other activities, producing longer IRTs that would be wrongly attributed to self control. With very long target times, such as those used by Bull et al.  and van den Bergh et al. , it is possible that successful performance is a result of periodic desertion of the task due to flagging motivation, rather than controlled waiting associated with self-control. Failure to detect abnormal impulsivity in SHR using DRL may be due to SHR's reduced motivation for the incentive relative to control strains – more frequent desertion of the waiting task may have been wrongly interpreted as more controlled waiting.
To isolate impulsivity from motivation, we propose to complement measures obtained from DRL with those obtained from a lever-holding task (LHT). In LHT, releasing a lever or button is reinforced only if it had been pressed longer than a specified interval; early releases restart the clock but are not reinforced. Variations of LHT have been used as a timing task in animals [31, 32].
In LHT and DRL, reinforcement is contingent on emitting a response (lever or button press in DRL; lever or button release in LHT) after withholding it for a minimum time. Both tasks differ in what subjects are required to do between responses: Waiting activities in LHT are restricted to those that keep the switch depressed, whereas in DRL they are anything other than pressing the switch. Like short IRTs in DRL, short response durations in LHT are deemed impulsive. Supporting this characterization of LHT inefficiency, Baldwin and colleagues  demonstrated that methylphenidate reduces the variability of response durations and the frequency of very short durations in children with ADHD.
As the case for DRL, the interpretation of LHT performance is not without confounds. A subject exposed to LHT contingencies may produce shorter "impulsive" response durations because of reduced motivation or poor motor control, not because of an impulsive tendency to release the lever early. Conversely, reduced motivation and poor motor control are unlikely to contribute to shorter IRTs in DRL: Smaller rewards yield longer IRTs in rats and pigeons . Longer "self-controlled" IRTs in DRL may result from low motivation to complete the task. Conversely, reduced motivation is unlikely to result in longer response durations in LHT. Thus, demonstration of impulsivity in both LHT and DRL cannot be attributed to motor impairment or enhanced motivation. Some studies have taken advantage of the complementary nature of LHT and DRL to interpret the behavioral effects of drugs in rats [34–37] and to evaluate timing in children , as is our strategy here.
Efficiency and peak deviation
A second hypothesis concerning the failure to detect impulsivity in SHR using DRL derives from the use of DRL "efficiency" as an (inverse) measure of impulsivity. Efficiency is typically inferred from the proportion of responses that exceed the target interval. Efficiency measures are intuitive and descriptive, but do not take full advantage of the data for drawing inferences, as would a truly efficient model of the behavior. A change in efficiency indicates that the distribution of IRTs changed, but it does not tell us precisely how it changed . Four responses spaced just under the target interval followed by a reinforced response are given the same efficiency score (20%) as a burst of 4 closely spaced responses followed by a reinforced response; yet the former performance is more inefficient in most senses of that term. Moreover, despite having the same efficiency score, responses that are spaced almost right would score better in most measures of timing than a burst of responses would. DRL efficiency ignores much of the information contained in performance, some of which may be critical to distinguish levels of impulsivity across strains of rats.
Richards and colleagues  suggested an analytic technique that might characterize DRL performance using more information than is provided by efficiency measures. Their peak deviation analysis identifies deviations in the IRT distribution from a random process, defined as one in which interval terminations occur randomly with constant probability. A constant-rate random process entails a negative exponential distribution of IRTs. In DRL, very short IRTs ("bursts") and IRTs around the target interval ("peak") are typically much more frequent than expected from a constant-rate random process. Using this analysis, van den Bergh  showed that bursts tended to be more frequent and peak IRTs tended to be shorter in SHR than in Wistar (WST); these tendencies, however, did not reach statistical significance.
Peak deviation analysis may reveal differences in DRL performance between SHR and control strains, but it is unclear how these differences should be linked to impulsivity. In the following analysis we develop a plausible behavioral mechanism for both DRL and LHT performance, and test it against data collected from SHR and two other strains. Some of the model parameters are directly related to the ability of rats to inhibit responses, and thus provide a measure of impulsivity. We then evaluate differences in these parameters across strains and reconcile our conclusions with prior data reported on SHR impulsivity.
Experiment 1: Lever holding task (LHT)
Eighteen rats (Rattus norvegicus; Charles River), 6 of each of 3 strains (Spontaneously Hypertensive Rat, or SHR, Wistar-Kyoto, or WKY, and Long-Evans, or LE; Charles River Laboratories). WKY was selected as control strain because it is the normotensive genetic progenitor of SHR. LE is also normotensive, but genetic differences between SHR and LE are larger than between SHR and WKY and between SHR and other outbred strains such as Wistar. The use of LE facilitated the identification of candidate behavioral deficits that may have been obscured by behavioral peculiarities of WKY or by similarities with SHR in genetic make-up. Approximate age at the beginning of the experiment was 120 days for SHR, 170 days for WKY, and 130 days for LE. Rats were housed individually in a room with a 12:12-hr light:dark cycle, with dawn at 1800 hr; experiments were conducted only during the dark cycle, the behavioral "day" for this nocturnal species.
The rats' running weights were based on 85% of their expected free-feeding weights, as estimated from a logistic function fitted to the provider's growth curves. According to these curves, initial running weights were 290, 315, and 340 g for SHR, WKY, and LE, respectively. Target weights were already essentially asymptotic for SHR and WKY, but for LE were expected to rise by 50 g over the duration of the experiment.
Each rat was weighed immediately prior to an experimental session. When required, supplementary feeding of 8604 rodent chow (Harlan Teklad, Madison, WI) was given at the end of each day, no fewer than 12 hr before the next experimental session. Supplementary feeding amounts were based 50% on current deviations from running weight, and 50% on a 5-day moving average of the amount historically fed. Thus, for example, if a rat was 4 g below running weight, and it had been fed with a daily average of 2 g of supplementary chow during the last 5 days, 3 g of supplementary chow were provided for that day. This mild regression to the mean amount historically fed dampened vicissitudes in supplementary feeding. Water was always available in the home cages.
All animal handling procedures in this study followed National Institutes for Health guidelines and were approved by the Arizona State University Institutional Animal Care and Use Committee.
Experimental sessions were conducted in three MED Associates® modular test chambers (305 mm long, 241 mm wide, and 210 mm high), each enclosed in a sound- and light-attenuating box equipped with a ventilating fan. The floor consisted of thin metal bars above a catch pan. The front and rear walls and the ceiling of the experimental chambers were made of clear plastic, with the front wall hinged and functioning as a door to the chamber. A square aperture (51 mm sides) located 15 mm above the floor and centered on an aluminum side panel provided access to a receptacle (ENV-200-R2M) for 45 mg food pellets (Noyes Precision pellets, Improved Formula A/I, Research Diets, Inc., New Brunswick, NJ). Single pellets were delivered by each activation of a dispenser (ENV-203). Two retractable levers (ENV-112CM) flanked the food hopper. Only the lever closer to the chamber door, to the right of the hopper, was operative; the other lever remained retracted throughout the experiment. The center of the lever was 80 mm from the center of the food hopper, and 21 mm from the floor. Lever presses were recorded when a force of approximately 0.2 N was applied to the end of the lever. A clicker (MED ENV-135M) was located at the top left corner of the test panel; it was used to generate a unique salient cue that indicated food delivery. The ventilation fan mounted on the rear wall of the sound-attenuating chamber provided masking noise of approximately 60 dB. There was no illumination of the test chambers during experimental sessions. Experimental events were arranged via a Med-PC® interface connected to a PC controlled by Med-PC IV® software.
In the lever-holding task (LHT), holding down and then releasing a response lever was reinforced with food if the time it was held fell within an adjusting criterial range. The lower bound of the range was fixed during experimental sessions and served as target time (T), the minimum time rats had to hold for food. The upper bound of the range was adjusted to ensure that about two thirds of response durations longer than T were reinforced; the non-reinforced third were the longest durations. Upper-bound adjustment is analogous to the "limited hold" procedure used in DRL, where non-reinforcement of the longest IRTs is intended to discourage task delinquency; it allows for a direct comparison between LHT and DRL (with limited hold) performance. Target times were established in ascending order: 0.25, 0.5, 0.75, 1, 1.5, 2.25, 3.38, and 5 s. The lower bound of the range of reinforced durations was adjusted to transition between target times. Further procedural details are described below.
Outline of experimental sessions
Each session started with a 280 s habituation period, during which the response levers were retracted. Each trial was initiated by the insertion of the lever. If the rat held down the lever for more than 100 ms before releasing it, the response duration was recorded and the lever was temporarily retracted upon release. Response durations that fell within an adjusting criterial range were reinforced with two clicks separated by 0.5 s, followed by a food pellet. Durations outside that range were not reinforced. Inter-trial intervals (ITI) of 7.5 s started after reinforcement, or after lever retraction if there was no reinforcement; levers remained retracted during the ITI. Sessions ended after 200 reinforcers or 2 hr, whichever happened first.
Adjustment of criterial range
Once a target time was acquired, at least 2 more sessions (typically 4) were conducted before further increasing the target time. With every new target time, L was set to the prior target time; if necessary, U was adjusted to ensure that it was not below the new target time. The rules for the acquisition of new target times and for the adjustment of the reinforced range were always as depicted in Figure 1.
Rats that had not acquired a target time after 10 sessions were deemed "slow learners" and excluded from further participation in the experiment; data from prior target times, however, was used in analysis. To avoid overrepresentation of "fast learners" in a strain, the exclusion of a slow learner in a strain was compensated by the exclusion of the slowest learner (the one that took longest to acquire the target time that caused the exclusion) in each of the other strains.
Data analysis was based on performance on the last 2 sessions of each target time that was acquired in fewer than 10 sessions. Response durations were deemed stable for a strain during these 2 sessions if the median change between both sessions was less than 6%.
Rats took between 43 and 55 days to complete Experiment 1 [Additional file 1]. The median rat took 1 session to acquire T < 1.5 s and 2 sessions to acquire T ≥ 1.5 s. Only 3 rats failed to acquire a target time in less than 10 sessions (S4 at T = 1.5 s; S6 and W4 at T = 5 s). To compensate for their exclusion, data from W2 and L7 were excluded from T = 1.5 s and above, and data from L2 were excluded from T = 5 s. Rat L3 was accidentally not trained on T = 1.5 s, so data for this rat in this condition is missing – no compensation for "slow learning" was conducted. Response durations were stable for all strains in all target times, except for LE rats in T = 5 s and WKY rats in T = 0.25 s, where the median response duration increased by 12% and decreased by 10%, respectively, over the last 2 sessions.
Very long response durations can be even more inefficient than very short ones; a short response just under T can at most halve the rate of reinforcement; a long response can reduce it as 1/t. A more direct measure of efficiency is rate of reinforcement – the average number of reinforcers obtained on a minute of experimental session while the lever was extended. Applying this metric to LHT 5 s, LE was more efficient than SHR, collecting 5.6 reinforcers per minute, and SHR at 2.2 was more efficient than WKY at 1.6 reinforcers per minute.
The midpoints and slopes of cumulative distributions in Figure 3 were correlated with T, but for longer values of T distributions showed an extra inflection on the left side (see the bottom panel of Figure 3). This inflection represents a distinct population of short duration responses. What controls the parameters of this population of response durations? One possibility is that these were carried over from prior target times, but this is unlikely, for three reasons: 1. At short T, before the inflection in the distribution appeared, the probability density function of response durations was inverted-U shaped (e.g., Figure 3, inset of top panel), whereas the function of the inflection decreases monotonically as response duration increases. 2. When the inflection appeared, it increased the relative frequency of very short durations. 3. Such bimodal distributions have been reported before under widely different pre-training conditions, both in LHT (e.g., ) and for IRTs in DRL (e.g., ).
We suggest here that the bimodal distribution of response durations may be the output of two mechanisms operating in temporally regulated responses: A timing mechanism that produces a distribution of durations around the target times, and a random response process that produces shorter durations. The operation of these mechanisms is described more precisely by the Temporal Regulation (TR) model.
Temporal Regulation (TR) model
Characteristics of the Temporal Regulation (TR) model
Cumulative distribution function (cdf)
Mean iterative dwell = 1/λ
θ = μ/T; w = σ/μ
where B(t) is the proportion of response durations shorter than t, Φ is the normal cdf (mean μ = T θ, variance = σ2) of response durations outputted by the timing process, and λ is the iterative response rate. The inferred value of θ = μ/T indicates when timed responses are emitted relative to target, and thus serves as a measure of response inhibition in TR that may be compared across different target times T. In this pacemaker-counter timing module, the criterial value of n, N (Figure 4, left diagram), is conditioned by reinforcement, wherein values of criterion n associated with t < T are extinguished, and larger values (under the upper limit U) are reinforced.
We focus our analysis on the timing parameters of TR, θ and σ, because these are directly relevant to the evaluation of impulsivity and to the question of its basis in timing deficits. As pointed out by Richards and colleagues , the iterative response bursts are highly variable across animals, which obscure a meaningful interpretation of their parameters (λ or τ). Timing parameters were analyzed to determine whether differences across strains were reliable. Parameters were estimated for each rat by using Solver in Microsoft Excel to minimize the sum of squared deviations between the predictions of Equation 1 and the observed distribution of response durations. A protocol for this analysis based on Microsoft Excel is provided in the appendix [Additional file 2].
Mean temporal estimates: Accuracy
Changes in the distribution of timed responses as a function of target time T have been well described in the timing literature [41, 42]. Based on these precedents, we predicted a constant relative response threshold θ across T. Because the mean timed response is represented in TR as μ = θT + δ, θ can be efficiently estimated as the slope of a linear regression of μ on T. Responses cannot be of zero duration; the intercept of the regression, δ, estimates the minimum response duration in these circumstances. For large values of T the minimum can be set to zero, thus eliminating a nuisance parameter; but for the very small values of T studied in this experiment, that is not always possible. A model comparison determined which parameters of the linear regression (θ, δ, both θ and δ, or none) were required to vary across strains in order to describe changes in μ as a function of T. The criterion for model selection was determined using the corrected Akaike Information Criterion (AICc) . AICc increases with the residual sums of squares and with the number of free parameters; a smaller AICc thus indicates a better account of the data for the degrees of freedom (parameters) in the model. AICc is only meaningful as a relative value, therefore ΔAICc was computed for each model as the difference between its AICc and the lowest AICc. The most parsimonious model, with ΔAICc = 0, was selected if no other model was at least 10 points better. This process was repeated until all combinations of parameters had been explored. This algorithm guaranteed that the data were at least e10 times more likely given the selected model compared to more parsimonious models. Confidence in the model selection was computed using Killeen's p rep  for AIC comparisons between nested models . p rep is the estimated probability that the selection would be replicated, that is, that a replication would favor the selected model and not the best simpler model.
Variability of temporal estimates: Precision
To assess changes in the precision of the timing process, we describe changes in σ using the Generalized Weber's Law (GWL): , where w is the Weber fraction that represents proportional error in temporal discrimination, and c is constant error . A model comparison based on AICc, described above, determined which GWL parameters (w, c, both, or none) were required to vary across strains in order to describe changes in σ as a function of μ.
Estimation of TR parameters and model comparison
Model-comparison analysis for LHT: Timing accuracy and precision
Parameters varied across strains
θ and δ
Number of free parameters (k)
w and c
Number of free parameters (k)
LHT performance by SHR, WKY, and LE rats was well described by the mixture of exponentially and normally distributed response durations of the TR model. For all strains, the sensitivity of the normally distributed portion of the response durations to the target time supports its characterization as the output of a timing process. For SHR and LE it is a simple scalar process, whereas for WKY, the dispersion of the normally distributed durations did not accord with Weber's Law [47–49], increasing faster up to about 2 s and slower thereafter.
Mean timed responses were generally shorter for SHR and WKY than for LE rats, suggesting that SHR and WKY rats have a bias to release the lever earlier than LE rats. This result is consistent with SHR as an animal model of the response inhibition deficit that characterizes ADHD , but it is inconsistent with the use of WKY as a control strain: If SHRs are just as impulsive as WKY rats, the source of impulsivity may lie in their common genetic background, thus rendering SHR-WKY comparisons uninformative. The performance of SHR and WKY was similarly suboptimal, resulting in lower efficiency in producing intervals longer than the target time.
The dispersion of timed responses of SHR and LE, but not WKY, was well described by the linear function known as the Generalized Weber's Law. The parameters of SHR suggest that timing precision was not compromised in SHR: if anything, they are more precise than LE. Timing precision in SHR appears to be inconsistent with recent reports of poor time reproduction – the closest analog to LHT – in ADHD . These investigations, however, also indicate that ADHD patients, like SHRs, systematically underestimate long target intervals [52–57]. Only one of these reports describes a measure of precision that allows an estimation of Weber fraction w . This research indicates that children with ADHD are not only more impulsive than controls, but that their timing is also less precise. SHRs showed analogous impulsivity relative to LE, as shown by θSHR, but no comparable timing imprecision.
In synthesis, the idiosyncratic performance of WKY in LHT suggests that it may not be the appropriate control strain to evaluate impulsivity in SHR. A comparison between SHR and LE performance suggests that SHRs are less capable of inhibiting reinforced responses – the critical feature of ADHD-related impulsivity. This result may stem from an inhibitory deficit intrinsic to the SHR strain which would support its use as an animal model of ADHD-related impulsivity. This result could also be interpreted as a difficulty in holding down the lever for SHR, relative to LE, due to a motor limitation or its lower body weight; it could also be interpreted as diminished motivation due to lower rates of reinforcement (in turn derived from inefficient responding). Experiment 2 was intended to disambiguate these alternate interpretations of LHT data.
Experiment 2: Differential reinforcement of low rates (DRL)
Whereas LHT performance may be affected by the physical demands of holding down the lever, this factor is unlikely to be confounded with response inhibition in DRL performance. Moreover, shorter response durations in LHT would result in differences in rate of reinforcement that could further shorten response durations in a positive feedback loop; in such case, low rates of reinforcement in DRL would lengthen IRTs, which would increase rate of reinforcement, negatively feeding back IRTs. To the extent that rate of reinforcement influences response withholding, LHT and DRL performance should diverge.
To verify our interpretation of LHT data in terms of impulsivity and timing precision, we conducted 3 variations of DRL. First, rats were exposed to a conventional DRL 5 s schedule. Then, we instituted a DRL 5 s schedule with limited hold (DRL-LH 5 s), where very long IRTs were not reinforced. DRL-LH 5 s served a double purpose: First, a comparison between DRL 5 s with and without limited hold assessed the sensitivity of impulsivity and timing to the discouragement of long waiting times. Second, DRL-LH 5 s data was more directly comparable to LHT data, because both schedules had an upper limit. Finally, a DRL 60 s schedule was implemented, which also served two purposes: First, it verified that our conclusions could be generalized beyond T = 5 s, and second, it replicated Bull et al.'s  study, in which SHRs did not display impulsivity.
Subjects and Apparatus
The same 18 rats of Experiment 1 served, after approximately 60 days of resting, under the same housing, feeding, and handling conditions as in Experiment 1. The experiment was conducted in the same chambers used in Experiment 1, but the clicker was replaced with a Sonalert 2.9 kHz tone generator (ENV 223AM).
Differential Reinforcement of Low Rates (DRL) 5 s
After a 300 s habituation period, the lever was inserted. Each lever press that occurred within 100 ms of the prior response was ignored by the program as a lever-bounce. Each valid response started a timer and the next lever press stopped the timer. Inter-response times shorter than 5 s restarted the timer; IRTs longer than 5 s were always followed by a 0.5-s tone simultaneously with the delivery of a food pellet. The first response after a feeding started the timer again. Daily sessions ended after 150 pellets had been delivered or 55 min had elapsed, whichever happened first. Ten sessions were conducted.
DRL with Limited Hold (DRL-LH) 5 s
An adjusting limited hold was imposed on the DRL 5 s procedure. IRTs longer than the hold restarted the timer and were not followed by food. The upper bound of the hold was seeded at 10 s; it was adjusted down by 0.01 s after every feeding, and up by 0.03 s after every interval longer than the upper bound. Note that the limited hold in DRL works as the upper limit U in LHT, and its adjustment here parallels the adjustment of U in Experiment 1 after target acquisition. Thirteen sessions were conducted.
DRL 60 s
The DRL target time was increased substantially to replicate the contingencies of Bull et al. , who did not find support for impulsivity in SHR. It also approximates the conventional 72-s target time (T) used on impulsivity and anti-depressant assays based on DRL [23, 58]. Three changes were introduced to the DRL procedure. (a) The timer was restarted by every lever press. This meant that after a feeding, the rat did not have to press the lever to start the timer because the timer had been running since the reinforced lever press. (b) The limited hold was removed, and (c) after every feeding, T, originally 5 s, was increased by 0.75%. The adjusted T was carried over from session to session. Once it reached 60 s,T was kept constant at 60 s for 10 sessions.
Analysis was conducted on IRTs from the last 3 sessions of DRL 5 s and DRL-LH 5 s. Because response rates were substantially lower in DRL 60 s, analysis was conducted on the last 5 sessions of this schedule. IRTs were binned so that each bin contained 1% of a rat's data. Cumulative distributions similar to those of Figure 3 were constructed for each strain. A model-comparison analysis was conducted to determine whether TR's timing parameters were reliably different across strains. Once again, we asked whether θ and w varied across strains. Four models were compared using AICc. One model allowed none of the timing parameters to vary across strains; a second model allowed θ but not w to vary; a third one allowed w but not θ to vary; a fourth one allowed both parameters to vary. When fitting each model, estimates of q and λ were fitted to each individual animal. Model selection rules and confidence computation were the same as in Experiment 1. For comparison, this analysis was also conducted on the LHT 5 s data analyzed in Experiment 1.
The time to transit between DRL-LH 5 s and DRL 60 s varied widely between strains and within the LE strain. The mean number of sessions it took to reach the 60 s target was 51.8 (SD = 8) for SHR, 24.3 (SD = 4.4) for WKY, and 27.7 (SD = 12.1) for LE. As shown in the bottom panel of Figure 7, efficiency of all strains showed a disastrous decrease to less than 4% when the target time was 60 s.
Model-comparison analysis for LHT 5 s and DRL schedules
θ and w
LHT 5 s
DRL 5 s
DRL-LH 5 s
DRL 60 s
Response inhibition across tasks and target times
Two features of DRL were varied: the presence or absence of an upper limit (the limited hold) and the target time, 5 or 60 s. In all these variations, the performance of SHR, WKY, and LE rats was well described by the TR model (Figure 7).
One variation in particular, DRL-LH 5 s, is most readily comparable to LHT 5 s, because both schedules have the same target time and an adjusting upper limit. The critical difference between these schedules is what rats were required to do while "waiting": in LHT they had to wait holding down the lever, whereas in DRL they had to wait by staying away from the lever. The complementary nature of LHT and DRL permits establishing whether shorter timed responses are influenced by factors other than impulsivity. Estimates of TR timing parameters from DRL-LH 5 s were close to those obtained from LHT 5 s, suggesting that these parameters are relatively robust over the nature of the waiting responses. Without the limited hold, performance was generally both less accurate (deviations of response threshold θ from 1 were greater in all strains) and less precise (Weber fractions w were greater in all strains).
The invariance of parameter values across specific tasks indicates that TR has some generalizability. The relativized timing parameters it provides (θ and w) are also invariant across moderately short (1–5 s) target times. However, when the target time of DRL was 60 s, response thresholds declined and Weber fractions increased in all strains. We believe this was due to a mixture of timing responses that usually fell short, and an occasional return from delinquency that was usually reinforced. Lapses of attention may have garnered an occasional reinforcement for flagging performance and resuscitated behavior under DRL 60 s. In LHT, this safety net was not available. These differences are reflected in the fact that it would be virtually impossible for a LHT 60 s schedule to sustain any responding. Our results indicate that different processes may be engaged when target times are very different, which confounds the interpretation of changes in TR parameters across widely different target times.
Response inhibition across strains
SHRs had lower thresholds for responding (θ) than WKY and LE in DRL schedules, and lower thresholds than LE in LHT schedules. Whereas a reduced ability to press a lever and infrequent engagement in the waiting task would result in shorter LHT timed responses, the same deficits in DRL would result in longer timed responses. The complementary contingencies of LHT and DRL schedules provide converging evidence that impetuous responding reflected in lower values of θ for SHR cannot be attributed to motor deficits or differences in body weight. It is also very unlikely that impulsivity in SHR was confounded with reduced motivation due to low rate of reinforcement; such hypothesis may explain shorter response durations in LHT but not shorter IRTs in DRL. This evidence that response inhibition in SHR is impaired supports the use of SHR as an animal model of ADHD-related impulsivity.
Estimates of θ for WKY were substantially greater on DRL 5 s than on LHT 5 s (but was reined in somewhat by the limited-hold contingency). If WKY were less motivated or less able to work for food than other strains, we would expect increased desertion, which would help DRL performance but not LHT performance. This was just the difference we found. The hypothesis of reduced motivation in WKY is supported by evidence of reduced instrumental responding for sucrose pellets in this strain . Consistent with prior observations [22, 60], WKY's different thresholds in the complementary tasks suggests that this strain may not provide consistent baseline levels of response inhibition required for the assessment for impulsivity in SHR.
There were no systematic between-strain differences in the Weber fractions in DRL comparable to those seen in LHT (Figure 5), where LE were less precise than the other two strains. These results confirm that the precision of temporal estimates of SHRs is not compromised, unlike that of children with ADHD .
Bull and colleagues  compared the distribution of IRTs from SHR, WKY, and Sprague-Dawley (CD) rats under DRL 60 s. Estimates of TR timing parameters from Bull et al.'s data indicate that θSHR = 0.4 and θWKY = 0.69, which are comparable to our estimates (0.52 and 0.61 respectively; see Figure 8). It is surprising, however, that θCD = 0.33, which is even lower than the response threshold of SHR. Compared to our data, CD rats in Bull et al.'s experiment appear to be extraordinarily impulsive. Estimates of w in Bull et al.'s rats were substantially larger than in our Experiment 2: Whereas our estimates of w in DRL 60 s ranged between 0.4 and 0.5 (Figure 9), estimates for Bull et al's data ranged between 1.2 and 1.6. This is indicative of poorer control of lever pressing by the target time in Bull et al.'s rats. Furthemore, Bull et al's rats were substantially more efficient (10–35%) than ours (1–6%). Several factors in their investigation may have contributed to these effects. Mainly, we suspect that their large target-duration step size used for shaping DRL performance (DRL 30 s immediately preceded DRL 60 s) may have strained waiting times beyond schedule control. In contrast, we introduced DRL 60 s progressively over the course of many sessions, respecting each animal's pace of acquisition. Relative to our data, poorly timed responding in Bull et al's study resulted in flatter IRT distributions and, consequently, enhanced "efficiency". These differences in results underline the importance of shaping procedures in DRL and question the use of efficiency as a measure of impulsivity.
The failure to inhibit prepotent responses defines the kind of impulsivity that characterizes ADHD. We provided a rationale for using complementary response-withholding tasks to measure impulsivity. In both tasks, the performance of an animal model of ADHD (SHR) and two normotensive strains (WKY and LE) was well described by a mixture of timed and iterated responses; we call this description the Temporal Regulation (TR) model. The TR model delivered a threshold parameter θ, which permitted measurement of bias towards producing short timed responses, independent of the precision of those responses and independent of response bursts. We characterized significant deviations of this parameter below that of control strains as a measure of impulsivity. Lower response thresholds in SHR indicated that they are systematically more impulsive than WKY and LE in a manner that is consistent with the performance of humans with ADHD. This result supports the use of SHR as an animal model of ADHD-related impulsivity. The inconsistent performance of WKY across response-withholding tasks undermines its conventional use as non-impulsive control strain; conventional laboratory strains like LE, Wistar (WST), or Sprague-Dawley (CD) should be considered.
Although SHRs are impulsive, the precision of their temporal estimates is not compromised as has been suggested for ADHD . More research on timing in ADHD is required to verify, across tasks and motivational conditions [61, 62], whether or not timing is systematically altered in ADHD. In both animal and human research, we suggest that detailed distributions of response durations and IRTs be reported, so that parameters from TR and from other models of timing and impulsivity may be estimated.
NIMH R01 MH066860 supported this research. We thank Paul M. Jellison for data collection and animal handling, Vinesa Gomez for data analysis, and Lewis A. Bizo for advice. Correspondence concerning this article should be addressed to Federico Sanabria, Department of Psychology, Arizona State University, P.O. Box 871104, Tempe, Arizona 85287-1104, most expeditiously at Federico.Sanabria@asu.edu.
- APA: Diagnostic and statistical manual of mental disorders (DSM IV-TR). Washington DC, Author. 2000, FourthGoogle Scholar
- Barkley RA: Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychol Bull. 1997, 121: 65-94. 10.1037/0033-2909.121.1.65.View ArticlePubMedGoogle Scholar
- Scheres A, Oosterlaan J, Geurts H, Morein-Zamir S, Meiran N, Schut H, Vlasveld L, Sergeant JA: Executive functioning in boys with ADHD: primarily an inhibition deficit?. Arch Clin Neuropsychol. 2004, 19: 569-594. 10.1016/j.acn.2003.08.005.View ArticlePubMedGoogle Scholar
- Brocki KC, Bohlin G: Developmental change in the relation between executive functions and symptoms of ADHD and co-occurring behaviour problems. Infant Child Dev. 2006, 15: 19-40. 10.1002/icd.413.View ArticleGoogle Scholar
- Doyle AE: Executive functions in attention-deficit/hyperactivity disorder. J Clin Psychiatry. 2006, 67: 21-26.PubMedGoogle Scholar
- Waldman ID, Nigg JT, Gizer IR, Park L, Rappley MD, Friderici K: The adrenergic receptor alpha-2A gene (ADRA2A) and neuropsychological executive functions as putative endophenotypes for childhood ADHD. Cogn Affect Behav Neurosci. 2006, 6: 18-30.View ArticlePubMedGoogle Scholar
- Fuggetta GP: Impairment of executive functions in boys with attention deficit/hyperactivity disorder. Child Neuropsychol. 2006, 12: 1-21. 10.1080/09297040500203418.View ArticlePubMedGoogle Scholar
- Stein N, Landis R: Effects of age and collateral behavior on temporally discriminated performance of children. Percept Mot Skills. 1978, 47: 87-94.View ArticleGoogle Scholar
- Gordon M: Assessment of impulsivity and mediating behaviors in hyperactive and non-hyperactive boys. J Abnorm Child Psychol. 1979, 7: 317-326. 10.1007/BF00916541.View ArticlePubMedGoogle Scholar
- Vandenbroek MD, Bradshaw CM, Szabadi E: Performance of impulsive and non-impulsive subjects on 2 temporal differentiation tasks. Pers Indiv Dif. 1992, 13: 169-174. 10.1016/0191-8869(92)90039-R.View ArticleGoogle Scholar
- Daugherty TK, Quay HC: Response perseveration and delayed responding in childhood behavior disorders. J Child Psychol Psychiatry. 1991, 32: 453-461. 10.1111/j.1469-7610.1991.tb00323.x.View ArticlePubMedGoogle Scholar
- Avila C, Cuenca I, Felix V, Parcet MA, Miranda A: Measuring impulsivity in school-aged boys and examining its relationship with ADHD and ODD ratings. J Abnorm Child Psychol. 2004, 32: 295-304. 10.1023/B:JACP.0000026143.70832.4b.View ArticlePubMedGoogle Scholar
- Lane SD, Cherek DR, Rhoades HM, Pietras CJ, Tcheremissine OV: Relationships among laboratory and psychometric measures of impulsivity: implications in substance abuse and dependence. Addictive Disorders & Their Treatment. 2003, 2: 33-40. 10.1097/00132576-200302020-00001.View ArticleGoogle Scholar
- Stewart PW, Sargent DM, Reihman J, Gump BB, Lonky E, Darvill T, Hicks H, Pagano J: Response inhibition during differential reinforcement of low rates (DRL) schedules may be sensitive to low-level polychlorinated biphenyl, methylmercury, and lead exposure in children. Environ Health Perspect. 2006, 114: 1923-1929.PubMed CentralPubMedGoogle Scholar
- Bardo MT, Cain ME, Bylica KE: Effect of amphetamine on response inhibition in rats showing high or low response to novelty. Pharmacol Biochem Behav. 2006, 85: 98-104. 10.1016/j.pbb.2006.07.015.View ArticlePubMedGoogle Scholar
- Sable HJK, Powers BE, Wang VC, Widholm JJ, Schantz SL: Alterations in DRH and DRL performance in rats developmentally exposed to an environmental PCB mixture. Neurotoxicol and Teratol. 2006, 28: 548-556. 10.1016/j.ntt.2006.06.005.View ArticleGoogle Scholar
- Cheng RK, MacDonald CJ, Meck WH: Differential effects of cocaine and ketamine on time estimation: Implications for neurobiological models of interval timing. Pharmacol Biochem Behav. 2006, 85: 114-122. 10.1016/j.pbb.2006.07.019.View ArticlePubMedGoogle Scholar
- Miller JP, McAuley JD, Pang KCH: Effects of the NMDA receptor antagonist MK-801 on short-interval timing in rats. Behav Neurosci. 2006, 120: 162-172. 10.1037/0735-7044.120.1.162.View ArticlePubMedGoogle Scholar
- Mancebo M: Ability to postpone reinforcement by boys with attention deficit hyperactivity disorder. Hofstra University. 2002Google Scholar
- Tsoi MM, Nicholson JN: Children's use of verbal collaterals in DRL performance. British Journal of Developmental Psychology. 1984, 2: 307-313.View ArticleGoogle Scholar
- Mayes SD, Calhoun SL, Crowell EW: Clinical validity and interpretation of the Gordon Diagnostic System in ADHD assessments. Child Neuropsychol. 2001, 7: 32-41.View ArticleGoogle Scholar
- Bull E, Reavill C, Hagan JJ, Overend P, Jones DNC: Evaluation of the spontaneously hypertensive rat as a model of attention deficit hyperactivity disorder: acquisition and performance of the DRL-60s test. Behav Brain Res. 2000, 109: 27-35. 10.1016/S0166-4328(99)00156-4.View ArticlePubMedGoogle Scholar
- van den Bergh FS, Bloemarts E, Chan JSW, Groenink L, Olivier B, Oosting RS: Spontaneously hypertensive rats do not predict symptoms of attention-deficit hyperactivity disorder. Pharmacol Biochem Behav. 2006, 83: 380-390. 10.1016/j.pbb.2006.02.018.View ArticlePubMedGoogle Scholar
- O'Driscoll GA, Depatie L, Holahan ALV, Savion-Lemieux T, Barr RG, Jolicoeur C, Douglas VI: Executive functions and methylphenidate response in subtypes of attention-deficit/hyperactivity disorder. Biol Psychiatry. 2005, 57: 1452-1460. 10.1016/j.biopsych.2005.02.029.View ArticlePubMedGoogle Scholar
- Scheres A, Oosterlaan J, Swanson J, Morein-Zamir S, Meiran N, Schut H, Vlasveld L, Sergeant JA: The effect of methylphenidate on three forms of response inhibition in boys with AD/HD. J Abnorm Child Psychol. 2003, 31: 105-120. 10.1023/A:1021729501230.View ArticlePubMedGoogle Scholar
- Sagvolden T, Berger DF: An animal model of Attention Deficit Disorder: The female shows more behavioral problems and is more impulsive than the male. Eur Psychologist. 1996, 1: 113-122. 10.1027/1016-9040.1.2.113.View ArticleGoogle Scholar
- Sagvolden T: Behavioral validation of the spontaneously hypertensive rat (SHR) as an animal model of attention-deficit/hyperactivity disorder (AD/HD). Neurosci Biobehav Rev. 2000, 24: 31-39. 10.1016/S0149-7634(99)00058-5.View ArticlePubMedGoogle Scholar
- Sagvolden T, Russell VA, Aase H, Johansen EB, Farshbaf M: Rodent models of attention-deficit/hyperactivity disorder. Biol Psychiatry. 2005, 57: 1239-1247. 10.1016/j.biopsych.2005.02.002.View ArticlePubMedGoogle Scholar
- Russell VA, Sagvolden T, Johansen EB: Animal models of attention-deficit hyperactivity disorder. Behav Brain Funct. 2005, 1: 9-10.1186/1744-9081-1-9.PubMed CentralView ArticlePubMedGoogle Scholar
- Doughty AH, Richards JB: Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons. J Exp Anal Behav. 2002, 78: 17-30. 10.1901/jeab.2002.78-17.PubMed CentralView ArticlePubMedGoogle Scholar
- McClure GYH, Wenger GR, McMillan DE: Effects of drugs on response duration differentiation .5. Differential effects under temporal response differentiation schedules. J Pharmacol Exp Ther. 1997, 281: 1357-1367.PubMedGoogle Scholar
- Ferguson SA, Paule MG: Effects of chlorpromazine and diazepam on time estimation behavior and motivation in rats. Pharmacol Biochem Behav. 1996, 53: 115-122. 10.1016/0091-3057(95)02002-0.View ArticlePubMedGoogle Scholar
- Baldwin RL, Chelonis JJ, Flake RA, Edwards MC, Feild CR, Meaux JB, Paule MG: Effect of methylphenidate on time perception in children with attention-deficit/hyperactivity disorder. Exp Clin Psychopharmacol. 2004, 12: 57-64. 10.1037/1064-1218.104.22.168.View ArticlePubMedGoogle Scholar
- Popke EJ, Mayorga AJ, Fogle CM, Paule MG: Comparison of drug effects on the performance of two timing tasks in rats. Pharmacol Biochem Behav. 2000, 67: 377-385. 10.1016/S0091-3057(00)00380-4.View ArticlePubMedGoogle Scholar
- Ferguson SA, Cada AM, Gray EP, Paule MG: No alterations in the performance of two interval timing operant tasks after alpha-difluoromethylornithine (DFMO)-induced cerebellar stunting. Behav Brain Res. 2001, 126: 135-146. 10.1016/S0166-4328(01)00259-5.View ArticlePubMedGoogle Scholar
- Popke EJ, Mayorga AJ, Fogle CM, Paule MG: Effects of acute nicotine on several operant behaviors in rats. Pharmacol Biochem Behav. 2000, 65: 247-254. 10.1016/S0091-3057(99)00205-1.View ArticlePubMedGoogle Scholar
- Droit S: Temporal regulation of behavior with an external clock in 3-year-old children – differences between waiting and response duration tasks. J Exp Child Psychol. 1994, 58: 332-345. 10.1006/jecp.1994.1038.View ArticleGoogle Scholar
- Richards JB, Sabol KE, Seiden LS: DRL interresponse-time distributions – quantification by peak deviation analysis. J Exp Anal Behav. 1993, 60: 361-385. 10.1901/jeab.1993.60-361.PubMed CentralView ArticlePubMedGoogle Scholar
- Killeen PR, Hall SS, Reilly MP, Kettle LC: Molecular analyses of the principal components of response strength. J Exp Anal Behav. 2002, 78: 127-160. 10.1901/jeab.2002.78-127.PubMed CentralView ArticlePubMedGoogle Scholar
- Machado A, Guilhardi P: Shifts in the psychometric function and their implications for models of timing. J Exp Anal Behav. 2000, 74: 25-54. 10.1901/jeab.2000.74-25.PubMed CentralView ArticlePubMedGoogle Scholar
- Gibbon J: Scalar expectancy theory and Weber's law in animal timing. Psychol Rev. 1977, 84: 279-325. 10.1037/0033-295X.84.3.279.View ArticleGoogle Scholar
- Killeen PR, Fetterman JG: A behavioral theory of timing. Psychol Rev. 1988, 95: 274-295. 10.1037/0033-295X.95.2.274.View ArticlePubMedGoogle Scholar
- Burnham KP, Anderson DR: Model selection and multimodel inference: A practical information-theoretic approach. 2002, New York NY, Springer-VerlagGoogle Scholar
- Killeen PR: An alternative to null-hypothesis significance tests. Psychol Sci. 2005, 16: 345-353. 10.1111/j.0956-7976.2005.01538.x.PubMed CentralView ArticlePubMedGoogle Scholar
- Ashby FG, O'Brien JB: The Prep stastistic as a measure of confidence in model fitting. Psychon Bull Rev.Google Scholar
- Killeen PR, Weiss NA: Optimal timing and the Weber function. Psychol Rev. 1987, 94: 455-468. 10.1037/0033-295X.94.4.455.View ArticlePubMedGoogle Scholar
- Crystal JD: Nonlinear time perception. Behav Processes. 2001, 55: 35-49. 10.1016/S0376-6357(01)00167-X.View ArticlePubMedGoogle Scholar
- Bizo LA, Chu JYM, Sanabria F, Killeen PR: The failure of Weber's law in time perception and production. Behav Processes. 2006, 71: 201-210. 10.1016/j.beproc.2005.11.006.View ArticlePubMedGoogle Scholar
- Killeen PR, Taylor TJ: How the propagation of error through stochastic counters affects time discrimination and other psychophysical judgments. Psychol Rev. 2000, 107: 430-459. 10.1037/0033-295X.107.3.430.View ArticlePubMedGoogle Scholar
- Sagvolden T, Pettersen MB, Larsen MC: Spontaneously hypertensive rats (SHR) as a putative animal model of childhood hyperkinesia – SHR behavior compared to 4 other rat strains. Physiol Behav. 1993, 54: 1047-1055. 10.1016/0031-9384(93)90323-8.View ArticlePubMedGoogle Scholar
- Toplak ME, Dockstader C, Tannock R: Temporal information processing in ADHD: Findings to date and new methods. J Neurosci Methods. 2006, 151: 15-29. 10.1016/j.jneumeth.2005.09.018.View ArticlePubMedGoogle Scholar
- Barkley RA, Murphy KR, Bush T: Time perception and reproduction in young adults with attention deficit hyperactivity disorder. Neuropsychology. 2001, 15: 351-360. 10.1037/0894-422.214.171.1241.View ArticlePubMedGoogle Scholar
- Kerns KA, McInerney RJ, Wilde NJ: Time reproduction, working memory, and behavioral inhibition in children with ADHD. Child Neuropsychol. 2001, 7: 21-31.View ArticlePubMedGoogle Scholar
- Meaux JB, Chelonis JJ: Time perception differences in children with and without ADHD. J Pediatr Health Care. 2003, 17: 64-71.PubMedGoogle Scholar
- Mullins C, Bellgrove MA, Gill M, Robertson IH: Variability in time reproduction: Difference in ADHD combined and inattentive subtypes. J Am Acad Child Adolesc Psychiatry. 2005, 44: 169-176. 10.1097/00004583-200502000-00009.View ArticlePubMedGoogle Scholar
- Smith A, Taylor E, Rogers JW, Newman S, Rubia K: Evidence for a pure time perception deficit in children with ADHD. J Child Psychol Psychiatry. 2002, 43: 529-542. 10.1111/1469-7610.00043.View ArticlePubMedGoogle Scholar
- Toplak ME, Rucklidge JJ, Hetherington R, John SCF, Tannock R: Time perception deficits in attention-deficit/hyperactivity disorder and comorbid reading difficulties in child and adolescent samples. J Child Psychol Psychiatry. 2003, 44: 888-903. 10.1111/1469-7610.00173.View ArticlePubMedGoogle Scholar
- Evenden J: Impulsivity: a discussion of clinical and experimental findings. J Psychopharmacol. 1999, 13: 180-192.View ArticlePubMedGoogle Scholar
- De La Garza R: Wistar Kyoto rats exhibit reduced sucrose pellet reinforcement behavior and intravenous nicotine self-administration. Pharmacol Biochem Behav. 2005, 82: 330-337. 10.1016/j.pbb.2005.09.002.View ArticlePubMedGoogle Scholar
- Drolet G, Proulx K, Pearson D, Rochford J, Deschepper CF: Comparisons of behavioral and neurochemical characteristics between WKY, WKHA, and Wistar rat strains. Neuropsychopharmacology. 2002, 27: 400-409. 10.1016/S0893-133X(02)00303-2.View ArticlePubMedGoogle Scholar
- McInerney RJ, Kerns KA: Time reproduction in children with ADHD: Motivation matters. Child Neuropsychol. 2003, 9: 91-108.View ArticlePubMedGoogle Scholar
- Van Meel CS, Oosterlaan J, Heslenfeld DJ, Sergeant JA: Motivational effects on motor timing in attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 2005, 44: 451-460. 10.1097/01.chi.0000155326.22394.e6.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.