Skip to main content
Log in

Development and Validation of a Brief Version of the Difficulties in Emotion Regulation Scale: The DERS-16

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

The Difficulties in Emotion Regulation Scale (DERS) is a widely-used, theoretically-driven, and psychometrically-sound self-report measure of emotion regulation difficulties. However, at 36-items, the DERS may be challenging to administer in some situations or settings (e.g., in the course of patient care or large-scale epidemiological studies). Consequently, there is a need for a briefer version of the DERS. The goal of the present studies was to develop and evaluate a 16-item version of the DERS – the DERS-16. The reliability and validity of the DERS-16 were examined in a clinical sample (N = 96) and two large community samples (Ns = 102 and 482). The validity of the DERS-16 was evaluated comparing the relative strength of the association of the two versions of the DERS with measures of emotion regulation and related constructs, psychopathology, and clinically-relevant behaviors theorized to stem from emotion regulation deficits. Results demonstrate that the DERS-16 has retained excellent internal consistency, good test-retest reliability, and good convergent and discriminant validity. Further, the DERS-16 showed minimal differences in its convergent and discriminant validity with relevant measures when compared to the original DERS. In conclusion, the DERS-16 offers a valid and brief method for the assessment of overall emotion regulation difficulties.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13, 27–45.

    Article  PubMed  Google Scholar 

  • Baer, R. A., Smith, G. T., Lykins, E., Button, D., Krietemeyer, J., Sauer, S., Walsh, E., Duggan, D., & Williams, J. M. G. (2008). Construct validity of the five facet mindfulness questionnaire in meditating and nonmeditating samples. Assessment, 15, 329–342.

    Article  PubMed  Google Scholar 

  • Bagby, R. M., Taylor, G. J., & Parker, J. A. (1994). The twenty-item Toronto alexithymia scale: II. Convergent, discriminant, and concurrent validity. Journal of Psychosomatic Research, 38, 33–40.

    Article  PubMed  Google Scholar 

  • Bardeen, J. R., Fergus, T. A., & Orcutt, H. K. (2012). An examination of the latent structure of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 34, 382–392.

    Article  Google Scholar 

  • Ben-Porath, D. D., Federici, A., Wisniewski, L., & Warren, M. (2014). Dialectical behavior therapy: does it bring about improvements in affect regulation in individuals with eating disorders? Journal of Contemporary Psychotherapy, 44, 245–251.

    Article  Google Scholar 

  • Berna, G., Ott, L., & Nandrino, J. L. (2014). Effects of emotion regulation difficulties on the tonic and phasic cardiac autonomic response. PloS One, 9, e102971.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bohus, M., Limberger, M. F., Frank, U., Sender, I., Gratwohl, T., & Stieglitz, R. (2001). Development of the borderline symptom list (BSL). Psychotherapie Psychosomatik Medizinische Psychologie, 51, 201–221.

    Article  Google Scholar 

  • Cicchetti, D., Ackerman, B. P., & Izard, C. E. (1995). Emotions and emotion regulation in developmental psychopathology. Development and Psychopathology, 7, 1–10.

    Article  Google Scholar 

  • Dixon-Gordon, K. L., Tull, M. T., & Gratz, K. L. (2014). Self-injurious behaviors in posttraumatic stress disorder: an examination of potential moderators. Journal of Affective Disorders, 166, 359–367.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ehring, T., Fischer, S., Schnülle, J., Bösterling, A., & Tuschen-Caffier, B. (2008). Characteristics of emotion regulation in recovered depressed versus never depressed individuals. Personality and Individual Differences, 44, 1574–1584.

    Article  Google Scholar 

  • Ehring, T., Tuschen-Caffier, B., Schnülle, J., Fischer, S., & Gross, J. J. (2010). Emotion regulation and vulnerability to depression: spontaneous versus instructed use of emotion suppression and reappraisal. Emotion, 10, 563–572.

    Article  PubMed  Google Scholar 

  • First, M. B., Gibbon, M., Spitzer, R. L., Williams, J. B. W, & Benjamin, L. S. (1997). Structured clinical interview for DSM-IV. Washington: American Psychiatric Press.

  • Fliege, H., Kocalevent, R. D., Walter, O. B., Beck, S., Gratz, K. L., Gutierrez, P. M., & Klapp, B. F. (2006). Three assessment tools for deliberate self-harm and suicide behavior: evaluation and psychopathological correlates. Journal of Psychosomatic Research, 61, 113–121.

    Article  PubMed  Google Scholar 

  • Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014). Construct validity and factor structure of the difficulties in emotion regulation scale among adults with severe mental illness. Journal of Psychiatric Research, 58, 175–180.

    Article  PubMed  Google Scholar 

  • Fox, H. C., Axelrod, S. R., Paliwal, P., Sleeper, J., & Sinha, R. (2007). Difficulties in emotion regulation and impulse control during cocaine abstinence. Drug and Alcohol Dependence, 89, 298–301.

    Article  PubMed  Google Scholar 

  • Goodman, M., Carpenter, D., Tang, C. Y., Goldstein, K. E., Avedon, J., Fernandez, N.,... & Hazlett, E. A. (2014). Dialectical behavior therapy alters emotion regulation and amygdala activity in patients with borderline personality disorder. Journal of Psychiatric Research, 57, 108–116.

  • Gratz, K. L. (2001). Measurement of deliberate self-harm: preliminary data on the deliberate self-harm inventory. Journal of Psychopathology and Behavioral Assessment, 23, 253–263.

    Article  Google Scholar 

  • Gratz, K. L. (2007). Targeting emotion dysregulation in the treatment of self-injury. Journal of Clinical Psychology, 63, 1091–1103.

    Article  PubMed  Google Scholar 

  • Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 26, 41–54.

    Article  Google Scholar 

  • Gratz, K. L., & Roemer, L. (2008). The relationship between emotion dysregulation and deliberate self-harm among female undergraduate students at an urban commuter university. Cognitive Behaviour Therapy, 37, 14–25.

    Article  PubMed  Google Scholar 

  • Gratz, K. L., & Tull, M. T. (2010). Emotion regulation as a mechanism of change in acceptance- and mindfulness-based treatments. In R. A. Baer (Ed.), Assessing mindfulness and acceptance: Illuminating the processes of change (pp. 107–134). Oakland, CA: New Harbinger Publications.

    Google Scholar 

  • Gratz, K. L., & Tull, M. T. (2011). Extending research on the utility of an adjunctive emotion regulation group therapy for deliberate self-harm among women with borderline personality pathology. Personality Disorders: Theory, Research, and Treatment, 2, 316–326.

    Article  Google Scholar 

  • Gratz, K. L., & Tull, M. T. (2012). Exploring the relationship between posttraumatic stress disorder and deliberate self-harm: The moderating roles of borderline and avoidant personality disorders. Psychiatry Research, 199, 19–23.

    Article  PubMed  PubMed Central  Google Scholar 

  • Gratz, K. L., Rosenthal, M. Z., Tull, M. T., Lejuez, C. W., & Gunderson, J. G. (2006). An experimental investigation of emotion dysregulation in borderline personality disorder. Journal of Abnormal Psychology, 115, 850–855.

    Article  PubMed  Google Scholar 

  • Gratz, K. L., Hepworth, C., Tull, M. T., Paulson, A., Clarke, S., Remington, B., & Lejuez, C. W. (2011). An experimental investigation of emotional willingness and physical pain tolerance in deliberate self-harm: the moderating role of interpersonal distress. Comprehensive Psychiatry, 52, 63–74.

    Article  PubMed  Google Scholar 

  • Gratz, K. L., Tull, M. T., & Levy, R. (2014). Randomized controlled trial and uncontrolled 9-month follow-up of an adjunctive emotion regulation group therapy for deliberate self-harm among women with borderline personality disorder. Psychological Medicine, 44, 2099–2112.

    Article  PubMed  Google Scholar 

  • Gratz, K. L., Bardeen, J. R., Levy, R., Dixon-Gordon, K. L., & Tull, M. T. (2015). Mechanisms of change in an emotion regulation group therapy for deliberate self-harm among women with borderline personality disorder. Behaviour Research and Therapy, 65, 29–35.

    Article  PubMed  PubMed Central  Google Scholar 

  • Gross, J. J., & Jazaieri, H. (2014). Emotion, emotion regulation, and psychopathology: an affective science perspective. Clinical Psychological Science, 2, 387–401.

    Article  Google Scholar 

  • Gross, J. J., & John, O. P. (1995). Facets of emotional expressivity: three self-report factors and their correlates. Personality and Individual Differences, 19, 555–568.

    Article  Google Scholar 

  • Gross, J. J., & John, O. P. (1997). Revealing feelings: facets of emotional expressivity in self-reports, peer ratings, and behavior. Journal of Personality and Social Psychology, 72, 435–448.

    Article  PubMed  Google Scholar 

  • Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85, 348–362.

    Article  PubMed  Google Scholar 

  • Hamilton, N. A., Karoly, P., Gallagher, M., Stevens, N., Karlson, C., & McCurdy, D. (2007). The assessment of emotion regulation in cognitive context: the emotion amplification and reduction scales. Cognitive Therapy and Research, 33, 255–263.

    Article  Google Scholar 

  • Hayes, S.C., Strosahl, K., Wilson, K.G., Bissett, R.T., Pistorello, J., Toarmino, D.,... McCurry, S.M. (2004). Measuring experiential avoidance: a preliminary test of a working model. The Psychological Record, 54, 553–578.

    Google Scholar 

  • Henry, J. D., & Crawford, J. R. (2005). The short-form version of the depression anxiety stress scales (DASS-21): construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227–239.

    Article  PubMed  Google Scholar 

  • Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104–121.

    Article  Google Scholar 

  • Hofmann, S. G., & Kashdan, T. B. (2010). The affective style questionnaire: development and psychometric properties. Journal of Psychopathology and Behavioral Assessment, 32, 255–263.

    Article  PubMed  PubMed Central  Google Scholar 

  • Izard, C. E., & Ackerman, B. P. (2000). Motivational, organizational, and regulatory functions of discrete emotions. In M. Lewis, & J. M. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 253–264). New York: Guilford Press.

    Google Scholar 

  • Kring, A. M., & Werner, K. H. (2004). Emotion regulation in psychopathology. In P. Philippot, & R. S. Feldman (Eds.), The regulation of emotion (pp. 359–385). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Kuo, J. R., Khoury, J. E., Metcalfe, R., Fitzpatrick, S., & Goodwill, A. (2015). An examination of the relationship between childhood emotional abuse and borderline personality disorder features: the role of difficulties with emotion regulation. Child Abuse and Neglect, 39, 147–155.

    Article  PubMed  Google Scholar 

  • Larsen, R. J., & Diener, E. (1987). Affect intensity as an individual difference characteristic: a review. Journal of Research in Personality, 21, 1–39.

    Article  Google Scholar 

  • Lavender, J. M., Wonderlich, S. A., Peterson, C. B., Crosby, R. D., Engel, S. G., Mitchell, J. E., &... Berg, K. C. (2014). Dimensions of emotion dysregulation in bulimia nervosa. European Eating Disorders Review, 22, 212–216.

  • Li, C. R., Huang, C., Yan, P., Bhagwagar, Z., Milivojevic, V., & Sinha, R. (2008). Neural correlates of impulse control during stop signal inhibition in cocaine-dependent men. Neuropsychopharmacology, 33, 1798–1806.

    Article  PubMed  PubMed Central  Google Scholar 

  • Look, A. E., Flory, J. D., Harvey, P. D., & Siever, L. J. (2010). Psychometric properties of a short form of the affective lability scale (ALS-18). Personality and Individual Differences, 49, 187–191.

    Article  PubMed  PubMed Central  Google Scholar 

  • Messman-Moore, T. L., Walsh, K. L., & DiLillo, D. (2010). Emotion dysregulation and risky sexual behavior in revictimization. Child Abuse and Neglect, 34, 967–976.

    Article  PubMed  Google Scholar 

  • Muris, P., Merckelbach, H., & Horselenberg, R. (1996). Individual differences in thought suppression. The white bear suppression inventory: factor structure, reliability, validity, and correlates. Behaviour Research and Therapy, 34, 501–513.

    Article  PubMed  Google Scholar 

  • Neumann, A., van Lier, P. A. C., Gratz, K. L., & Koot, H. M. (2010). Multidimensional assessment of emotion regulation difficulties in adolescents using the difficulties in emotion regulation scale. Assessment, 17, 138–149.

    Article  PubMed  Google Scholar 

  • Oliver, M. N., & Simmons, J. S. (2004). The affective lability scales: development of a short-form measure. Personality and Individual Differences, 37, 1279–1288.

    Article  Google Scholar 

  • Pfohl, B., Blum, N., St. John, D., McCormick, B., Allen, J., & Black, D. W. (2009). Reliability and validity of the borderline evaluation of severity over time (BEST): a self-rated scale to measure severity and change in persons with borderline personality disorder. Journal of Personality Disorders, 23, 281–293.

    Article  PubMed  PubMed Central  Google Scholar 

  • Reinert, D. F., & Allen, J. P. (2007). The alcohol use disorders identification test: an update of research findings. Alcoholism: Clinical and Experimental Research, 31, 185–199.

    Article  Google Scholar 

  • Salters-Pedneault, K., Roemer, L., Tull, M. T., Rucker, L., & Mennin, D. S. (2006). Evidence of broad deficits in emotion regulation associated with chronic worry and generalized anxiety disorder. Cognitive Therapy and Research, 30, 469–480.

    Article  Google Scholar 

  • Saunders, J. B., Aasland, O. G., Babor, T. F., De La Fuente, J. R., & Grant, M. (1993). Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction, 88, 791–804.

    Article  PubMed  Google Scholar 

  • Schmidt, R. E., Gay, P., Courvoisier, D., Jermann, F., Ceschi, G., David, M., Brinkmann, K., & Van der Linden, M. (2009). Anatomy of the white bear suppression inventory (WBSI): a review of previous findings and a new approach. Journal of Personality Assessment, 91, 323–330.

    Article  PubMed  Google Scholar 

  • Sheehan, D., Janavs, J., Baker, R., Lecrubier, Y., Hergueta, T., & Weiller, E. (2010). MINI international neuropsychiatric interview, Swedish Version 5.0.

  • Sheppes, G., Suri, G., & Gross, J. J. (2015). Emotion regulation and psychopathology. Annual Review of Clinical Psychology, 11, 379–405.

    Article  PubMed  Google Scholar 

  • Simons, J. S., & Gaher, R. M. (2005). The distress tolerance scale: development and validation of a self-report measure. Motivation and Emotion, 29, 83–102.

    Article  Google Scholar 

  • Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 1, 102–111.

    Article  Google Scholar 

  • Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251.

    Article  Google Scholar 

  • Stevens, N. R., Gerhart, J., Goldsmith, R. E., Heath, N. M., Chesney, S. A., & Hobfoll, S. E. (2013). Emotion regulation difficulties, low social support, and interpersonal violence mediate the link between childhood abuse and posttraumatic stress symptoms. Behavior Therapy, 44, 152–161.

    Article  PubMed  Google Scholar 

  • Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. California State University Northridge: HarperCollins College Publishers.

    Google Scholar 

  • Taylor, C. T., Laposa, J. M., & Alden, L. E. (2004). Is avoidant personality disorder more than just social avoidance? Journal of Personality Disorders, 18, 571–594.

    Article  PubMed  Google Scholar 

  • Taylor, S., Zvolensky, M.J., Cox, B.J., Deacon, B., Heimberg, R.G., Ledley, D.R.,... Cardenas, S.J. (2007). Robust dimensions of anxiety sensitivity: development and initial validation of the anxiety sensitivity index-3. Psychological Assessment, 19, 176–188.

    Article  PubMed  Google Scholar 

  • Thompson, R. A. (1994). Emotion regulation: a theme in search of definition. In N. A. Fox (Ed.), The development of emotion regulation: biological and behavioral considerations (pp. 25–52). Chicago: University of Chicago Press.

    Google Scholar 

  • Tull, M. T. (2006). Extending an anxiety sensitivity model of uncued panic attack frequency and symptom severity: the role of emotion dysregulation. Cognitive Therapy and Research, 30, 177–184.

    Article  Google Scholar 

  • Tull, M. T., & Roemer, L. (2007). Emotion regulation difficulties associated with the experience of uncued panic attacks: evidence of experiential avoidance, emotional nonacceptance, and decreased emotional clarity. Behavior Therapy, 38, 378–391.

    Article  PubMed  Google Scholar 

  • Tull, M. T., Barrett, H. M., McMillan, E. S., & Roemer, L. (2007). A preliminary investigation of the relationship between emotion regulation difficulties and posttraumatic stress symptoms. Behavior Therapy, 38, 303–313.

    Article  PubMed  Google Scholar 

  • Tull, M. T., Stipelman, B. A., Salters-Pedneault, K., & Gratz, K. L. (2009). An examination of recent non-clinical panic attacks, panic disorder, anxiety sensitivity, and emotion regulation difficulties in the prediction of generalized anxiety disorder in an analogue sample. Journal of Anxiety Disorders, 23, 275–282.

    Article  PubMed  Google Scholar 

  • Tull, M. T., Gratz, K. L., Latzman, R. D., Kimbrel, N. A., & Lejuez, C. W. (2010). Reinforcement sensitivity theory and emotion regulation difficulties: a multimodal investigation. Personality and Individual Differences, 49, 989–994.

    Article  Google Scholar 

  • Tull, M. T., Weiss, N. H., Adams, C. E., & Gratz, K. L. (2012). The contribution of emotion regulation difficulties to risky sexual behavior within a sample of patients in residential substance abuse treatment. Addictive Behaviors, 37, 1084–1092.

    Article  PubMed  PubMed Central  Google Scholar 

  • Tull, M. T., Bardeen, J. R., DiLillo, D., Messman-Moore, T., & Gratz, K. L. (2015). A prospective investigation of emotion dysregulation as a moderator of the relation between posttraumatic stress symptoms and substance use severity. Journal of Anxiety Disorders, 29, 52–60.

    Article  PubMed  PubMed Central  Google Scholar 

  • Turner, B. J., Layden, B. K., Butler, S. M., & Chapman, A. L. (2013). How often, or how many ways: clarifying the relationship between non-suicidal self-injury and suicidality. Archives of Suicide Research, 17, 397–415.

    Article  PubMed  Google Scholar 

  • Wegner, D. M., & Zanakos, S. (1994). Chronic thought suppression. Journal of Personality, 62, 615–640.

    Article  Google Scholar 

  • Weinberg, A., & Klonsky, E. D. (2009). Measurement of emotion dysregulation in adolescents. Psychological Assessment, 21, 616–621.

    Article  PubMed  Google Scholar 

  • Whiteside, U., Chen, E., Neighbors, C., Hunter, D., Lo, T., & Larimer, M. (2007). Difficulties regulating emotions: do binge eaters have fewer strategies to modulate and tolerate negative affect? Eating Behaviors, 8, 162–169.

    Article  PubMed  Google Scholar 

  • Zou, G. Y. (2007). Toward using confidence intervals to compare correlations. Psychological Methods, 12, 399–413.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This research was supported by National Institute of Child Health and Human Development Grant R01 HD062226, awarded to the eighth author (DD). Additional funding was provided by the Stockholm County Council (ALF project; grant number: 20140428) and the Fredrik och Ingrid Thurings stiftelse.

Conflict of Interest

All authors declare that they have no conflicts of interest.

Experiment Participants

All study procedures were approved by the appropriate institutional review committee and meet the guidelines of the responsible government agency. Written informed consent was obtained for all participants prior to participation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Johan Bjureberg.

Appendix

Appendix

Difficulties in Emotion Regulation Scale – 16 Item Version (DERS-16)

1

2

3

4

5

Almost never

Sometimes

About half the time

Most of the time

Almost always

0–10 %

11–35 %

36–65 %

66–90 %

91–100 %

Please indicate how often the following statements apply to you by writing the appropriate number from the scale above (1–5) on the line beside each item.

1. I have difficulty making sense out of my feelings. [CLARITY*]

2. I am confused about how I feel. [CLARITY]

3. When I am upset, I have difficulty getting work done. [GOALS]

4. When I am upset, I become out of control. [IMPULSE]

5. When I am upset, I believe that I will remain that way for a long time. [STRATEGIES]

6. When I am upset, I believe that I’ll end up feeling very depressed. [STRATEGIES]

7. When I am upset, I have difficulty focusing on other things. [GOALS]

8. When I am upset, I feel out of control. [IMPULSE]

9. When I am upset, I feel ashamed with myself for feeling that way. [NONACCEPTANCE]

10. When I am upset, I feel like I am weak. [NONACCEPTANCE]

11. When I am upset, I have difficulty controlling my behaviors. [IMPULSE]

12. When I am upset, I believe that there is nothing I can do to make myself feel better. [STRATEGIES]

13. When I am upset, I become irritated with myself for feeling that way. [NONACCEPTANCE]

14. When I am upset, I start to feel very bad about myself. [STRATEGIES]

15. When I am upset, I have difficulty thinking about anything else. [GOALS]

16. When I am upset, my emotions feel overwhelming. [STRATEGIES]

  1. CLARITY = Lack of Emotional Clarity; GOALS = Difficulties Engaging in Goal-Directed Behavior; IMPULSE = Impulse Control Difficulties; STRATEGIES = Limited Access to Effective Emotion Regulation Strategies; NONACCEPTANCE = Nonacceptance of Emotional Responses.
  2. *Factor as described in the original study of the 36-item DERS (Gratz and Roemer 2004). This information was not presented to participants

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bjureberg, J., Ljótsson, B., Tull, M.T. et al. Development and Validation of a Brief Version of the Difficulties in Emotion Regulation Scale: The DERS-16. J Psychopathol Behav Assess 38, 284–296 (2016). https://doi.org/10.1007/s10862-015-9514-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-015-9514-x

Keywords

Navigation