Dark Triad Dirty Dozen
The Dark Triad Dirty Dozen (DTDD) is a brief 12-item personality inventory that simultaneously assesses the three socially maladaptive, dark triad traits: Machiavellianism, narcissism, and psychopathy. It was developed by Jonason and Webster in 2010 based on already existing, longer measures of each dark triad trait.
The DTDD was originally developed to identify the dark triad traits among subclinical adult population (i.e. high scores on the DTDD does not guarantee a clinical diagnosis). It is not intended to diagnose personality disorders such as the Narcissistic personality disorder.
The DTDD consists of 4 items per subscale (i.e. Machiavellianism, narcissism, and psychopathy). Responses are rated on a 7-point Likert scale, wherein 1 implies a strong disagreement and the opposite for 7. The Machiavellianism items assess characteristics such as manipulativeness, deceitfulness, and likelihood of employing flattery and exploitation for personal gain. The narcissism items are concerned with whether the individual seeks admiration, attention, status, and favours from others. The psychopathy items focus on features such as amorality, cynicism, callousness, and lack of remorse.
The DTDD was developed due to the absence of a single, concise test which measured the three dark triad traits simultaneously. Prior to the development of the DTDD, researchers were required to use different personality tests for each of the dark triad traits. This made scoring difficult for researchers, as it required standardisation of scores of each test for comparison. Another issue with measuring all of dark triad traits by different tests was that it would involve too many items, making administration time-consuming and potentially fatiguing among test-takers, leading to less accurate responses.
As such, Jonason and Webster sought to develop a short and easily administrable measure of the dark triad by adapting items from traditional, existing measures of each dark triad construct, namely the Mach IV for Machiavellianism, the Self-Report Psychopathy Scale-III (SRP-III) for psychopathy, and the Narcissistic Personality Inventory (NPI) for narcissism. The researchers first identified 22 candidate items, and conducted a principal component analysis to identify items that would be included in the DTDD. Four items that contributed to each of the dark triad trait the most were added in the DTDD. Since Jonason and Webster identified a “problem” item that was contributing to lower internal consistency reliability, it was rephrased in the final version of the DTDD.
Effects of Sex and Age
Given that personality tends to be unstable until adulthood, researchers have been reluctant to conduct self-report personality measures on younger people. In line with this, most studies on the DTDD have been administering the questionnaire in university student or adult samples; however, a study has suggested that it is also applicable to use in high-school aged population as well.
Consistent with studies investigating sex differences in scores of established measures of the dark triad traits, adult males tend to score higher on the DTDD than females, especially on the psychopathy subscale. Similar pattern of sex differences in the DTDD scores have been found among adolescents, however it is not as robust as the adult samples. Jones and Paulhus explain that this sex difference may emerge because males, more than females, tend to benefit more from using manipulative, exploitative strategies characteristic of the dark triad traits. Females may not benefit as much from engaging in these socially manipulative tactics as they tend to be more embedded in social structures.
Theoretically, the three dark triad traits are treated as separate, but related constructs. In parallel with the factor structure of the dark triad traits, traditional tests of these traits measure each trait independently (e.g. NPI, SRP-III, Mach IV). Due to the DTDD’s ability to measure all three constructs simultaneously, researchers have been inquiring whether the DTDD should be better conceptualised as a scale measuring a unitary factor, that is, a composite dark triad trait, or as a scale that measures three distinct but correlating factors. It has been previously demonstrated that the three-factor model (i.e. a scale measuring Machiavellianism, narcissism, and psychopathy) was more appropriate match for the DTDD more than the single-factor model (i.e. a scale measuring a compound dark triad factor). However further research on the DTDD’s factor structure displayed that a bi-factor model yielded the most appropriate match. A bi-factor model combines the one-factor and three-factor models. In this model, both the general factor (i.e. composite dark triad factor) and the three factors of the DTDD subscales (i.e. Machiavellianism, narcissism, and psychopathy) account for the shared variance of the items.
In their first publication of DTDD, Jonason and Webster have reported overall good reliability of the personality scale:
- The test-retest reliability of the DTDD was investigated on 60 psychology university students. In this study, the participants completed the DTDD each week for 3 weeks. The average test-retest correlation was high: DTDD = .89, Machiavellianism = .86, psychopathy = .76, narcissism = .87.
- The item-level temporal reliability refers to whether responses of each item on the questionnaire retains stability across time. This was assessed on the same 60 psychology students over the course of 3 weeks. The average item-level temporal reliability was high: M = .92, P = .84, N = .92.
- The DTDD is also found to have satisfactory internal consistency reliability: DTDD = .86, M = .79, P = .77, N = .84. After revision of Item 6, a psychopathy-specific item, the internal consistency reliability of psychopathy subscale has improved from (on average) .60 to .77.
Jonason and Webster conducted several validity tests of the DTDD as part of its development. Although relevant outcomes have all shown statistical significance, the DTDD’s validity appears not as robust as its reliability.
- Convergent validity (i.e. the extent to which two tests that measure the same construct are strongly related) was assessed by comparing the DTDD subscales (i.e. Machiavellianism, psychopathy, narcissism) with established measures of each subscales; Mach IV, SRP-III, and NPI respectively. DTDD Machiavellianism was correlated with Mach IV at .34, DTDD psychopathy with SRP-III at .42 and DTDD Narcissism with NPI at .46. However, the SRP-III correlated stronger with DTDD Machiavellianism at .44 than DTDD psychopathy, a subscale that SRP-III should have the largest theoretical overlap with.
- Concurrent validity (i.e. whether measures of constructs that should be theoretically related does show high correlation) with the relevant Big Five personality traits was assessed using the Ten-Item Personality Inventory (TIPI) and the Big Five Inventory. As expected, the DTDD displayed negative but modest correlation with Agreeableness and Conscientiousness.
- Through comparison with an aggression scale, the DTDD showed some evidence of concurrent validity, as there were medium positive correlations with physical aggression, verbal aggression, hostility and anger. Subscales that were more theoretically associated with aggression (i.e. DTDD Machiavellianism and DTDD psychopathy) displayed stronger correlations with measures of aggression.
- The DTDD showed positive association (.31) with the Sociosexual Orientation Inventory (a personality test measuring individuals’ attitudes towards participating in casual sexual relationships), again, contributing to its concurrent validity.
- Jonason and McCain investigated the concurrent validity of the DTDD in relation to the HEXACO model of personality. In line with established measures of the dark triad traits, all the DTDD subscales showed strong negative association with the Honesty/Humility factor (ranging from -.52 to -.38) and significant but weaker negative correlation with Agreeableness (ranging from -.29 to -.21).
Other researchers have also conducted validity tests. Below are the examples of the findings:
- In a study investigating the DTDD’s criterion validity on 200 undergraduate students, it was found that DTDD was significantly predictive of socially maladaptive outcome variables concerning sex (e.g. opting for short-term sexual relationships and likelihood of engaging in sexual harassment), money (e.g. conspicuous consumption and tendency to make unethical decisions for monetary gains) and power (e.g. one's perceived importance of power). However, DTDD was not as predictive of these outcomes as the Honesty-Humility trait of the HEXACO model of personality.
- The convergent validity specifically of the DTDD psychopathy subscale was assessed in a study with other established self-report psychopathy tests on 789 undergraduates and 75 male prisoners. DTDD psychopathy showed significant correlations with prominent measures of psychopathy including the Psychopathic Personality Inventory-Revised (.38), SRP-III (.46) and Levenson Self-Report Psychopathy scale (.48). However, this study reported less promising criterion validity of the DTDD, as results indicate that the standard psychopathy scales predicted externalising behaviours (including substance use, antisocial behaviour, domestic violence, and gambling) better than the DTDD psychopathy subscale.
The DTDD has been translated and adapted for other cultures and languages, including French-Canadian, Japanese, Polish, Portuguese, Serbian, Spanish, Swedish, and Turkish versions.
Alternatives to the DTDD
Other researchers saw the 12-item DTDD too brief in covering all relevant content involved in each of the dark triad traits. As an alternative brief measure, Jones and Paulhus have developed the 27-item Short Dark Triad (SD3) in 2014, consisting of 9 items for each of Machiavellianism, psychopathy and narcissism subscale. As opposed to the DTDD in which items were derived from existing dark triad measures, in the SD3, items were developed through considering theoretically relevant facets of the three traits.
Criticisms of the DTDD
Comparison with the SD3
Researchers have questioned DTDD’s validity, especially in comparison to the SD3. It has been found that the convergent validity of the SD3 is superior to the DTDD in relation to existing measures of dark triad subscales in multiple studies. Researchers report that the SD3 performs better than the DTDD in terms of incremental validity (i.e the extent of a new instrument to predict additional information that was not previously predicted by other instruments). Moreover, when content validity (i.e. whether a test captures the essential elements of a construct) of the two inventories was compared, the SD3 out-performed the DTDD. Researchers suggest that the DTDD’s poorer performance on these validity outcomes may be due its sheer brevity and the large content overlap between the items, which grants the scale good internal consistency at the expense of sufficient coverage of theoretically significant content.
The DTDD has also been criticised for its low discriminating power specifically for its narcissism subscale. An item response theory analysis has revealed that the DTDD narcissism items were the easiest to respond to compared to DTDD items for Machiavellianism and psychopathy. This implies that the DTDD narcissism subscale does not sufficiently discriminate between those with “normal” range of narcissism (which may result from having self confidence or high self-esteem) and those with “abnormal” levels of the trait.
Other researchers have criticised about the sparse coverage of important psychopathy facets in the DTDD psychopathy subscale. Specifically, the DTDD does not account for disinhibition (i.e. impulsivity), which may explain why it has weaker correlations with relevant Big Five personality traits such as Agreeableness and Conscientiousness compared to established measures of psychopathy. They recommend that the DTDD should be used as an adjunct measure of psychopathy.
The DTDD’s psychopathy and Machiavellianism subscales have been questioned whether they are adequately distinct from each other, given that they are conceptualised similarly in the questionnaire. A study demonstrated that the demarcation between the two subscales are blurred, as the DTDD Machiavellianism shows stronger correlation with a traditional measure of psychopathy rather than of Machiavellianism. This study concludes that at least among university student aged men, the DTDD is better understood as a measure of two factors; narcissism and “Machiavellianism-psychopathy”, where Machiavellianism is conceptualised as the less severe form of psychopathy.
- Jonason, Peter K.; Webster, Gregory D. (2010). "The dirty dozen: A concise measure of the dark triad". Psychological Assessment. 22 (2): 420–432. doi:10.1037/a0019265. ISSN 1939-134X.
- Webster, Gregory D.; Jonason, Peter K. (2013). "Putting the "IRT" in "Dirty": Item response theory analyses of the Dark Triad Dirty Dozen—An efficient measure of narcissism, psychopathy, and Machiavellianism". Personality and Individual Differences. 54 (2): 302–306. doi:10.1016/j.paid.2012.08.027. ISSN 0191-8869.
- Klimstra, Theo A.; Sijtsema, Jelle J.; Henrichs, Jens; Cima, Maaike (2014). "The Dark Triad of personality in adolescence: Psychometric properties of a concise measure and associations with adolescent adjustment from a multi-informant perspective". Journal of Research in Personality. 53: 84–92. doi:10.1016/j.jrp.2014.09.001. ISSN 0092-6566.
- Paulhus, Delroy L; Williams, Kevin M (2002). "The Dark Triad of personality: Narcissism, Machiavellianism, and psychopathy". Journal of Research in Personality. 36 (6): 556–563. doi:10.1016/s0092-6566(02)00505-6. ISSN 0092-6566.
- Jonason, Peter K. University of Western Sydney Kaufman, Scott B. Webster, Gregory D. Geher, Glenn (2013). What lies beneath the Dark Triad Dirty Dozen : varied relations with the Big Five. U.S.A., Individual Differences Research Group. OCLC 859108874.CS1 maint: multiple names: authors list (link)
- Jonason, Peter K.; Luévano, Victor X. (2013). "Walking the thin line between efficiency and accuracy: Validity and structural properties of the Dirty Dozen". Personality and Individual Differences. 55 (1): 76–81. doi:10.1016/j.paid.2013.02.010. ISSN 0191-8869.
- Jonason, Peter K.; McCain, Jessica (2012). "Using the HEXACO model to test the validity of the Dirty Dozen measure of the Dark Triad". Personality and Individual Differences. 53 (7): 935–938. doi:10.1016/j.paid.2012.07.010. ISSN 0191-8869.
- Lee, Kibeom; Ashton, Michael C.; Wiltshire, Jocelyn; Bourdage, Joshua S.; Visser, Beth A.; Gallucci, Alissa (2013). "Sex, Power, and Money: Prediction from the Dark Triad and Honesty–Humility". European Journal of Personality. 27 (2): 169–184. doi:10.1002/per.1860. ISSN 1099-0984.
- Miller, Joshua D.; Few, Lauren R.; Seibert, L. Alana; Watts, Ashley; Zeichner, Amos; Lynam, Donald R. (2012). "An examination of the Dirty Dozen measure of psychopathy: A cautionary tale about the costs of brief measures". Psychological Assessment. 24 (4): 1048–1053. doi:10.1037/a0028583. ISSN 1939-134X.
- Savard, Claudia; Simard, Caroline; Jonason, Peter K. (2017). "Dark Triad Dirty Dozen--French-Canadian Version". PsycTESTS Dataset. Retrieved 2019-05-13.
- Shimotsukasa, T.; Oshio, A. (2016). "Development and validation of the Japanese version of the Short Dark Triad (SD3-J): Comparing with the Japanese version of the Dark Triad Dirty Dozen". Personality and Individual Differences. 101: 514. doi:10.1016/j.paid.2016.05.295. ISSN 0191-8869.
- Czarna, A.Z.; Jonason, P.K. (2014). "Parszywa Dwunastka: Developing a Polish version of the Dark Triad Dirty Dozen". Personality and Individual Differences. 60: S62. doi:10.1016/j.paid.2013.07.270. ISSN 0191-8869.
- Macedo, A.; Araújo, A.I.; Cabaços, C.; Brito, M.J.; Mendonça, L.; Pereira, A.T. (2017). "Personality dark triad: Portuguese validation of the dirty dozen". European Psychiatry. 41: S711. doi:10.1016/j.eurpsy.2017.01.1268. ISSN 0924-9338.
- Dinić, Bojana M.; Petrović, Boban; Jonason, Peter K. (2018). "Serbian adaptations of the Dark Triad Dirty Dozen (DTDD) and Short Dark Triad (SD3)". Personality and Individual Differences. 134: 321–328. doi:10.1016/j.paid.2018.06.018. ISSN 0191-8869.
- Pineda, David; Sandín, Bonifacio; Muris, Peter (2018-06-08). "Psychometrics properties of the Spanish version of two Dark Triad scales: The Dirty Dozen and the Short Dark Triad". Current Psychology. doi:10.1007/s12144-018-9888-5. ISSN 1046-1310.
- Garcia, Danilo; MacDonald, Shane; Rapp-Ricciardi, Max (2017-05-22). "Factor analysis of the Swedish version of the Dark Triad Dirty Dozen". PsyCh Journal. 6 (2): 166–167. doi:10.1002/pchj.168. ISSN 2046-0252.
- Özsoy, Emrah; Rauthmann, John F.; Jonason, Peter K.; Ardıç, Kadir (2017). "Reliability and validity of the Turkish versions of Dark Triad Dirty Dozen (DTDD-T), Short Dark Triad (SD3-T), and Single Item Narcissism Scale (SINS-T)". Personality and Individual Differences. 117: 11–14. doi:10.1016/j.paid.2017.05.019. ISSN 0191-8869.
- Jones, Daniel N.; Paulhus, Delroy L. (2013-12-09). "Introducing the Short Dark Triad (SD3)". Assessment. 21 (1): 28–41. doi:10.1177/1073191113514105. ISSN 1073-1911.
- Maples, Jessica L.; Lamkin, Joanna; Miller, Joshua D. (2014). "A test of two brief measures of the dark triad: The dirty dozen and short dark triad". Psychological Assessment. 26 (1): 326–331. doi:10.1037/a0035084. ISSN 1939-134X.
- "Peer Review #1 of "The (mis)measurement of the Dark Triad Dirty Dozen: exploitation at the core of the scale (v0.1)"". 2016-03-01. doi:10.7287/peerj.1748v0.1/reviews/1. Cite journal requires
- Carter, Gregory Louis; Campbell, Anne C.; Muncer, Steven; Carter, Katherine A. (2015). "A Mokken analysis of the Dark Triad 'Dirty Dozen': Sex and age differences in scale structures, and issues with individual items". Personality and Individual Differences. 83: 185–191. doi:10.1016/j.paid.2015.04.012. ISSN 0191-8869.