Link Search Menu Expand Document

A Dual Process Theory of Ethical Judgement

Dual process theories of moral psychology claim that moral abilities involve two, or more, processes that are independent and divergent. They are independent in the sense that the conditions which influence whether they occur and which outputs they generate do not completely overlap. And they are divergent in the sense their outputs can conflict (given a single scenario, one process’ output imply rightness whereas the others’ implies wrongness).

If the video isn’t working you could also watch it on youtube. Or you can view just the slides (no audio or video).

This recording is also available on stream (no ads; search enabled).

If the slides are not working, or you prefer them full screen, please try this link. The recording is available on stream and youtube.

Notes

Please Answer This Dilemma First

The recording and slides make use of the following dilemma. Please answer it before you start.

‘You are part of a group of ecologists who live in a remote stretch of jungle. The entire group, which includes eight children, has been taken hostage by a group of paramilitary terrorists. One of the terrorists takes a liking to you. He informs you that his leader intends to kill you and the rest of the hostages the following morning.

‘He is willing to help you and the children escape, but as an act of good faith he wants you to kill one of your fellow hostages whom he does not like. If you refuse his offer all the hostages including the children and yourself will die. If you accept his offer then the others will die in the morning but you and the eight children will escape.

‘Would you kill one of your fellow hostages in order to escape from the terrorists and save the lives of the eight children?’ (Koenigs et al., 2007)

Why This Dual-Process Theory?

Greene offers an elaborate dual-process theory of ethical cognition, one which incorporates controversial claims about consequentialism and emotion.1 As these claims are neither essential features of a dual-process theory nor necessary for the overall argument we are developing (see Greene contra Ethics (Railgun Remix)), we may consider a stripped-down dual process theory instead.

The Stripped-Down Dual-Process Theory

According to this theory:

Two (or more) ethical processes are distinct in this sense: the conditions which influence whether they occur, and which outputs they generate, do not completely overlap.

One process is faster than another: it makes fewer demands on scarce cognitive resources such as attention, inhibitory control and working memory.

A key feature of the stripped-down dual-process theory is its theoretical modesty: it involves minimal commitments concerning the particular characteristics of the processes. Identifying characteristics of the process is a matter of discovery.

What Does the Dual-Process Theory Predict?

To make use of existing evidence, we have to add an auxiliary assumption to the dual-process theory:

The slow process is responsible for characteristically consequentialist responses; the fast for other responses.2

Prediction 1: Increasing cognitive load will selectively slow consequentialist responses. This prediction has been confirmed (Greene, Morelli, Lowenberg, Nystrom, & Cohen, 2008).

Prediction 2: Limiting the time available to make a decision will reduce consequentialist responses. This prediction also appears to have been confirmed:

‘The model detected a significant effect of time pressure, p = .03 (see Table 1), suggesting that the slope of utilitarian responses was steeper for participants under time pressure. […] participants under time pressure gave less utilitarian responses than control participants to scenarios featuring low kill–save ratios, but reached the same rates of utilitarian responses for the highest kill–save ratios’ (Trémolière & Bonnefon, 2014, p. 927).3

On the face of it, then, the dual-process theory appears well supported by evidence (and Greene, 2014 cites much further evidence). We may therefore accept it for now.

Of course you will need to evaluate the evidence properly (see Moral Intuitions and Emotions: Evaluating the Evidence) before you can claim to know whether or not the dual-process theory is true. We will consider some more evidence for, and against, the dual-process theory next week (look out especially for process dissociation).

Other Dual-Process Theories of Ethical Cognition

Dual-process theories of ethical cognition are widely endorsed but come in many varieties. All of the following are elaborations of the stripped-down dual-process theory above.

Cushman’s Dual-Process Theory

Cushman supplements the core idea of a dual-process theory with a distinction between model-free and model-based learning:

‘the functional role of value representation in a model-free system is to select actions without any knowledge of their actual consequences, whereas the functional role of value representation in a model-based system is to select actions precisely in virtue of their expected consequences’ (Cushman, 2013, p. 285).

Cushman also proposes that a good dual-process theory should explain patterns of judgements on dilemmas like the trolley problems, and that this requires appeal to distinction between model-free and model-based:

‘It is the contrast between model-free and model-based systems—or between action- and outcome-based valuation—that can explain the conflict engendered by moral dilemmas’ (Cushman, 2013, p. 285).

We consider Cushman’s proposal in Dual Process Theory and Auxiliary Hypotheses, where a quarter of it is adopted.

Kumar’s Dual-Process Theory

Kumar proposes what he calls a ‘minimalist’ dual-process theory:

‘A minimalist model says that two types of processes generate moral judgements. Type 1 processes are fast, spontaneous, unconscious, and involve emotional processing; type 2 processes are slow, controlled, conscious, and involve reasoned processing. In short, some moral judgements arise as a flash of feeling, while others issue from conscious deliberation’ (Kumar, 2016, p. 791).

This is not very different from the stripped-down theory I offered. So why not just use Kumar’s theory rather than making my own?4 In my view, it is not minimalist enough: there is little evidence on consciousness, control or speed; nor do we know enough about the phenomenology to postulate ‘a flash of feeling’.

Interestingly, Kumar does not accept Greene’s proposed link between fast processes and characteristically consequentialist responses. He does, however, link the fast processes to emotions:

’Each process type gives rise to one element of moral judgement: type 1 processes generate moral emotions and type 2 processes generate moral beliefs. A minimalist model also explains conflict cases’ (Kumar, 2016, p. 792).

Defending this claim requires finding some evidence for the link. My view is that while emotion probably plays different roles in fast and slow processes, it is likely to feature in both (as Cushman, 2013 suggests). For this reason I take Kumar’s bet on fast/slow linking to emotions/beliefs to be risky. And it is not required to generate predictions currently being tested.

Haidt’s Dual-Process Theory

Haidt’s Social Intuitionist Model of Moral Judgement (which is a part of Moral Foundations Theory; see Moral Foundations Theory: An Approach to Cultural Variation) could be interpreted as a kind of dual-process theory because it distinguishes intuition and reasoning as two kinds of process.

As we saw, the Social Intuitionist Model of Moral Judgement involves a variety of further claims—such as that ‘moral reasoning is done primarily for socially strategic purposes’ (Graham et al., 2013, p. 66)—which are not essential features of a dual-process theory.5

Two Systems?

Although two systems theories are sometimes understood as making claims over and above those of a dual-process theory (e.g. Bertram Gawronski & Trope, 2014), others do not make any distinction:

‘We use the term “system” only as a label for collections of cognitive processes that can be distinguished by their speed, their controllability, and the contents on which they operate’ (Kahneman & Frederick, 2005, p. 267).

Glossary

automatic : On this course, a process is _automatic_ just if whether or not it occurs is to a significant extent independent of your current task, motivations and intentions. To say that _mindreading is automatic_ is to say that it involves only automatic processes. The term `automatic' has been used in a variety of ways by other authors: see Moors (2014, p. 22) for a one-page overview, Moors & De Houwer (2006) for a detailed theoretical review, or Bargh (1992) for a classic and very readable introduction
characteristically consequentialist : According to Greene, a judgement is characteristically consequentialist (or characteristically utilitarian) if it is one that in ‘favor of characteristically consequentialist conclusions (eg, “Better to save more lives”)’ (Greene, 2007, p. 39). According to Gawronski et al. (2017, p. 365), ‘a given judgment cannot be categorized as [consequentialist] without confirming its property of being sensitive to consequences.’
characteristically deontological : According to Greene, a judgement is characteristically deontological if it is one that in ‘favor of characteristically deontological conclusions (eg, “It’s wrong despite the benefits”)’ (Greene, 2007, p. 39). According to Gawronski et al. (2017, p. 365), ‘a given judgment cannot be categorized as deontological without confirming its property of being sensitive to moral norms.’
cognitively efficient : A process is cognitively efficient to the degree that it does not consume working memory and other scarce cognitive resources.
David : ‘David is a great transplant surgeon. Five of his patients need new parts—one needs a heart, the others need, respectively, liver, stomach, spleen, and spinal cord—but all are of the same, relatively rare, blood-type. By chance, David learns of a healthy specimen with that very blood-type. David can take the healthy specimen's parts, killing him, and install them in his patients, saving them. Or he can refrain from taking the healthy specimen's parts, letting his patients die’ (Thomson, 1976, p. 206).
dual-process theory : Any theory concerning abilities in a particular domain on which those abilities involve two or more processes which are distinct in this sense: the conditions which influence whether one mindreading process occurs differ from the conditions which influence whether another occurs.
Edward : ‘Edward is the driver of a trolley, whose brakes have just failed. On the track ahead of him are five people; the banks are so steep that they will not be able to get off the track in time. The track has a spur leading off to the right, and Edward can turn the trolley onto it. Unfortunately there is one person on the right-hand track. Edward can turn the trolley, killing the one; or he can refrain from turning the trolley, killing the five’ (Thomson, 1976, p. 206).
fast : A fast process is one that is to some interesting degree automatic and to some interesting degree cognitively efficient. These processes are also sometimes characterised as able to yield rapid responses.
Since automaticity and cognitive efficiency are matters of degree, it is only strictly correct to identify some processes as faster than others.
The fast-slow distinction has been variously characterised in ways that do not entirely overlap (even individual author have offered differing characterisations at different times; e.g. Kahneman, 2013; Morewedge & Kahneman, 2010; Kahneman & Klein, 2009; Kahneman, 2002): as its advocates stress, it is a rough-and-ready tool, not the basis for a rigorous theory.
Moral Foundations Theory : The theory that moral pluralism is true; moral foundations are innate but also subject to cultural learning, and the Social Intuitionist Model of Moral Judgement is correct (Graham et al., 2019). Proponents often claim, further, that cultural variation in how these innate foundations are woven into ethical abilities can be measured using the Moral Foundations Questionnare (Graham, Haidt, & Nosek, 2009; Graham et al., 2011). Some empirical objections have been offered (Davis et al., 2016; Davis, Dooley, Hook, Choe, & McElroy, 2017; Doğruyol, Alper, & Yilmaz, 2019). See Moral Foundations Theory: An Approach to Cultural Variation.
slow : converse of fast.
Social Intuitionist Model of Moral Judgement : A model on which intuitive processes are directly responsible for moral judgements (Haidt & Bjorklund, 2008). One’s own reasoning does not typically affect one’s own moral judgements, but (outside philosophy, perhaps) is typically used only to provide post-hoc justification after moral judgements are made. Reasoning does affect others’ moral intuitions, and so provides a mechanism for cultural learning.
trolley problem : ‘Why is it that Edward may turn that trolley to save his five, but David may not cut up his healthy specimen to save his five?’ (Thomson, 1976, p. 206).

References

Bargh, J. A. (1992). The Ecology of Automaticity: Toward Establishing the Conditions Needed to Produce Automatic Processing Effects. The American Journal of Psychology, 105(2), 181–199. https://doi.org/10.2307/1423027
Bertram Gawronski, J. W. S., & Trope, Y. (2014). Two of what? A conceptual analysis of dual-process theories. In J. W. Sherman, B. Gawronski, & Y. Trope (Eds.), Dual-process theories of the social mind (pp. 3–19). New York: Guilford Press.
Cushman, F. (2013). Action, Outcome, and Value: A Dual-System Framework for Morality. Personality and Social Psychology Review, 17(3), 273–292. https://doi.org/10.1177/1088868313495594
Cushman, F., Young, L., & Greene, J. D. (2010). Multi-system moral psychology. In J. M. Doris, M. P. R. Group, & others (Eds.), The moral psychology handbook (pp. 47–71). Oxford: OUP.
Davis, D., Dooley, M., Hook, J., Choe, E., & McElroy, S. (2017). The Purity/Sanctity Subscale of the Moral Foundations Questionnaire Does Not Work Similarly for Religious Versus Non-Religious Individuals. Psychology of Religion and Spirituality, 9(1), 124–130. https://doi.org/10.1037/rel0000057
Davis, D., Rice, K., Tongeren, D. V., Hook, J., DeBlaere, C., Worthington, E., & Choe, E. (2016). The Moral Foundations Hypothesis Does Not Replicate Well in Black Samples. Journal of Personality and Social Psychology, 110(4). https://doi.org/10.1037/pspp0000056
Doğruyol, B., Alper, S., & Yilmaz, O. (2019). The five-factor model of the moral foundations theory is stable across WEIRD and non-WEIRD cultures. Personality and Individual Differences, 151, 109547. https://doi.org/10.1016/j.paid.2019.109547
Gawronski, B., Armstrong, J., Conway, P., Friesdorf, R., & Hütter, M. (2017). Consequences, norms, and generalized inaction in moral dilemmas: The CNI model of moral decision-making. Journal of Personality and Social Psychology, 113(3), 343–376. https://doi.org/10.1037/pspa0000086
Gawronski, B., & Beer, J. S. (2017). What makes moral dilemma judgments “utilitarian” or “deontological”? Social Neuroscience, 12(6), 626–632. https://doi.org/10.1080/17470919.2016.1248787
Gawronski, B., Conway, P., Armstrong, J., Friesdorf, R., & Hütter, M. (2018). Effects of incidental emotions on moral dilemma judgments: An analysis using the CNI model. Emotion, 18(7), 989–1008. https://doi.org/10.1037/emo0000399
Graham, J., Haidt, J., Koleva, S., Motyl, M., Iyer, R., Wojcik, S. P., & Ditto, P. H. (2013). Moral Foundations Theory: The Pragmatic Validity of Moral Pluralism. In P. Devine & A. Plant (Eds.), Advances in Experimental Social Psychology (Vol. 47, pp. 55–130). Academic Press. https://doi.org/10.1016/B978-0-12-407236-7.00002-4
Graham, J., Haidt, J., Motyl, M., Meindl, P., Iskiwitch, C., & Mooijman, M. (2019). Moral Foundations Theory: On the advantages of moral pluralism over moral monism. In K. Gray & J. Graham (Eds.), Atlas of Moral Psychology. New York: Guilford Publications.
Graham, J., Haidt, J., & Nosek, B. A. (2009). Liberals and conservatives rely on different sets of moral foundations. Journal of Personality and Social Psychology, 96(5), 1029–1046. https://doi.org/10.1037/a0015141
Graham, J., Nosek, B. A., Haidt, J., Iyer, R., Koleva, S., & Ditto, P. H. (2011). Mapping the moral domain. Journal of Personality and Social Psychology, 101(2), 366–385. https://doi.org/10.1037/a0021847
Greene, J. D. (2007). The Secret Joke of Kant’s Soul. In W. Sinnott-Armstrong (Ed.), Moral Psychology, Vol. 3 (pp. 35–79). MIT Press.
Greene, J. D. (2014). Beyond Point-and-Shoot Morality: Why Cognitive (Neuro)Science Matters for Ethics. Ethics, 124(4), 695–726. https://doi.org/10.1086/675875
Greene, J. D., Morelli, S. A., Lowenberg, K., Nystrom, L. E., & Cohen, J. D. (2008). Cognitive load selectively interferes with utilitarian moral judgment. Cognition, 107(3), 1144–1154. https://doi.org/10.1016/j.cognition.2007.11.004
Haidt, J., & Bjorklund, F. (2008). Social intuitionists answer six questions about moral psychology. In Walter Sinnott-Armstrong (Ed.), Moral psychology, Vol 2: The cognitive science of morality: Intuition and diversity (pp. 181–217). Cambridge, Mass: MIT press.
Kahneman, D. (2002). Maps of bounded rationality: A perspective on intuitive judgment and choice. In T. Frangsmyr (Ed.), Le prix nobel, ed. T. Frangsmyr, 416–499. (Vol. 8, pp. 351–401). Stockholm, Sweden: Nobel Foundation.
Kahneman, D. (2013). Thinking, fast and slow.
Kahneman, D., & Frederick, S. (2005). A model of heuristic judgment. In K. J. Holyoak & R. G. Morrison (Eds.), The cambridge handbook of thinking and reasoning (pp. 267–293). Cambridge: Cambridge University Press.
Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64(6), 515–526. https://doi.org/10.1037/a0016755
Koenigs, M., Young, L., Adolphs, R., Tranel, D., Cushman, F., Hauser, M., & Damasio, A. (2007). Damage to the prefrontal cortex increases utilitarian moral judgements. Nature; London, 446(7138), 908–911. http://0-dx.doi.org.pugwash.lib.warwick.ac.uk/10.1038/nature05631
Kumar, V. (2016). The empirical identity of moral judgment. The Philosophical Quarterly, 66(265), 783–804.
Moors, A. (2014). Examining the mapping problem in dual process models. In Dual process theories of the social mind (pp. 20–34). Guilford.
Moors, A., & De Houwer, J. (2006). Automaticity: A Theoretical and Conceptual Analysis. Psychological Bulletin, 132(2), 297–326. https://doi.org/10.1037/0033-2909.132.2.297
Morewedge, C. K., & Kahneman, D. (2010). Associative processes in intuitive judgment. Trends in Cognitive Sciences, 14(10), 435–440. https://doi.org/10.1016/j.tics.2010.07.004
Paxton, J. M., & Greene, J. D. (2010). Moral Reasoning: Hints and Allegations. Topics in Cognitive Science, 2(3), 511–527. https://doi.org/10.1111/j.1756-8765.2010.01096.x
Qureshi, A., Apperly, I. A., & Samson, D. (2010). Executive function is necessary for perspective selection, not level-1 visual perspective calculation: Evidence from a dual-task study of adults. Cognition, 117(2), 230–236.
Thomson, J. J. (1976). Killing, Letting Die, and The Trolley Problem. The Monist, 59(2), 204–217. https://doi.org/10.5840/monist197659224
Trémolière, B., & Bonnefon, J.-F. (2014). Efficient KillSave Ratios Ease Up the Cognitive Demands on Counterintuitive Moral Utilitarianism. Personality and Social Psychology Bulletin, 124(3), 379–384. https://doi.org/10.1177/0146167214530436
  1. See Paxton & Greene, 2010 for a compact overview of Greene’s theory. The theory has been presented in a variety of different ways (see, for example, Cushman, Young, & Greene (2010) for an alternative presentation). 

  2. Greene (2014) suggests that the fast process is responsible for characteristically deontological responses, but this further assumption is not required to generate the predictions considered here. 

  3. Later we will consider an alternative interpretation of the same findings due to Gawronski, Conway, Armstrong, Friesdorf, & Hütter (2018, p. 1006)

  4. The stripped-down dual-process theory not strictly speaking mine. It was developed jointly with Ian Apperly, Jason Low and Hannes Rakoczy. 

  5. Paxton & Greene (2010, pp. 513–4) offer a concise comparison: ‘there are two critical differences between Haidt’s SIM and Greene’s dual-process model. First, while the SIM posits that reasoned judgment within an individual is, ‘‘rare, occurring primarily in cases in which the intuition is weak and processing capacity is high,’’ Greene’s dual-process model allows that moral reasoning—especially utilitarian⁄consequentialist reasoning—may be a ubiquitous feature of moral common sense. Second, according to the SIM, social influence on moral judgment only occurs when one person succeeds in modifying another’s intuition.’