<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Networks of beliefs: An integrative theory of individual- and social-level belief dynamics.</title></titleStmt>
			<publicationStmt>
				<publisher>American Psychological Association</publisher>
				<date>09/19/2024</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10556270</idno>
					<idno type="doi">10.1037/rev0000494</idno>
					<title level='j'>Psychological Review</title>
<idno>0033-295X</idno>
<biblScope unit="volume"></biblScope>
<biblScope unit="issue"></biblScope>					

					<author>Jonas Dalege</author><author>Mirta Galesic</author><author>Henrik Olsson</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[We present a theory of belief dynamics that explains the interplay between internal beliefs in people’s minds and beliefs of others in their external social environments. The networks of belief theory goes beyond existing theories of belief dynamics in three ways. First, it provides an explicit connection between belief networks in individual minds and belief dynamics on social networks. The connection, absent from most previous theories, is established through people’s social beliefs or perceived beliefs of others. Second, the theory recognizes that the correspondence between social beliefs and others’ actual beliefs can be imperfect, because social beliefs are affected by personal beliefs as well as by the actual beliefs of others. Past theories of belief dynamics on social networks do not distinguish between perceived and actual beliefs of others. Third, the theory explains diverse belief dynamics phenomena parsimoniously through the differences in attention and the resulting felt dissonances in personal, social, and external parts of belief networks. We implement our theoretical assumptions in a computational model within a statistical physics framework and derive model predictions. We find support for our theoretical assumptions and model predictions in two large survey studies (N1 = 973, N2 = 669). We then derive insights about diverse phenomena related to belief dynamics, including group consensus and polarization, group radicalization, minority influence, and different empirically observed belief distributions. We discuss how the theory goes beyond different existing models of belief dynamics and outline promising directions for future research.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><p>Why do people's beliefs sometimes become more extreme over time and in other instances stay quite moderate? When are these beliefs shaped by other related issues, and when are they shaped by one's social environment? Why do people sometimes project their personal beliefs onto others, and at other times perceive others' beliefs with high accuracy? How can a single theory of belief change answer these questions and explain a plethora of phenomena including polarization, radicalization, minority influence, and real-world belief patterns?</p><p>These and other questions about belief formation and change have been investigated in a wide range of disciplines, from psychology <ref type="bibr">(Ajzen, 1991;</ref><ref type="bibr">Dalege et al., 2018;</ref><ref type="bibr">Latan&#233; &amp; Wolf, 1981;</ref><ref type="bibr">Vallacher et al., 2017)</ref>, sociology <ref type="bibr">(Friedkin &amp; Johnsen, 1990;</ref><ref type="bibr">Proskurnikov &amp; Tempo, 2017)</ref>, cultural evolution <ref type="bibr">(Boyd &amp; Richerson, 1985;</ref><ref type="bibr">Hoppitt &amp; Laland, 2013)</ref>, and economics <ref type="bibr">(Acemoglu &amp; Ozdaglar, 2011;</ref><ref type="bibr">Golub &amp; Sadler, 2016)</ref>, to statistical physics <ref type="bibr">(Castellano et al., 2009;</ref><ref type="bibr">Pentland, 2014)</ref> and applied mathematics <ref type="bibr">(Hickok et al., 2022)</ref>. This large body of work has provided a plethora of empirical findings and theories about the structure, formation, and change of beliefs.</p><p>However, there is a disconnect between lines of work that study belief change at the level of a single individual mind (the internal level) and at the level of social networks (the external level). At the internal level, modeling individual belief networks has been a promising framework for explaining empirical findings on how and why people change their beliefs <ref type="bibr">(Dalege et al., 2016;</ref><ref type="bibr">Monroe &amp; Read, 2008;</ref><ref type="bibr">Shultz &amp; Lepper, 1996;</ref><ref type="bibr">Van Overwalle &amp; Siebler, 2005)</ref>. At the external level, belief change has been fruitfully studied within the context of social networks, whereby interactions with others' actual or perceived beliefs can influence one's own beliefs <ref type="bibr">(Christakis &amp; Fowler, 2010;</ref><ref type="bibr">DeGroot, 1974;</ref><ref type="bibr">Festinger, 1954;</ref><ref type="bibr">French, 1956;</ref><ref type="bibr">Friedkin &amp; Johnsen, 1990;</ref><ref type="bibr">Harary, 1959)</ref>.</p><p>The internal and external levels of beliefs have been studied largely in isolation from each other. Models of internal belief networks generally disregard external social networks, although a number of classic social-cognitive theories recognize the importance of social environments in changing individual beliefs and behaviors <ref type="bibr">(Ajzen, 1991;</ref><ref type="bibr">Cialdini &amp; Trost, 1998;</ref><ref type="bibr">Festinger, 1954;</ref><ref type="bibr">Fishbein &amp; Ajzen, 1975;</ref><ref type="bibr">Petty &amp; Cacioppo, 1986)</ref>. On the other side, models of belief dynamics on external social networks, typically developed outside psychology in fields from sociology, economics, computational social science, to statistical physics <ref type="bibr">(Albert &amp; Barab&#225;si, 2002;</ref><ref type="bibr">Easley &amp; Kleinberg, 2010;</ref><ref type="bibr">Friedkin &amp; Johnsen, 1990;</ref><ref type="bibr">Jackson, 2008;</ref><ref type="bibr">Newman, 2003;</ref><ref type="bibr">Watts, 2004)</ref>, largely disregard the richness of individual belief structures and individual differences in perceptions of others' beliefs <ref type="bibr">(Galesic, Bruine de Bruin, et al., 2021)</ref>.</p><p>To acquire a comprehensive understanding of belief dynamics, we need to integrate findings and models at the internal and external levels, ideally using theoretically driven quantitative models that are simple but empirically testable <ref type="bibr">(Galesic, Olsson, et al., 2021)</ref>. In this article, we develop such an integrative theory of belief dynamics, the networks of belief (NB) theory. We build on the attitudinal entropy (AE; <ref type="bibr">Dalege et al., 2018)</ref> framework and the hierarchical Ising opinion model (HIOM; <ref type="bibr">van der Maas et al., 2020)</ref>. Like these theories, we conceptualize beliefs as nodes in attitude networks within a statistical physics framework which enables rigorous investigations and predictions of belief dynamics. We adopt an inclusive definition of beliefs <ref type="bibr">(Galesic, Olsson, et al., 2021)</ref> that encompasses beliefs as assumptions about the state of the world, views on moral and political issues, evaluation of attitudes, or own preferences.</p><p>The NB theory goes beyond past theories in three ways. First, it makes a direct connection between internal beliefs and external social worlds, through people's social beliefs or perceived beliefs of others. This is a crucial step that enables connecting models and findings on internal networks, largely developed in psychology, and belief dynamics models operating solely on the level of external networks, of which multitudes exist in fields from computational social science to statistical physics.</p><p>Our second contribution is explaining how social beliefs can become more or less accurate representations of the actual beliefs of others and how that affects the resulting belief dynamics. In this way, we bridge the gap between "objectively" measured beliefs in social networks that are the major type of data used to study belief dynamics and "subjective" perception of these beliefs that are what eventually matters for social influence <ref type="bibr">(Thomas &amp; Swaine Thomas, 1928)</ref>.</p><p>Our third contribution is explicit modeling of attention to different sources of dissonance between these different beliefs in internal and external networks. We postulate and show empirically that differences in attention to different parts of the internal and external networks, and the resulting differences in felt dissonance regarding those parts, lead to changes in consistency of these network parts. This in turn leads to predictable patterns in people's beliefs and to well-established effects such as polarization, radicalization, and minority influence.</p><p>In what follows, we first outline the main premises of the NB theory, describe the relationships between the central psychosocial constructs in the NB theory and statistical physics constructs, present our formal implementation of the theory together with illustrative simulations and predictions, and report empirical tests of our theoretical predictions. We then demonstrate that the NB theory can account for pervasive phenomena in the belief dynamics literature such as group polarization, group radicalization, and minority influence, as well as for empirical trends in real-world data such as the patterns of political self-identification at a given moment and its increasing polarization over time. We end with a thorough discussion of how the NB theory contributes to the existing models of belief dynamics in different disciplines.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Main Premises</head><p>The NB theory rests on three premises about the underlying psychosocial constructs. First, we assume that beliefs and their relations can be represented as network structures. Second, we assume that individuals aim to reduce dissonance within their belief networks and increase correspondence between perceived and actual beliefs of others around them. Third, dissonance between beliefs only affects belief change when it is felt, and this depends on whether individuals pay attention to their beliefs and their relationships. In their general forms, these premises have been implemented and tested in a range of models and empirical studies.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Belief Networks</head><p>The first main premise of the NB theory is that the dynamics of a single belief depends on related beliefs one has (e.g., <ref type="bibr">Brandt &amp; Sleegers, 2021;</ref><ref type="bibr">Dalege et al., 2016</ref><ref type="bibr">Dalege et al., , 2018))</ref>. For example, in Figure <ref type="figure">1A</ref>, beliefs about vaccination of the person on the left are related to beliefs she has about science, economic situation, and perceived beliefs of her friend on the right. For her friend, beliefs about vaccination are related to his beliefs about a secret conspiracy behind vaccination, economic situation, and perceived beliefs of his friend on the left.</p><p>As shown in Figure <ref type="figure">1B</ref>, these beliefs can be represented as nodes in a network, with edges representing mutual influence of beliefs that different individuals have about various issues and about each other. Going beyond previous theories, the NB theory assumes that beliefs of interconnected individuals form two distinct classes of networks that interact with each other (Figure <ref type="figure">1B</ref>).</p><p>One network represents each individual's internal network, which consists of personal beliefs and social beliefs. Personal beliefs represent beliefs related to an issue, such as various facts, preferences, and more general moral and other values that one considers relevant (e.g., whether one believes that one should get vaccinated might depend on one's beliefs about the efficacy and safety of the vaccine and whether getting vaccinated aligns with one's religious and political beliefs). Social beliefs represent perceived beliefs of other individuals one is connected to.</p><p>A second, external network, describes the connections between individuals. Each connection between two individuals consists of the relation between Individual A's social beliefs about Individual B's actual beliefs and of the relation between Individual B's social beliefs about Individual A's actual beliefs.</p><p>In sum, the two networks, internal and external, are connected through individuals' social beliefs, which are in turn affected by Note. Panel A shows an example of beliefs about vaccination. Panel B shows a more formal visual representation of the model. The focal person has an internal belief network that consists of personal (squares) and social (triangles) beliefs. The personal beliefs include a belief about a certain issue (focal belief b i , e.g., about safety of vaccines) and other related beliefs (b j , e.g., beliefs about science, economy, or various conspiracies). The personal beliefs are connected by edges &#969; ij that represent the mutual influence between the personal beliefs. The focal person also has a social belief, s ik , which is their perceived belief of person k about the issue b i (e.g., whether a friend believes vaccines are safe). The mutual influence between the social belief and the personal belief about issue b i is represented by the edge &#961; ik . The influence of the actual belief b ik of person k on the social belief of the focal person is represented by the directed edge &#945; ik . Subscripts for the focal person and the edges between the other beliefs b j are omitted for simplicity. The other person k has the same belief structure as the focal person. See the online article for the color version of this figure.</p><p>NETWORKS OF BELIEFS THEORY both their own personal beliefs and by the actual beliefs of others in their social circle. This assumption is based on findings that individuals perceive their social environment relatively accurately <ref type="bibr">(Galesic et al., 2018;</ref><ref type="bibr">Nisbett &amp; Kunda, 1985)</ref>, while also showing ego projection in some instances <ref type="bibr">(Gagn&#233; &amp; Lydon, 2004;</ref><ref type="bibr">Goel et al., 2010)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Dissonance Reduction</head><p>The second main premise of the NB theory is that people have a need to reduce dissonance they might feel because of inconsistency between their different personal and social beliefs <ref type="bibr">(Festinger, 1957;</ref><ref type="bibr">Gawronski, 2012;</ref><ref type="bibr">Gawronski &amp; Strack, 2012;</ref><ref type="bibr">Heider, 1946</ref><ref type="bibr">Heider, , 1958))</ref>, as well as because of a lack of correspondence between their social beliefs (perceptions of others) and what the others actually believe <ref type="bibr">(Dhami &amp; Olsson, 2008;</ref><ref type="bibr">Hammond, 1965)</ref>. We assume three types of dissonance. Inconsistency between personal beliefs (e.g., believing that vaccines are effective at preventing diseases but also dangerous is inconsistent, because they have opposing implications for one's decision to get vaccinated) can cause personal dissonance. Inconsistency between personal and social beliefs (e.g., believing that vaccines are effective but perceiving some or all friends as believing otherwise) can cause social dissonance. Finally, lack of correspondence between social beliefs (perceived beliefs of others) and others' actual beliefs can give rise to external dissonance. Note that in contrast to personal and social dissonance, external dissonance requires that one is able to observe lack of correspondence between one's social beliefs and others' actual beliefs (such as when a friend behaves in stark contrast to one's social beliefs). The study of the accuracy of the perception of the characteristics of other individuals and groups has a long history in psychology (for reviews, see <ref type="bibr">Funder, 1995;</ref><ref type="bibr">Gagn&#233; &amp; Lydon, 2004;</ref><ref type="bibr">Galesic et al., 2018)</ref>, but these studies have not investigated the processes of belief change or dissonance reduction. Of more relevance to belief change is literature on metaperception correction that investigates ways of changing inaccurately held beliefs. Here too, the focus is not on the processes of belief change or dissonance reduction. In addition, corrections are predominantly done on the group level <ref type="bibr">(Mernyk et al., 2022)</ref>, while in NB theory, the focus is on connected individuals.</p><p>The NB theory is the first to explicitly differentiate between personal, social, and external dissonances. Other models implement belief change processes through dissonance reduction, but they do not explicitly differentiate dissonances due to the lack of consistency of personal and social beliefs (social dissonance) and the lack of correspondence of social and actual others' beliefs (external dissonance; for related models, see <ref type="bibr">Ellinas et al., 2017;</ref><ref type="bibr">Goldberg &amp; Stein, 2018;</ref><ref type="bibr">Rodriguez et al., 2016;</ref><ref type="bibr">Schweighofer et al., 2020;</ref><ref type="bibr">van der Maas et al., 2020</ref>; more in the Discussion section). To fully understand when and why individuals change their beliefs, we need to understand how these dissonances together lead to different social phenomena (e.g., see the Minority Influence section).</p><p>In line with social psychological research on dissonance, ambivalence, and related phenomena <ref type="bibr">(Festinger, 1957;</ref><ref type="bibr">Newby-Clark et al., 2002)</ref>, we distinguish between potential and felt dissonance. Potential dissonance refers to a lack of consistency and correspondence in one's beliefs, while felt dissonance refers to the psychological discomfort arising when attending to potential dissonance. The concept of felt dissonance is similar to the concept of felt ambivalence <ref type="bibr">(Dalege et al., 2018;</ref><ref type="bibr">Priester &amp; Petty, 1996;</ref><ref type="bibr">van Harreveld et al., 2009)</ref>. As pointed out by several authors (e.g., <ref type="bibr">Newby-Clark et al., 2002;</ref><ref type="bibr">Priester &amp; Petty, 1996;</ref><ref type="bibr">van Harreveld et al., 2009)</ref>, potential dissonance due to incongruent beliefs does not have to result in felt dissonance.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Attention to Dissonance</head><p>The third main premise of the NB theory is that the extent to which potential dissonance translates into felt dissonance is moderated by the amount of attention to different inconsistencies between beliefs. This attention will depend on the overall importance of the issue, as well as on individual and cultural differences in sensitivity to potential dissonance and its sources. One example of what could moderate attention is the need for closure. People might differ in how much they desire closure in their internal and external networks, as reflected in their propensity to seek different opinions, to like or dislike questions that can be answered in different ways, or to be irritated when one person disagrees with everyone else in a group <ref type="bibr">(Webster &amp; Kruglanski, 1994;</ref><ref type="bibr">but see Stalder, 2010)</ref>. Another example could be cultural differences. For example, Japanese but not European American participants are showing more personal dissonance reduction in the presence of relevant others <ref type="bibr">(Kitayama et al., 2004)</ref>.</p><p>Individuals can direct different amounts of attention to personal, social, or external dissonance. For example, when considering who to vote for, some individuals might seek consistency between their beliefs about a certain candidate and their other personal beliefs such as beliefs about moral and economic issues. Other individuals might be more interested in achieving consistency between their beliefs about the candidate and what they perceive others around them think about the candidate. Still, others might feel that it is important to know accurately what others think, that is, achieve correspondence between their social beliefs and others' actual beliefs. The attention to dissonance in different parts of one's internal and external network can also depend on the issue at hand. For example, individuals might care more about their personal dissonance when evaluating a political candidate, about their social dissonance when choosing what to wear, and about the correspondence dissonance when deciding whether to get vaccinated. Directing more attention to different parts of one's belief network results in a higher impact of those parts of the network, which will be more likely to motivate a change in one's beliefs according to the felt dissonance. Importantly, these different dissonances can be measured and modeled, providing a nuanced picture of when and why different people change (or do not change) beliefs about different issues.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Relating Psychosocial and Statistical Physics Constructs</head><p>The premises of the NB theory need to be translated into a computational model that allows to investigate the theory's implied dynamics and to derive testable predictions. There are many frameworks that can be used to develop such computational models <ref type="bibr">(Borsboom, van der Maas, et al., 2021;</ref><ref type="bibr">Page, 2018)</ref>. These include general constraint satisfaction frameworks (e.g., <ref type="bibr">Shultz &amp; Lepper, 1996)</ref> and their neural network implementations (e.g., <ref type="bibr">Monroe &amp; Read, 2008)</ref>. We choose a statistical physics framework, in which beliefs are represented as spins, potential dissonance is represented as energy, and attention is represented as temperature. We find the statistical physics framework useful for two main reasons. First, statistical physics models are well-suited to describe higher level cognitive and social dynamics emerging from lower level dynamics in a parsimonious way. This has been recognized in previous models and frameworks <ref type="bibr">(Castellano et al., 2009;</ref><ref type="bibr">Galesic, Olsson, et al., 2021;</ref><ref type="bibr">Rodriguez et al., 2016;</ref><ref type="bibr">van der Maas et al., 2006)</ref>. In the present case, statistical physics models enable us to investigate how belief dynamics emerge at the level of internal networks (from interactions between personal and social beliefs within individuals) and at the level of external networks (from interactions between individuals). Second, we can build on already existing statistical physics models of beliefs at the internal level <ref type="bibr">(Dalege et al., 2018;</ref><ref type="bibr">Schweighofer et al., 2020;</ref><ref type="bibr">van der Maas et al., 2020)</ref> and at the external level <ref type="bibr">(Castellano et al., 2009;</ref><ref type="bibr">Pham et al., 2022;</ref><ref type="bibr">Redner, 2019)</ref>. Of course, as every analogy in science <ref type="bibr">(Gigerenzer, 1991)</ref>, the statistical physics analogy has limitations, and it is important to not force statistical physics assumptions on human psychology and sociality when they are not applicable (see the Discussion section). Similarly, we acknowledge that other factors than dissonance reduction play a role in the formation and change of beliefs such as information integration <ref type="bibr">(Anderson, 1971</ref>; see the Discussion section).</p><p>In Table <ref type="table">1</ref>, we describe the relationships between the psychosocial constructs in our main premises, the corresponding statistical physics constructs, and the empirical measures of these constructs. The formal implementation of the NB theory rests on three core assumptions about the relationship between psychosocial and statistical physics constructs, described next. These three assumptions map onto and enable modeling of the three premises described in the previous section (the Main Premises section).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Beliefs as Spins</head><p>First, we assume that belief nodes can be modeled analogous to what is traditionally referred to as spins in statistical physics systems. This is a standard assumption in belief dynamic models based on a statistical physics framework (for a review, see <ref type="bibr">Castellano et al., 2009)</ref>. In physics, the term spin refers to a variable that can take two or more states. Beliefs are assumed to range from very positive to very negative; a person can, for example, have a highly positive opinion about Politician A but a weak negative opinion about Politician B. Conceptualizing beliefs as spins represents these magnitudes of beliefs as values ranging from -1 to 1, with higher positive or negative values indicating stronger endorsement of the given belief in either direction.</p><p>Furthermore, like in physical systems where interacting particles are considered to be coupled, we can assume that beliefs within a single individual as well as beliefs of different individuals can be coupled, that is, they can influence each other. Couplings, or edges, can range in strength, representing different amounts of influence between one's own and between own and others' beliefs. Some beliefs are fairly independent, while other beliefs have a strong influence on each other. For example, one's beliefs about the effectiveness and safety of COVID-19 vaccines are probably more strongly related than one's beliefs about the effectiveness of COVID-19 vaccines and the safety of flu vaccines. The sign of a given coupling represents whether two beliefs have an inhibitory or excitatory influence on each other. For example, the beliefs that vaccines are effective and safe might have an excitatory influence on each other, while the beliefs that vaccines are effective and unnatural might have an inhibitory influence on each other.</p><p>Besides influencing each other, belief nodes can also be affected by an outside influence such as new information (e.g., scientific findings about an issue), a media source (e.g., arguing for or against an issue), a transformative event (e.g., surprising elections or a war), fitness benefits or drawbacks of different beliefs (e.g., antivaccination views), and others. More general beliefs such as those about moral values and cultural norms can also affect beliefs about specific issues, without being affected in turn, at least not in the short run. Theoretically, all these influences can be represented in a network model, but practically, it is not feasible to measure or include all of them. Therefore, to model those more durable exogenous influences, we use the statistical physics analogy of local fields whose positive (negative) values lead to a higher probability to (not) endorse a given belief. These local fields influence belief nodes in the network but do not get influenced in turn.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Potential Dissonance as Energy</head><p>Second, we formalize potential dissonance as energy. In statistical physics systems, energy is high when systems include particles that are strongly connected but misaligned. Similarly, potential dissonance is a function of both misalignment of beliefs and the strength of the influence between beliefs. Formally, if two beliefs have a strong excitatory influence between each other but are misaligned, energy will be higher than if two beliefs, which have weak excitatory influence between each other, are misaligned. The concept that energy represents potential dissonance, consistency, or harmony has a long history in psychology and related fields. For example, in Hopfield's 1980s work <ref type="bibr">(Hopfield, 1982)</ref>, he linked energy to bidirectionally connected neural networks, and researchers conceptualized energy as lack of harmony <ref type="bibr">(Smolensky, 1986)</ref> or coherence (e.g., <ref type="bibr">Thagard &amp; Verbeurgt, 1998)</ref>, and the energy concept has been related to dissonance in belief dynamic models <ref type="bibr">(Shultz &amp; Lepper, 1996)</ref>.</p><p>To implement our assumption that there are three types of dissonances (personal, social, and external, see the Main Premises section), we assume three different contributions to energy-one for the misalignment between different personal beliefs, one for the misalignment between personal and social beliefs, and one for the misalignment between social beliefs and actual beliefs of others. That potential dissonance can be formalized as energy and that people can differentiate between the dissonances in different parts of their belief networks are core assumptions of the theory that have not yet been investigated empirically.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Empirical Tests of the Assumption of Three Separate Dissonances</head><p>To investigate the validity of our assumption that there are three separate dissonances, we conducted two empirical studies (see Appendix A for details and Table <ref type="table">1</ref> for examples of main questions). Study 1 was a survey with 973 U.S. participants from Mechanical Turk which assessed their beliefs on genetically modified (GM) food safety and related moral and political beliefs, consistency and dissonance in personal and social beliefs, and reactions to an informational intervention. Study 2 was a two-wave survey which involved 669 U.S. participants from the University of Southern California's Understanding America Panel, examining beliefs on GM food, flu vaccination, and climate change, plus nominated friends' actual beliefs. The focus was on personal/social beliefs and NETWORKS OF BELIEFS THEORY felt dissonance, influenced by seeing friends' responses and scientists' views. All questions in both studies except for the demographics were answered on 7-point scales with labeled extremes. Potential dissonances were measured by the incongruence of beliefs multiplied by the estimated connection between them.</p><p>First, the results from confirmatory factor analyses from Study 1 showed that personal and social felt dissonances formed two separate factors, which were moderately related. This finding is in line with the assumptions of our theory. Second, regression analyses showed that felt personal dissonance was reliably best predicted by </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Attention as Temperature</head><p>Third, the moderating factor of attention is implemented by using the statistical physics concept of (inverse) temperature.</p><p>Temperature represents to what extent the belief updating process is more or less probabilistic. High temperature results in more randomness in the belief updating process so that beliefs change in a way that does not necessarily reduce potential dissonance, while low temperature results in a more a deterministic belief change in a way that reduces dissonance. The NB theory therefore implies that belief change will be related to dissonance only when a person pays attention to the dissonance, while lack of attention results in beliefs changing in an almost random fashion. The formal implementation in the model is inverse temperature in the form of a parameter &#946;. This parameter is multiplied with the dissonance of the beliefs, and therefore, it amplifies the differences in dissonances between different belief states (see Equations 2 and 6). This amplification in turn leads to a more pronounced pressure to reduce dissonance and leads to more deterministic, predictable network dynamics. In contrast, low inverse temperature leads to a belief network behaving in a random, unpredictable fashion.</p><p>Note that the concept of temperature in statistical physics is different than the intuitive concept of temperature in everyday language. In everyday experience, when people are excited about something they might experience higher heart rate, blood pressure, and related physiological changes that make one feel warmer. Hence, the relationship between excitement and temperature translates to "higher temperature" in everyday language meaning "stronger opinions." However, in statistical physics, the concept of temperature is very different. Here, higher temperature (typically induced exogenously) causes particles to behave more erratically, not necessarily in a way that reduces the overall energy. Hence, the relationship between temperature and the probabilistic nature of particle systems can be mapped on the relationship between the lack of attention and the probabilistic nature of belief systems. In the latter, lower attention causes beliefs to update more probabilistically, not necessarily in a way that reduces the overall dissonance.</p><p>To implement our assumption that individuals direct different amounts of attention to inconsistencies among their personal and social beliefs, as well as to the lack of correspondence between their social beliefs and actual beliefs of people around them, the NB theory features three temperatures-one for directing attention to the misalignment between different personal beliefs, one for directing attention to the misalignment between personal and social beliefs, and one for directing attention to the misalignment between social beliefs and actual beliefs of others. High temperature (or low attention) of one part in the network results in more probabilistic updating of beliefs for this network, implying low impact of this network on belief change. Low temperature (or high attention) of one part in the network results in a more deterministic belief updating process, implying high impact of this network on belief change. Implementing the NB theory in this way leads to the consequence that attention is necessary for dissonance reduction. With enough attention, potential dissonance translates into felt dissonance, which in turn typically leads to lower (potential) dissonance. In some cases, it can be difficult to lower the dissonance, for example, when one's social environment is against vaccines but one's personal beliefs are highly positive toward vaccines. Such situations are probably the ones in which individuals feel the most dissonance for a prolonged time.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Empirical Test of the Separability of Different Attention Parameters</head><p>To test the separability of the different attention parameters, we again used the empirical studies described in the previous section and in Appendix A. As described in detail in Appendix C, we first tested whether questions about the importance of reducing different dissonances (see also example questions in Table <ref type="table">1</ref>) formed three separated factors. Confirmatory factor analyses of the data in Study 2 indeed showed factors for the importance of reducing personal dissonance, for the importance of reducing social dissonance, and for the importance of reducing external dissonance.</p><p>We then proceeded to test whether these different factors uniquely predict their associated dissonances. NB theory predicts that higher attention to dissonance predicts a reduced potential dissonance (energy): When people pay attention to their potential dissonance (i.e., when they experience felt dissonance), their beliefs will tend to become more consistent, reducing potential dissonance. We find that attention to dissonance in the personal, social, and external parts of the belief network relates negatively to the potential dissonance (energy) in those parts of the network. Study 1 lacked data on participants' social contacts' actual beliefs, limiting the measurement of energy in external networks. However, accurate social beliefs are likely to raise internal network energy due to potential inconsistencies between social and personal beliefs. Findings weakly support this, potentially due to homogeneous social networks or the greater influence of belief expression frequency on external network temperature.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Formal Implementation</head><p>In this section, we formalize the NB theory to study the interactions of internal and external belief network dynamics and derive quantitative empirical predictions. We first present the general implementation of the NB theory connecting different parts of the theory and then introduce each part separately. We illustrate each part using simulations, discuss the main predictions following from the formalization, and present empirical tests of our assumptions and predictions. In Appendix D, we discuss several ways to estimate and measure the core constructs of the NB theory in empirical data.</p><p>We define the probability that an individual updates their personal belief b i from its current state to a new state b &#8242; i as:</p><p>where b &#8242; i is one of m possible states ranging from -1 to 1 and &#916;(D pers &#222; represents the change in felt dissonance that would occur if b i flips to b &#8242; i (the felt dissonance of b i is subtracted from the felt dissonance of b &#8242; i ). Thus, if the felt dissonance of b &#8242; i is lower than the NETWORKS OF BELIEFS THEORY felt dissonance of b i , the probability of flipping to b &#8242; i is higher than keeping b i . Conversely, if the felt dissonance of b &#8242; i is higher than the felt dissonance of b i , the probability of flipping to b &#8242; i is lower than keeping b i . Equation 1 is an adapted form of <ref type="bibr">Glauber's (1963)</ref> dynamics for ordinal belief states. In contrast to Glauber's dynamics, where only energies of two states (i.e., -1 and 1) are compared to each other, the current updating compares the current state's energy to the energies of each of the m possible states. To ensure that the probabilities of remaining in the current state and the probabilities of flipping to any other state together sum to 1, we divide them by the sum of the energy comparisons for each state. Additionally, while the standard Glauber dynamics formulation includes a division of change in energy by the temperature of the system, we account for the (inverse) temperature by including it as attention parameters in the equation for felt dissonance. Specifically, we define the felt dissonance D pers as:</p><p>where H pers is the potential dissonance between personal beliefs (defined by Equation <ref type="formula">3</ref>), H soc is the potential dissonances between personal and social beliefs (defined by Equation <ref type="formula">4</ref>), and &#946; pers and &#946; soc represent the attention paid to each of the dissonances. The values of &#946; ranges from zero to infinity. We assume that the correlation between these attention parameters is positive but lower than 1 (for empirical validation, see Appendix C). The ratio between these parameters determines the amount of weight given to different sources of dissonance. If, for example, one values the consistency of their different personal beliefs more than the consistency of their personal and social beliefs, then &#946; pers would be higher than &#946; soc .</p><p>Because the attention parameters are multiplied with the dissonances, high attention parameters amplify differences in dissonance. A minor difference in dissonance will lead to a minor difference in the probability to flip when the attention parameter is also low, but to a pronounced difference in the probability to flip if the attention parameter is high. Note that the way we implemented belief updating is a local process-each belief can only reduce its dissonance with connected nodes and the global dissonance of the network is reduced only indirectly. A belief network can therefore get stuck in a local minimum where parts of the network have reduced their local dissonance, but the global dissonance of the network is not at its potential minimum. This effect usually occurs when attention is very high, so that beliefs have a high pressure to reduce their dissonance locally. The network then can only "escape" from such local minima if attention is somewhat lowered.</p><p>For the potential dissonance between personal beliefs, we extend the formulation from the AE framework <ref type="bibr">(Dalege et al., 2016</ref><ref type="bibr">(Dalege et al., , 2018</ref>; see also <ref type="bibr">van der Maas et al., 2020)</ref>. In the AE framework, the dynamics of belief networks is modeled using the <ref type="bibr">Ising (1925)</ref> model and beliefs are modeled as binary. Here, we extend this formulation to a version of Potts model <ref type="bibr">(Wu, 1982)</ref> that allows for an approximation of continuous beliefs (measured on a scale from -1, representing complete disagreement, to 1, representing complete agreement). Similar representations have been used in a variety of different models (e.g., <ref type="bibr">Hopfield, 1982</ref><ref type="bibr">Hopfield, , 1984))</ref>. The potential dissonance between personal beliefs is given by:</p><p>where b i represents the current state of given personal belief i on a continuum between -1 and 1, &#969; i represents the exogenous influence on b i , and the edge weights &#969; ij represent the influence between b i and a different personal belief b j . If the influence between two beliefs is excitatory, their dissonance is high when they are in different states and low when they are in similar states. Conversely, if the influence between two beliefs is inhibitory, their dissonance is high when they are in similar states and low when they are in different states. Note that both the values of &#969; ij and &#964; i are always relative to &#946; pers . For example, a value of 1 for both &#969; ij and &#964; i and a value of 0.1 for &#946; pers would result in the exact same dynamics as a value of 10 for both &#969; ij and &#964; i and a value of 1 for &#946; pers . The same holds for the edges and attention parameters in the other energy functions. Similarly, &#969; ij and &#964; i need to be in a similar range to both be able to affect the dynamics of the personal beliefs.</p><p>In addition to the potential personal dissonance, personal beliefs are also affected by the potential social dissonance, given by:</p><p>where the &#961; ik represents the influence between personal belief b i and an associated social belief s i one has about a person k (in other words, one's perceived belief of the person k's belief). Note that the social beliefs have no local field (such as &#964; i in Equation <ref type="formula">3</ref>), because their dispositions are determined implicitly by the local fields acting on personal beliefs of others in one's social environment. We thus assume that social beliefs are only affected by one's own beliefs and actual beliefs in one's external network, given by the following equation:</p><p>where &#916;(D soc ) represents the difference in felt dissonance between the current state s i and a new state s &#8242; i , stemming from potential dissonances between personal and social beliefs (H soc ; defined by Equation <ref type="formula">4</ref>) and potential dissonances between social and actual beliefs of connected individuals (H ext ; defined by Equation <ref type="formula">7</ref>), each weighted by an attention parameter &#946; as defined by Equation <ref type="formula">6</ref>:</p><p>where &#946; soc and &#946; ext represent the attention paid to each of the dissonances. We again assume that the correlation between these attention parameters is positive but lower than 1 (for empirical validation, see Appendix C). The ratio between these parameters determines the amount of weight given to different sources of dissonance. If, for example, one is motivated to hold accurate social beliefs and discusses beliefs with others a lot, it is likely that their &#946; ext will be higher than &#946; soc . We define the external potential dissonance as:</p><p>where s ik is the individual's social belief about belief i of person k, b ik is the actual belief i of the connected person k, and &#945; k represents the influence of the actual belief b ik of person k on the social belief s ik . In contrast to the edges in the internal network &#969; ij and &#961; ik , &#945; k is directed as it is assumed that only actual beliefs can influence social beliefs directly, but that social beliefs can influence actual beliefs only indirectly. The dynamics of each person k's beliefs b ik are modeled by Equations 1 and 2.</p><p>Because the dissonance between two beliefs in our implementation is expressed as multiplication of belief states (b i b j in Equation 3, b i s ik in Equation <ref type="formula">4</ref>, and s ik b ik in Equation <ref type="formula">5</ref>), the lowest dissonance is achieved when two beliefs have the same (respectively different) and extreme states when they are positively (respectively negatively) connected. We think that it is reasonable to assume that more extreme values result in lower energies, because extreme values represent a more unambiguous belief, which probably serves the need for consistency more than a more ambiguous belief. Additionally, in Appendix E, we investigate several other distance measures and show that multiplication is empirically the best suited distance measure for our theory. As can be seen in Figure <ref type="figure">E1</ref>, only the multiplication implementation can reproduce the increasing bimodality that we see in empirical data (Figure <ref type="figure">2</ref>). Furthermore, this multiplication implementation has been used in several other constraint satisfaction models of belief change (e.g., <ref type="bibr">Shultz &amp; Lepper, 1996)</ref>.</p><p>Note that different potential dissonances will have different sizes, reflecting the sum over different numbers of pairs of personal beliefs (Equation <ref type="formula">3</ref>), personal and social beliefs (Equation <ref type="formula">4</ref>), and social and actual beliefs (Equation <ref type="formula">7</ref>). This formulation as sums allows that a person who has relatively more social contacts than beliefs related to an issue might feel higher social or external dissonance than a person who has relatively more personal beliefs about an issue.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Illustrations of the Networks of Beliefs Theory's Dynamics</head><p>To illustrate the belief dynamics implied by the different attention parameters, we ran several illustrative simulations varying one attention parameter while keeping the other two attention parameters constant. We turn to simulations of the interactions between the different attention parameters in the Explaining Established Belief Dynamics Phenomena section. Codes for all simulations can be found at <ref type="url">https://osf.io/n58h6/?view_only=0da2fb3267574e4fa5397  8bc4a36ba32</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>General Simulation Setup</head><p>In all simulations reported in this article, each individual has a fully connected personal belief network of 10 nodes, as illustrated by the square nodes in the leftmost panel in Figure <ref type="figure">2A</ref>. One of the personal beliefs of each individual represents a focal belief that is communicated in the external network. We focus on the focal beliefs about an issue and its related personal and social beliefs, where this part of the belief network is represented as a fully connected network. The whole belief system will have a more nuanced pattern of relationships. The simulations mimic interactions about one important (focal) topic at a time, but can be extended to other network structures and more beliefs. We set the edge weights in all simulations to &#969; = .4 for the influence between personal beliefs, &#961; = 1 for the influence between personal and social beliefs, and &#945; = 1.4. These values lead to moderate correlations between beliefs in all parts of the belief network (r &#8773; .3) at moderate levels of attention (&#946; = 1; see Appendix F for details). Each belief (both personal and social) can have seven different states: -1, -.66, -.33, 0, .33, .66, and 1. Simulations with other numbers of belief states produce equivalent patterns of results. We calculate probabilities of different belief states b &#8242; i and s &#8242; i according to Equation 1 and Equation 5 and assign a new belief state according to these probabilities. In each iteration, all beliefs are updated in turn and in random order. Every simulation run consists of 100 iterations unless specified otherwise. Unless otherwise noted, beliefs were initialized randomly and all &#964; were set to 0. For the simulations in Appendix G, we compared the belief dynamics with the attention parameter of interest set to either 0.5 or 2, keeping the other attention parameters constant. The reason we used these values for the attention parameter is that we wanted to compare low and high values for the attention parameter that meaningfully differ, but which are still in a realistic range for the networks we investigate in this article. Note that interpreting absolute values of the attention parameter is not instructive, as the effects of it are contingent on other factors such as the size and connectivity of the network. The illustrations provided in this section show that the values for the attention parameter function in this way-we see pronounced differences in the dynamics for the networks between low and high values for the attention parameter and these dynamics also match roughly what we observe in empirical data.</p><p>For each illustrative simulation, we ran each attention condition 1,000 times.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Implications of Attention Directed at Personal Dissonance</head><p>For the implications of varying attention directed at personal dissonance, we investigate the mean distribution of personal beliefs within each individual, as well as the dynamics of the mean beliefs over time. The two leftmost panels in Figure <ref type="figure">3A</ref> show the distributions of mean belief states at the end of each of the 100 runs for each individual, for each level of attention. These results suggest that low attention leads to a normal distribution of mean end beliefs, with most networks ending up in a neutral state (equivalent to how they started). In contrast, high attention leads to a bimodal distribution with most networks ending up in an extreme state. To better understand the dynamics over time, Panels (d) and (e) in Appendix G show the results of five randomly selected simulation runs over time, assuming either low or high attention. Low attention leads to networks fluctuating around the neutral middle point, while high attention leads to more stable networks that settle at more extreme belief states.</p><p>These simulation results lead to two basic implications of the NB theory. First, if individuals pay much attention to their potential personal dissonance, the theory predicts a bimodal distribution of belief averages, while it predicts a normal distribution of belief averages when individuals pay little attention to this dissonance. Second, paying attention to potential personal dissonance should lead to a higher stability and resistance of beliefs. Note. The predicted distributions of personal beliefs under low and high attention to personal dissonance (Panel A) are echoed in the distributions of average beliefs for participants who assigned low versus high levels of importance to their potential personal dissonance (Panel B, results from Study 1, N = 973). See the online article for the color version of this figure.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>NETWORKS OF BELIEFS THEORY</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Empirical Tests of Implications of Attention Directed at Personal Dissonance</head><p>We tested these implications and found support for them. First, directing attention to personal dissonance should result in a bimodal belief distribution among individuals valuing belief consistency, compared to a normal distribution for others. Study 1 (see Appendix A) tested this by examining GM food belief averages among participants differing in consistency importance. Figure <ref type="figure">2</ref> shows that high-importance individuals displayed more bimodal belief distributions, confirming the implication.</p><p>Second, focusing on personal dissonance should enhance belief stability and resistance, resulting in extreme, consistent beliefs that require strong intervention to alter. Study 1's educational intervention on GM food safety demonstrated that individuals who attribute higher importance to their belief consistency, and thus pay higher attention to their personal dissonance, showed less belief change postintervention. Structural equation modeling confirmed this relationship: Higher attention to dissonance was related to less belief change after the intervention.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Implications of Attention Directed at Social Dissonance</head><p>For the implications of varying attention directed at social dissonance, we focus on the correlation between social and personal beliefs and the variance in social beliefs within each individual. As can be seen in the two rightmost panels in Figure <ref type="figure">3A</ref>, higher attention leads to lower variance of the social beliefs at the end of a simulation run. This is the result of the social beliefs becoming more interdependent with the focal personal belief.</p><p>These simulation results lead to two further basic implications of the NB theory. First, the theory predicts that those individuals will have social beliefs that are more consistent with their personal beliefs (Panels f and g in Appendix G). This effect can occur either because these (B) Survey data (A) Model Note. The predicted differences in variance of social beliefs under low and high attention to social dissonance (Panel A) are echoed in the empirically measured variance of social beliefs about five social contacts, for participants assigning different levels of importance to their potential social dissonance (Panel B, left). As predicted by the theory, this reduction in variance is related to reduced difference between social and personal beliefs of these same participants (Panel B, right, results from Study 1, N = 973). See the online article for the color version of this figure.</p><p>NETWORKS OF BELIEFS THEORY individuals project their beliefs more to others, because they change their personal beliefs to be aligned with their social beliefs, or due to a mix of both these processes. Second, if individuals pay much attention to the potential dissonance between their personal beliefs and their social beliefs, the theory predicts that variance of their social beliefs will decrease. When one's social network is heterogeneous (contacts have different beliefs), this effect will resemble ego projection.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Empirical Tests of Implications of Attention Directed at Social Dissonance</head><p>Again, we tested these implications and found support for them. The implications of directing attention to social dissonance are that (a) people who pay more attention to social dissonance will have lower variance of social beliefs and (b) their personal and social beliefs will be more consistent. To test these predictions, we calculate the variance of social beliefs (across the five social contacts) that participants reported in Study 1, as well as the average difference of each of the social beliefs and personal beliefs about the same issues. As Figure <ref type="figure">3b</ref> suggests, both the variance (left panel) and the difference of personal and social beliefs (right panel) tend to be smaller for those participants who reported a higher importance of social consistency (more attention to the social dissonance). (B) Survey data (A) Model Note. The predicted differences in the distribution of personal beliefs under low and high attention to external dissonance (Panel A) are echoed in the empirically measured extremity of personal beliefs, for participants assigning different levels of importance to their potential external dissonance (Panel B, left) and discussing their beliefs with friends more often (Panel B, right, results from Study 2, N = 669). See the online article for the color version of this figure. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Implications of Attention Directed at External Dissonance</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Empirical Tests of Implications Attention Directed at External Dissonance</head><p>As before, we tested this implication and found support for it. The implication of directing attention to external dissonance is that groups of people who pay a lot of attention to their external dissonance (i.e., to the correspondence between their social beliefs and others' actual beliefs) will be more likely to show higher levels of radicalization. To investigate this, we analyze data about the extremity of participants' beliefs in the first wave of Study 2 and regress them on our two proxies of attention to external dissonance: the importance of accurately perceiving friend's beliefs and frequency of discussing a topic with the friend. In a mixed model adjusting for clustering of participants within, we find as expected that both of these proxies for attention were positively related to more radical beliefs, as illustrated in Figure <ref type="figure">4B</ref> (for importance, &#946; = .08, p &lt; .001; for frequency, &#946; = .08, p = .02). These results remain robust after including interactions with topics and controlling for felt social dissonance.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Explaining Established Belief Dynamics Phenomena</head><p>In this section, we discuss how the NB theory can explain established phenomena in belief dynamics, including group polarization, group radicalization, and minority influence. First is a note on the terminology. Some authors use the term group polarization to describe extreme differences in beliefs of different segments of the population (e.g., <ref type="bibr">Axelrod et al., 2021;</ref><ref type="bibr">Iyengar &amp; Westwood, 2015;</ref><ref type="bibr">Yardi &amp; Boyd, 2010)</ref> or strong dislike among different segments <ref type="bibr">(Mason, 2016)</ref>. Here, we will use the term "group polarization" in this sense. Other authors (e.g., <ref type="bibr">Friedkin, 1999;</ref><ref type="bibr">Isenberg, 1986;</ref><ref type="bibr">Sunstein, 2002)</ref> use the term "polarization" to denote radicalization of a whole group toward the same more extreme position, usually occurring after a group discussion or a mere exposure to arguments in line with an existing view. We will therefore call this type of polarization "group radicalization." Finally, we will discuss separately the phenomena of minority influence on group polarization and radicalization.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Consensus and Polarization</head><p>A number of different models have been developed to explain consensus and polarization in societies <ref type="bibr">(Flache et al., 2017;</ref><ref type="bibr">Levin et al., 2021)</ref>. Long-run consensus is associated mostly with unconditional social influence models. These models assume that if individuals are connected by an edge, they will always influence each other toward reducing their belief differences. For nominal beliefs, examples include voter models <ref type="bibr">(Clifford &amp; Sudbury, 1973;</ref><ref type="bibr">Holley &amp; Liggett, 1975;</ref><ref type="bibr">Redner, 2019)</ref>, while for continuous beliefs, the most prominent ones are averaging models <ref type="bibr">(DeGroot, 1974;</ref><ref type="bibr">Friedkin &amp; Johnsen, 1990</ref><ref type="bibr">, 2011)</ref>.</p><p>Group polarization has been extensively studied with conditional influence models that assume a threshold or a tolerance level that determines if an individual will be influenced by a neighbor <ref type="bibr">(Axelrod, 1997;</ref><ref type="bibr">Deffuant et al., 2000;</ref><ref type="bibr">Hegselmann &amp; Krause, 2002;</ref><ref type="bibr">van der Maas et al., 2020)</ref>.</p><p>Several models go beyond this threshold dynamics of influence weights and include other psychosocial mechanisms that can produce similar patterns. For example, in <ref type="bibr">Nowak et al.'s (1990)</ref> dynamic version of <ref type="bibr">Latan&#233;'s (1981)</ref> theory of social impact, group polarization is explained through an interplay of two individual parameters: persuasiveness-the likelihood that one will influence those who have a different point of view, and supportiveness-the likelihood that one will help those with the same point of view to resist change. In <ref type="bibr">Leonard et al. (2021;</ref><ref type="bibr"/> see also <ref type="bibr">Franci et al., 2021)</ref>, it is explained through a dynamic interaction of group-level selfreinforcement and reflective partisanship, which determine the extent of within-and between-group influences. Finally, some models explain polarization through the process of balancing the relationships between beliefs and between individuals holding different beliefs <ref type="bibr">(Pham et al., 2020;</ref><ref type="bibr">2022;</ref><ref type="bibr">Rodriguez et al., 2016;</ref><ref type="bibr">Schweighofer et al., 2020</ref>; see the Discussion section).</p><p>In the NB theory, we aim to explain consensus and polarization that occur in structured networks where people are already grouped in clusters due to reasons other than their beliefs, for example, geography, workplaces, and family groups. These structures are ubiquitous in most human collectives. We ask, if such a clustered society starts with equally distributed, largely moderate beliefs, in what circumstances does it become polarized? We posit that consensus and polarization can emerge simply because of different levels of attention people pay to their personal, social, and external dissonances. For example, people's attention to these dissonances can change after prominent events (e.g., surprising elections or court rulings about issues such as abortion and gay marriage). As we show next, when people pay a lot of attention to their personal dissonance (how their own beliefs align to each other), the society remains rather diverse (heterophilous). However, when they pay more attention to their social and external dissonances (how their social beliefs align with their other beliefs and others' beliefs), either complete (radical) consensus or polarization can occur.</p><p>To investigate this, we run a simulation with 100 individuals, who each have an internal fully connected network (&#969; = 1) of 10 personal belief nodes, initialized at random belief states. One of these internal nodes functions as the focal belief in this simulation. This belief is connected, via social beliefs, to focal beliefs of other individuals (see Figure <ref type="figure">1</ref>). We generate a social network using stochastic block model with two clusters of 50 individuals. We set the probability that any individual is connected to another individual in the same cluster to .4 for both clusters, and the probability that an individual is connected to an individual from the other cluster to .01. We set each type of attention to dissonance (&#946; pers , &#946; soc , and &#946; ext ) to either 0.5 (low attention) or 2 (high attention). For each of the resulting eight combination of attention parameters, we simulated 100 runs. In each simulation run, nodes were first randomly initialized and NETWORKS OF BELIEFS THEORY then each updated over 100 iterations. In this section, we summarize the results in Figure <ref type="figure">5</ref> (detailed results can be found in Appendix H).</p><p>Figure <ref type="figure">5</ref> summarizes how NB theory can explain patterns of both consensus and polarization due to attention to personal, social, and external dissonance. Moderate consensus-clustered around a neutral opinion-is likely to occur when individuals do not pay too much attention to personal and social dissonances. On the other hand, either extreme consensus or extreme polarization can occur when individuals do not pay too much attention to personal dissonance and attend strongly to their social and external dissonances. Finally, if individuals pay a lot of attention to personal dissonance, individuals tend to hold extreme beliefs that are independent of the social network, resulting in extreme heterophily (or polarization within groups).</p><p>These simulations also point to ways in which radical polarization might be reduced. One is reducing attention to social dissonance, or more generally the need to align personal beliefs with the perceived beliefs of our social contacts. As shown, for example, in Panels (f) and (g) of Figure <ref type="figure">H1</ref>, reducing &#946; soc from 2 to 0.5 leads to occurrence of moderate or extreme heterophily instead of radical consensus/ polarization. Note that reducing &#946; soc while keeping &#946; ext high (attention to accuracy of social beliefs) will generally lead to accurate social beliefs. Taken together, our results suggest that promoting originality and nonconformism could be sufficient to reduce unfavorable societal outcomes such as complete polarization or (seemingly less damaging but potentially dangerous in the long run) radical consensus.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Group Radicalization</head><p>Group radicalization refers to the phenomenon that group discussion can lead to a more extreme average group opinion than it was before the discussion. For instance, in <ref type="bibr">Sunstein et al. (2007)</ref>, liberal groups that discussed issues such as affirmative action or civil unions adopted more extreme beliefs about those issues than they started with, although such radicalization does not always occur <ref type="bibr">(Isenberg, 1986)</ref>. A variety of accounts have been proposed to explain this phenomenon. Some involve motivational processes such as a desire to be "better" than the group average <ref type="bibr">(Isenberg, 1986)</ref> and to be distinct from an outgroup <ref type="bibr">(Turner, 1985)</ref>. Other accounts postulate sampling processes that lead to higher likelihood of sharing arguments that are in line with majority the view <ref type="bibr">(Burnstein &amp; Vinokur, 1973</ref>). Yet, other accounts propose that the core mechanism is realignment of internal belief networks, so that beliefs about an issue align with one's preexisting and more stable internal preferences or core values such as political or religious orientation. Group discussion, or even just thinking about an issue <ref type="bibr">(Dalege et al., 2018;</ref><ref type="bibr">Monroe &amp; Read, 2008)</ref>, can make people more aware of the alignment (or lack of thereof) of their belief about a particular issue and their core values. The threshold models described in the previous section, and their extensions, can also produce group radicalization. For example, one mechanism is repulsive social influence. Here, influence weights can be negative or positive depending on the difference in beliefs between individuals <ref type="bibr">(Flache &amp; Macy, 2011;</ref><ref type="bibr">Huet &amp; Deffuant, 2010)</ref>. This leads these models to naturally settle in bipolar belief states <ref type="bibr">(Flache &amp; Macy, 2011;</ref><ref type="bibr">Huet &amp; Deffuant, 2010;</ref><ref type="bibr">Jager &amp; Amblard, 2005)</ref>.</p><p>The NB theory predicts group radicalization through a novel process where attention to different dissonances produces the phenomenon. To show this, we simulate a group of 10 individuals who are all equally strongly connected to each other (all &#945; = 1). All these individuals have an internal network of 10 beliefs. Each of these networks is fully connected (all &#969; = 1). Each simulation run Note. From the initial state of moderate heterophily of focal personal beliefs in the two communities (Panel A), beliefs can change depending on the attention people pay to their personal, social, and external dissonances (Panel B). If they do not pay attention to any of these dissonances, the model predicts no or little change. If they pay attention to both their social and external dissonance, the model predicts either radically different beliefs in the two communities, or complete consensus across communities-depending on small differences in initial conditions (yellow shadings). In all other conditions, the model predicts that beliefs will become more extreme within groups (extreme heterophily; green shadings). Detailed results are shown in Appendix H. See the online article for the color version of this figure.</p><p>consisted of two phases of 100 iterations each, with the first phase modeling the period before the group discussion and the second phase the period after the group discussion. In the first phase, both social dissonance &#946; soc and external dissonance &#946; ext were set to 0, representing that individuals are not communicating with each other yet. In the second phase, both &#946; soc and &#946; ext were set to either 0.5 or 2, representing less and more engaged group discussion. In addition, attention to personal dissonance &#946; pers was also set to either 0.5 or 2, representing less or more pressure to align one's personal beliefs with each other. Belief states at the beginning of each simulation were initialized at random. A summary of the results of these simulations is shown in Figure <ref type="figure">6</ref>. Detailed results can be found in Appendix I.</p><p>Figure <ref type="figure">6</ref> shows that when people pay a lot of attention to how well their personal beliefs align with their social beliefs, group radicalization is likely to occur. This is even more likely when people also pay attention to how their social beliefs align with the actual beliefs of others. More intense group discussions and in particular those that focus on (dis)agreement between individuals might raise the attention to both of these sources of dissonance (social and external), making group radicalization more likely. In contrast, paying attention to personal dissonance can reduce group radicalization. These results also suggest ways to reduce group radicalization: by reducing attention to social dissonance, for example, by encouraging nonconformity and originality during group discussions, and by increasing attention to personal dissonance, for example, by reminding people of their core values that might be in contrast with beliefs of others.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Minority Influence</head><p>Minority influence refers to the process by which a small group of individuals with dissenting beliefs and behaviors can gradually influence and change the beliefs and behaviors of the majority <ref type="bibr">(Moscovici et al., 1969;</ref><ref type="bibr"/> for reviews, see, e.g., <ref type="bibr">Martin &amp; Hewstone, 2009)</ref>. A plethora of factors can affect how successful a minority is in influencing a majority <ref type="bibr">(Crano, 2010;</ref><ref type="bibr">David &amp; Turner, 2001;</ref><ref type="bibr">Quiamzade et al., 2010;</ref><ref type="bibr">C. M. Smith &amp; Tindale, 2010)</ref>. Minorities can directly influence focal beliefs of the majority or indirectly influence related beliefs even when focal beliefs of the majority remain unchanged.</p><p>Here, we focus on modeling the conditions for direct minority influence. We ran a simulation with 30 individuals embedded in a network with two clusters generated by a stochastic block model. The majority cluster consisted of 20 individuals whose belief states were initialized randomly in the range from -1 to 0. The minority cluster consisted of 10 individuals whose belief states were initialized randomly in the range from 0 to 1. The probability that any individual in the majority cluster was connected to any other individual in the majority cluster was set to .33, while the probability that any individual in the minority cluster was connected to any other individual in the minority cluster was set to .67. These settings resulted in an average degree of 6 within both clusters taking into account only the connections within each cluster. The probability of a link between the minority and majority clusters was set to .1. We also investigated stochastic block model networks with more sparsely connected clusters, as well as random networks, but the patterns of results were similar.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Figure 6</head><p>Conditions for Group Radicalization Before and After Group Discussion About Personal Beliefs Note. In network representations, circles represent individuals with their personal and social beliefs (equivalent to the large circles in Figure <ref type="figure">1</ref>), and edges represent the directed influence of individuals' actual beliefs to the social beliefs of their contacts (each equivalent to the two edges connecting the individual circles in Figure <ref type="figure">1</ref>). Blue nodes indicate negative beliefs and red nodes indicate positive beliefs, with higher color saturation corresponding to higher extremity of beliefs. We track four types of networks that occur at the end of simulations assuming different combinations of attention parameters, starting from a network where people have moderate beliefs and there is no group radicalization (Panel A). After group discussion (Panel B), the model predicts that when people pay attention to their social dissonance, moderate or extreme radicalization will occur, depending on the level of attention to personal and external dissonances. If people do not pay attention to their social dissonance, beliefs can become more extreme but there will be no whole group radicalization (detailed results are shown in Appendix I). See the online article for the color version of this figure.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>NETWORKS OF BELIEFS THEORY</head><p>We varied the attention parameters independently for the majority and minority clusters. For ease of interpretation, we varied the attention to social and external dissonances together, setting both &#946; soc and &#946; ext to either 0.5 or 2. The attention to personal dissonance &#946; pers was set independently to either 0.5 or 2. For each combination of attention parameters, in both majority and minority clusters, we simulated 100 runs. Belief states at the beginning of each simulation were initialized at random. A summary of the simulations is shown in Figure <ref type="figure">7</ref> (detailed results can be found in Appendix J).</p><p>Taken together, as the summary of the simulations in Figure <ref type="figure">7</ref> suggest, the minority will have the most influence on the rest of the network if they strive to keep their personal beliefs consistent, and if the majority is distracted and does not pay attention to their personal, social, or external dissonance. These predictions fit well with empirical findings showing that minorities must hold consistent beliefs to influence majorities <ref type="bibr">(Moscovici et al., 1969;</ref><ref type="bibr">Wood et al., 1994)</ref>. At the same time, the majority will have the most influence on the minority if they pay attention to those different sources of dissonance and strive for consistency of beliefs, independently of what the minority does.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Comparing Model Predictions With Real-World Trends</head><p>In this section, we discuss whether the NB theory can reproduce belief dynamics found in real-world data. We first model increasing polarization in the United States over time and then turn to crosssectional distributions of beliefs in different European countries.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Empirical Trends in Group Polarization</head><p>A trend observed in many real-world settings is, as mentioned before, an increased polarization of societies into groups holding extreme and opposing beliefs. For example, as Figure <ref type="figure">8</ref> shows, evaluations of Democrat and Republican political candidates, as recorded in American National Election Studies, have become more and more extreme over the last several decades. Notably, interest in political campaigns has also increased in the same period.</p><p>The NB theory explains group polarization and related phenomena through the interplay of attentions to personal, social, and internal dissonances (see the Consensus and Polarization section). However, these patterns and their trends over time can also be explained by increased attention to all dissonances together with lower connectivity. In particular, when people pay a lot of attention to the consistency of their personal and social beliefs, as well as to correspondence of others' perceived and actual beliefs, either radical consensus or polarization can occur, depending on small biases in initial conditions. If the two groups are even a little bit biased toward opposing positions to begin with, an increased attention to these dissonances will likely lead to radical polarization.</p><p>It is reasonable to assume that the increased interest in political campaigns relates to increased attention to political beliefs of others one knows and to the dissonance between own and others' perceived and actual beliefs. According to the NB theory, this would then naturally lead to increased radicalization of political beliefs within initially moderate groups of Democrats and Republicans, and consequently to group polarization. Note. Starting from an initial state where minority and majority have substantially different beliefs (Panel A), minority can prevail only if the majority group does not pay attention to any of their potential dissonances (Panel B; averaged over all levels of attention for the minority group). If the minority group pays attention to their personal dissonance, they can avoid majority influence at the cost of strong polarization between the two groups. For all other combinations of attention parameters, majority will influence the minority group. Detailed results are shown in Appendix J. See the online article for the color version of this figure. Note.</p><p>Trends in answers to questions about political interest (top row, question "Would you say that you have been [not much interested-somewhat interested-very much interested] in the political campaigns so far this year?") and evaluations of Democrat and Republican political candidates that year ("How would you rate candidate [on the feeling thermometer]?"). Data and full text of questions are available at <ref type="url">https://electionstudies.org</ref>. FT = feeling thermometer.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>NETWORKS OF BELIEFS THEORY</head><p>To investigate this prediction in more detail, we ran a simulation where we varied network structure (from two initially disconnected clusters to two strongly interrelated clusters, top to bottom rows of Figure <ref type="figure">9</ref>) and increased all attention parameters gradually over time (from &#946; pers = &#946; soc = &#946; ext = 0.25 to 1.5 over five time steps). Each network included 30 people, with 15 people in each cluster. The clusters differed in their exogenous influence; the first cluster had negative exogenous influence, &#964; = -.5, and the second cluster had positive exogenous influence, &#964; = .5. These differing exogenous influences could, for example, represent one cluster consisting of people living in a rural area, making them more predisposed to identify as conservatives, and the other cluster consisting of people living in an urban area, making them more predisposed to identify as liberals. Within-cluster probability of connection was .35, and between-cluster probability was either 0, .01, .1, or .35. Initial beliefs in each cluster were set randomly. We ran 100 runs with eight iterations in each run.</p><p>Figure <ref type="figure">9</ref> shows the results for each time step, suggesting that group polarization can occur from random initial beliefs purely because of the increase in people's attention to dissonance. This is likely to happen whenever there are sparse or no connections between the two clusters (the first two rows in Figure <ref type="figure">9</ref>). When the two clusters are moderately related (connectivity 0.1, third row in Figure <ref type="figure">9</ref>), both polarization or consensus are about equally likely. Finally, when the two clusters are tightly related, consensus will occur in the direction of whatever the initial bias was.</p><p>Importantly, as shown in Figure <ref type="figure">5</ref>, extreme differences in beliefs (extreme heterophily) can occur even in tightly connected communities, in particular when people pay a lot of attention to their personal dissonances rather than external and social dissonances. Thus, the NB theory provides explanations for both polarization between groups (Figure <ref type="figure">9</ref>) and within groups (extreme heterophily in Figure <ref type="figure">5</ref>).</p><p>These results have implications for interventions that could be used to reduce the likelihood of group polarization. Paradoxically, reducing people's attention to political campaigns would help, but so would an increased level of intergroup contact between different groups. Note that such an increased contact could lead to adoption of whatever option was in slight majority initially. Note, however, that the effects of intergroup contact are multifaceted and that the nature of the contact, the specifics of group characteristics, and the beliefs in question most certainly also determine to what extent polarization or consensus will be achieved, or if the behavior of the individuals and groups will change. For example, surface-level contact as Anglo-Whites interacting with Spanish-speaking confederates on rail platforms can increase exclusionary beliefs <ref type="bibr">(Enos, 2014)</ref>, tolerant behaviors against other groups of people might not generalize beyond the specifics of the intervention (e.g., <ref type="bibr">Mousa, 2020)</ref>, and exposure to opposing views can increase political polarization <ref type="bibr">(Bail et al., 2018)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Cross-Sectional Distribution of Beliefs</head><p>We now look at how well the NB theory can explain specific distribution of beliefs observed at a single time point in different countries. Figure <ref type="figure">10</ref> shows data from four countries about respondents' own political placement and opinion about the European Union. <ref type="bibr">Flache et al. (2017)</ref> argued that these data showed evidence of several belief dynamic processes. The central peak suggests assimilation to the central or moderate belief in the population, the nonextreme clusters just next to the center suggest similarity bias, and the (small) extreme peaks might suggest polarization produced by a mix of unconditional and repulsive processes.</p><p>The NB theory can reproduce this general pattern conditional on two empirically testable assumptions. First, most individuals pay little attention to the consistency of their personal beliefs about these topics, meaning that their attention parameters &#946; pers is low. Second, political placement represents an average of several more specific beliefs. To show that these assumptions can reproduce the empirically observed distributions, we ran a simulation with 2,000 individuals (this number was chosen in order to have a similar sample size as in the empirical data) who each have a fully connected network consisting of 50 belief nodes, representing the many specific beliefs that give rise to the answer on the political placement and the European Union questions. In this simulation, we focus only on dissonance arising from internal beliefs and omit the external network by setting the attention parameters for both social and external dissonances to 0. We draw the values of the attention toward personal dissonances from exponential distributions with rates of either 2 (representing an exponential distribution with many extreme values), 5 (representing an exponential distribution with moderately many extreme values), or 10 (representing an exponential distribution with few extreme values). These distributions represent populations in which most individuals have low levels of attention to the consistency of their beliefs, with more or fewer individuals paying some attention. Exponential distribution is appropriate for such cases with a cutoff at 0 and a high upper bound.</p><p>As shown in Figure <ref type="figure">11</ref>, our simulations can reproduce some of the main patterns in the empirical answer distributions, depending on the attention distribution in the population (insets in Figure <ref type="figure">11</ref>). The assumption that most people are not paying much attention to the consistency of their beliefs (the middle and right panels in Figure <ref type="figure">11</ref>) produces predicted answer distributions that are closest to the empirical data. Attention distributions alone cannot explain biases toward one or the other end of the answer distributions noticeable in Figure <ref type="figure">10</ref>. Those biases could be explained by assuming exogenous influences on people's beliefs, such as political leaders and specific country-level events. Although NB theory can reproduce these patterns in the answer distributions, it is important to note that assumptions of the amount of attention to the consistency of personal beliefs about these topics and that the political placement represents an average of several more specific beliefs need empirical validation.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Discussion</head><p>In this article, we develop an integrative theory of belief dynamics, the NB theory. It goes beyond past theories in three ways. First, it makes a direct connection between internal beliefs and external social worlds, through people's social beliefs or perceived beliefs of others. Second, it can explain how social beliefs can become more or less accurate representations of the actual beliefs of others, and how that affects the resulting belief dynamics. Third, the theory explains diverse belief dynamics phenomena parsimoniously through the differences in attention and the resulting felt dissonances in personal, social, and external parts of belief networks.</p><p>We implement the NB theory as a computational model in a statistical physics framework in which beliefs are represented as spins, potential dissonance is represented as energy, and attention is 0 Intercluster connectivity 0.01 0.1 0.35 Polarization Radical consensus 0 20 40 60 80 100 0 0 . 0 1 0 . 1 0 . 3 5 Percentage Intercluster connection probability (A) (B) Note. Simulation of belief dynamics occurring on networks with different levels of intercluster connectivity (Panel (A), top to bottom row: from no to high connectivity). At each time step, attention to dissonance increases, resulting in different end patterns of beliefs. When intercluster connectivity is zero or low, the dynamics always leads to radical polarization (the first two bars in Panel (B)). When it is medium (0.1), the dynamics ends up in radical consensus half of the time, and in radical polarization the other half, depending on small differences in initial belief distribution in the two clusters (the third bar in Panel (B)). When the connectivity is high (0.35), the end result is always radical consensus (the fourth bar in Panel (B)). See the online article for the color version of this figure.  Note. Empirical distributions of answers to questions about political position (top row, question "in politics people sometimes talk of 'left' and 'right.' Where would you place yourself on this scale?") and the European Union (bottom row, question "Now thinking about the European Union, some say European unification should go further. Others say it has already gone too far. What best describes your position?") in four European countries, from the 2012 European Social Survey (adapted from Figure 3 in Flache et al., 2017). Note. Insets show hypothesized distributions of attention parameters.</p><p>Finally, we show that the computational implementation of NB theory can account for established belief dynamics phenomena including consensus and polarization, group radicalization, and minority influence, providing new parsimonious explanations for these diverse phenomena. We also show that the model can reproduce real-world trends in group polarization over time and in cross-sectional distribution of beliefs.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Relationship to Other Models</head><p>How does our model compare to the numerous previous accounts? Models of belief dynamics can be compared on many different dimensions. The sheer number of models that have been proposed in the literature, and the lack of tests against empirical data, makes it difficult to compare the predictive accuracy and the empirical validity of the models' assumptions. Many of these models can in principle account for a wide range of phenomena, but what mechanisms are necessary and/or sufficient to explain these phenomena are unknown. The scope of such an investigation of belief dynamics models is beyond the scope of this article, therefore focus on structural and process features of models: (1) Does the model represent one or more personal beliefs; (2) if it has more than one belief represented, does it represent them as independent beliefs, in a network, or does it assume a summary representation; (3) does the model include social influence, and if so, does it include social influence from only one agent at the time or the whole network; ( <ref type="formula">4</ref>  <ref type="formula">8</ref>) to what extent does the model been tested on empirical data. In this section, we will focus on comparing our model with models that are most similar to ours according to these features.</p><p>Our model represents several personal beliefs in a network (Features 1 and 2 above) together with a subjective representation of others' beliefs (Feature 4) and an external factual belief network that can influence the subjective representation of others' beliefs (Feature 3). The updating mechanism for nodes follows the minimization of the weighted sum of the personal, social, and external energies (Feature 5), which in turn relies on the weighted average of all beliefs (personal beliefs have unique weights between beliefs, while social and external beliefs rely on one weighting parameter each, Feature 7). The edge weights in our model can be derived by the relations in empirical data (6; i.e., partial correlations). In terms of tests on empirical data, we provide several tests of core assumptions (Feature 8, see Appendices B and C). Given this feature list, this means that many prominent belief dynamic models will be left out in this comparison. These include models that only represent one belief or vectors of noninteractive beliefs (Features 1 and 2), such as <ref type="bibr">French's (1956)</ref> formal model of social power, <ref type="bibr">Harary's (1959)</ref> generalization of <ref type="bibr">French's model, and DeGroot's (1974)</ref> consensus formation model and others that followed in this and other traditions such as the bounded confidence models <ref type="bibr">(Deffuant et al., 2000;</ref><ref type="bibr">Hegselmann &amp; Krause, 2002;</ref><ref type="bibr">Weisbuch et al., 2002)</ref>, vector models based on attraction or assimilation and rejection or repulsion mechanisms <ref type="bibr">(Flache &amp; Macy, 2011;</ref><ref type="bibr">Huet &amp; Deffuant, 2010;</ref><ref type="bibr">Jager &amp; Amblard, 2005)</ref>, social influence network theory (e.g., <ref type="bibr">Friedkin &amp; Johnsen, 1990</ref><ref type="bibr">, 2011)</ref>, computational implementations of social impact theory <ref type="bibr">(Nowak et al., 1990)</ref>, models of the dissemination of culture <ref type="bibr">(Axelrod, 1997)</ref>, vector models that combine demographic and belief representations <ref type="bibr">(Flache &amp; M&#228;s, 2008)</ref>, and several models inspired by statistical physics (e.g., <ref type="bibr">Galesic &amp; Stein, 2019;</ref><ref type="bibr">Pham et al., 2022;</ref><ref type="bibr"/> for reviews of models inspired by statistical physics, see <ref type="bibr">Castellano et al., 2009</ref>, and for a general overview of social influence models, see <ref type="bibr">Flache et al., 2017)</ref>.</p><p>There are models that represent beliefs as networks (Feature 2 above), but only include social influence implicitly (Feature 3). For example, in the AE framework <ref type="bibr">(Dalege et al., 2016</ref><ref type="bibr">(Dalege et al., , 2018))</ref>, which we use as the basis for the representation of the internal belief network in our model, exogenous or social influence can only be represented with the external field parameter (&#964; in Equation 3 above). A similar model with only nonspecific exogenous influences is <ref type="bibr">Brandt and Sleegers (2021)</ref>. An influential class of models that also represent beliefs as networks is constraint satisfaction models. <ref type="bibr">Shultz and Lepper (1996)</ref> formulated a constraint satisfaction model that aims at reducing dissonance in a network of cognitions. In this model, there is no explicit representation of social influence, but the general formulation of this and other constraint satisfaction models allows for nodes that represent various external or social influences as they are represented in the network. A more elaborate neural network model of constraint satisfaction is <ref type="bibr">Monroe and Read's (2008)</ref> attitudes as constraint satisfaction model. Their model has separate banks of nodes for cognitive representations and for persuasive communications, and they investigate the impact of external messages represented on the persuasion units. There are also other neural network models that are not based on constraint satisfaction. For example, Van Overwalle and Siebler's (2005) model is based on an autoassociative recurrent network that focuses on assimilating new information instead of the settling of the network in a steady state.</p><p>There are not many models that both have a network representation of internal beliefs and a representation of an external network (Features 2 and 3). A model that explicitly represents belief networks and social networks is <ref type="bibr">Goldberg and Stein's (2018)</ref> associative diffusion model. The aim of this model is to explain cultural differentiation without the need for segregated networks. It is also based on the perception of behaviors of others (Feature 4), but in contrast to NB theory, it does not include the effect of actual beliefs on the perception of actual belief. In G&amp;S, observing others behavior directly influences their own beliefs, while in our model that updates the social beliefs that might update the personal beliefs. The belief updating mechanism (Feature 5) is similar to that of NB theory in that it is based on a constraint satisfaction mechanism. In contrast to NB theory, the edge weights (Feature 6) in the associative diffusion model are determined by a reinforcement scheme with decay. The assumptions and predictions of the associative diffusion model have not been tested against data (Feature 6).</p><p>A model that shares the same basic assumption about the internal network is the HIOM (van der <ref type="bibr">Maas et al., 2020)</ref>, only without the social beliefs. In the HIOM, the internal network of personal beliefs is described by a mean-field approach resulting in modeling these networks as cusp catastrophes: Strongly involved individuals have resistant beliefs but change them drastically if they do change, and weakly involved individuals have less resistant beliefs and change them in a more gradual manner. These dynamics are also implied by the NB theory as it is an extension of the AE framework (for an illustration of these dynamics implied by the AE framework, see <ref type="bibr">Dalege et al., 2022)</ref>. The HIOM additionally assumes that involvement increases when individuals interact. A crucial difference NETWORKS OF BELIEFS THEORY between the HIOM and the NB theory lies in the representation of social beliefs-the HIOM does not differentiate between actual beliefs and perceived beliefs of others (Feature 4). The HIOM therefore cannot explain that individuals differ in how much importance they attach to their personal versus social beliefs. This difference also leads to a different coupling between individuals in the HIOM than our NB theory. While the HIOM assumes that averages of more specific beliefs are communicated between individuals, the NB theory assumes that beliefs are coupled between individuals through perceived beliefs. Additionally, the HIOM treats beliefs as binary while the NB theory treats beliefs as continuous. A potentially fruitful avenue for future research would be to integrate the dynamics of increasing attention due to their interaction into the NB theory.</p><p>Another model that shares features with ours is the social cognitive-social belief model <ref type="bibr">Rodriguez et al. (2016)</ref>. The aim of this model is to integrate insights from network models of social influence and models that represent personal beliefs as networks (Features 2 and 3 above), and as such, this is very much in line with the aims of our model. Another similarity to our model is the reliance on a statistical physics formalism in the sense that the model relies on minimizing an energy function that combines energies in the internal network with weights attached to each of the personal and social components in the energy function. The main difference between our model and the <ref type="bibr">Rodriguez et al. model</ref>  Another model that integrates insights from network models of social influence and models that represent personal beliefs as networks (Features 2 and 3) is the one presented in <ref type="bibr">Ellinas et al. (2017)</ref>. In contrast to our model, Ellinas et al.'s model is not based on the statistical physics notion of minimizing energy and is focused on the probability of accepting associations from neighboring individuals (Feature 7). The probability that an individual accepts an incoming association from a randomly selected other individual is a function of both the portion of the individual's neighbors that agree with that belief and the social rank difference between the receiver and its neighbors, with different weights allowed for each of these components. In Ellinas et al.'s model, the belief networks and the social rank of individuals are estimated from survey data. In contrast to our model, this model has a mechanism to change the value of edges between personal beliefs by accepting proposed link values by other neighboring individuals (Feature 6). However, the node values are static and do not change (Feature 5). Ellinas et al. conducted theoretical explorations of different parameter values, but there are no empirical tests of assumptions or predictions (Feature 8).</p><p>In contrast to <ref type="bibr">Ellinas et al.'s (2017)</ref> model that does not have a mechanism for updating of beliefs, the weighted network balance model described in <ref type="bibr">Schweighofer et al. (2020)</ref> also has a mechanism for updating node values (Feature 5 above). The model is a computational extension of the ideas in <ref type="bibr">Heider's (1946)</ref> balance theory and <ref type="bibr">Cartwright and Harary's (1956)</ref> structural balance theory and is particularly aimed at explaining hyperpolarization, which <ref type="bibr">Schweighofer et al. (2020)</ref> defines as the simultaneous occurrence of belief extremeness and issue constraint for multidimensional beliefs.</p><p>In contrast to our model, where we distinguish between internal and external belief networks, the weighted network balance model considers relations between two Individuals A and B and a policy issue, D. The model is a combination of network representations and vector representations (Features 1 and 2). The beliefs of any individual are represented with a vector that is all beliefs of an individual toward the policy issue. These interpersonal beliefs in the model do not need to reflect reality but might be purely subjective (Feature 4). These vector representations of beliefs are then combined with signed geometrical means. These are then used to determine edge weights between the individuals the policy issue under consideration (Feature 6). Beliefs are updated by moving them closer to a perfectly balanced opinion vector. In <ref type="bibr">Schweighofer et al. (2020)</ref>, the weighted network balance model is tested with data from American National Election Study (Feature 8).</p><p>In sum, our comparison of NB theory and other models suggests three main contributions of the NB theory. It includes both internal beliefs and external social worlds, connected through people's social beliefs or perceived beliefs of others. It explains how these social beliefs can differ from the actual beliefs of others, which is often disregarded in models of belief dynamics. Third, while many of these models implement belief change processes through some form of dissonance, incoherence, or imbalance reduction in internal belief networks or in the relation between beliefs in social networks, they do not explicitly differentiate dissonances due to the consistency of personal and social beliefs and the correspondence of social and actual others' beliefs.</p><p>We also make a contribution by providing extensive empirical tests of the core assumptions of our theory as well as of specific empirical predictions. This is very rare, with most models being presented on the conceptual level without empirical tests <ref type="bibr">(Castellano et al., 2009;</ref><ref type="bibr">Redner, 2019)</ref>. Going forward, given the plethora of models that can account for phenomena such as consensus, polarization, and radicalization, an estimate of model mimicry <ref type="bibr">(Wagenmakers et al., 2004)</ref> in the area of belief dynamic models would be very helpful to tease out what representations and mechanisms are really needed to explain pertinent phenomena.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Limitations and Possible Extensions</head><p>The statistical physics framework that we used here is just one the many analogies that have been used to explore and understand human belief dynamics. Many other analogies have been used for this purpose, including epidemiological models, where transmission of belief is like a transmission of disease <ref type="bibr">(Newman, 2003)</ref>; percolation, where beliefs seep through a society like liquid through a substance <ref type="bibr">(Duffie et al., 2010)</ref>; balance, where beliefs and individuals align in a way that leads to most consistent relationships on the level of pairs and triads <ref type="bibr">(Heider, 1958;</ref><ref type="bibr">Pham et al., 2020)</ref>; expected utility, where beliefs change to maximize the product of value and likelihood of different cognitions <ref type="bibr">(Ajzen, 1991;</ref><ref type="bibr">Fishbein &amp; Ajzen, 1975)</ref>; evolution, where beliefs evolve in the process of cultural learning <ref type="bibr">(Richerson &amp; Boyd, 2008)</ref>; Bayesian networks, where networks of beliefs change in line with their conditional dependencies <ref type="bibr">(Cook &amp; Lewandowsky, 2016)</ref>; forces, where belief change under combined influence of several distinct social forces <ref type="bibr">(Latan&#233;, 1981)</ref>; and networks, where systems of beliefs are conceptualized as networks that aim to minimize the overall energy <ref type="bibr">(Dalege et al., 2016)</ref>.</p><p>While analogies can be very useful to cope with novelty and uncertainty in science and life in general <ref type="bibr">(Dunbar, 1997;</ref><ref type="bibr">Holyoak &amp; Thagard, 1996)</ref>, it is important to keep in mind that they were "borrowed" from another domain that does not necessarily correspond to all of the intricacies of the domain we wish to explain <ref type="bibr">(Gigerenzer, 1991;</ref><ref type="bibr">Olson et al., 2019)</ref>, in this case belief dynamics. We need to recognize the unnecessary "baggage" of worldview, assumptions, and methodologies that are transferred to the domain of belief dynamics along with the analogy.</p><p>In the case of statistical physics analogy, such potential baggage includes its assumptions that beliefs are like spins and that there is no strategic behavior, no individual differences, no emotions, and no institutions. Another important baggage is the assumption that people always want to minimize dissonance among their beliefs, while it is clearly possible that people sometimes can consciously maintain some dissonance between their beliefs. For example, scientists are trained to forego changing their beliefs about scientific issue just because they do not fit with their moral values.</p><p>More specifically, in the NB theory, we assume that the main mechanism for belief change is dissonance reduction, and we implement it within a statistical physics framework that assumes that people find belief states that minimize energy. We want to make clear that we do not believe that all belief change is caused by an optimization process of one criterion. For a full understanding of belief dynamics, a comprehensive theory of belief dynamics should include mechanisms that go beyond the goal of dissonance or energy reduction, although several mechanisms of belief change can be incorporated in a framework that is assumed to minimize energy. For example, another form of consistency criterion that has been applied to several belief dynamic models is triangle balance (e.g., <ref type="bibr">Pham et al., 2022;</ref><ref type="bibr">Rodriguez et al., 2016;</ref><ref type="bibr">Schweighofer et al., 2020)</ref>. That is, a triangle of nodes is balanced if it includes zero or two negative links; otherwise, it is unbalanced. This form of consistency mechanism could be incorporated as a separate term in the energy function (see, e.g., <ref type="bibr">Pham et al., 2022)</ref>. Going beyond dissonance, balance, and minimization of energy, other mechanisms have been proposed as fundamental for belief change. For example, information integration in the form of summation and averaging can produce belief change <ref type="bibr">(Anderson, 1971)</ref>. For social and external beliefs, in this view, people are not trying to minimize dissonance or achieve balance, but might just be influenced by people around them without ever considering dissonance or balance.</p><p>Another limitation of our statistical physics implementation of NB theory is that it assumes primacy to edge weights in the sense that these influence node values but nodes do not influence edge weights. There is no mechanism in the model that can differentially change the edge weight between two nodes. The only mechanism that can change the values of all edge weight is the attention parameter &#946;. That is, increasing or decreasing the value of &#946; has the same effect as increasing or decreasing all edge weights. Possible extensions could include edge weight updating mechanisms from neural network models of belief dynamics (e.g., <ref type="bibr">Monroe &amp; Read, 2008)</ref>.</p><p>Finally, in the current formulation, NB theory and its implementation is only concerned with beliefs and their dynamics and not the relation between beliefs, preferences, and behavior The beliefs are not at present connected to a preference to choose a specific option or act in certain way. In addition, we have not modeled the strategic considerations related to beliefs. For example, people might choose to signal some beliefs, but not others, and some beliefs might be signaled covertly (van Der Does, <ref type="bibr">Galesic, et al., 2022)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Conclusion</head><p>NB theory connects internal and external belief networks. Unlike many other models of belief dynamics, it does not assume that people perceive others' beliefs accurately, but allows that these perceptions can be shaped by both personal beliefs and others' actual beliefs. The theory can explain different phenomena in belief dynamics largely by one basic mechanism-attending to different parts of belief networks. We find empirical support for the different assumptions and predictions of the theory in two large studies. Some of the confirmed predictions reproduce previous findings, and others are unique to the NB theory, for example, that paying attention to the dissonance between personal and social beliefs decreases the variance of social beliefs and increases their consistency with personal beliefs, and that group radicalization is more likely when people pay attention to the accuracy of their social beliefs. The theory also offers a parsimonious explanation for group consensus, polarization, radicalization, and minority influence and reproduces empirically observed patterns of beliefs in different studies. We hope that in addition to providing answers to crucial questions on the dynamics of beliefs, the NB theory will inspire further work on the integration of different research areas on belief dynamics and addressing some of the most pressing issues we currently face as a society. two-factor model fits the data better than a one-factor model (we allowed for correlated errors between the negatively worded items in both these models). The one-factor model showed poor fit to the data, RMSEA = .29, CFI = .73, and also showed worse fit than the two-factor model, Akaike information criterion (AIC) = 21,980.53 versus AIC = 21,368.35 for the two-factor model, Bayesian information criterion (BIC) = 22,043.98 versus BIC = 21,436.68 for the two-factor model. The results thus indicate that personal and social felt dissonances form two separate factors, which are moderately related. Both these findings are in line with the assumptions of our theory.</p><p>We then proceeded to test whether personal and social felt dissonances relate to personal and social potential dissonances. We expected that personal felt dissonances predict personal energies and that they do so better than social dissonances. Conversely, we expected that social dissonances predict social energies and that they do so better than personal dissonances. To calculate potential personal and social dissonance, we first estimated edges between personal beliefs (&#969; ij ) and between personal and social beliefs (&#961; ik ), consisting of the average of one's own beliefs and the average of the social beliefs for each of five social contacts. Edges represent regularized partial correlations, which were estimated using the EBICglasso function in the R-package qgraph <ref type="bibr">(Epskamp et al., 2012;</ref><ref type="bibr">Epskamp &amp; Fried, 2018)</ref>. Using these networks, we calculated potential dissonance for each participant using Equations 3 and 4, and setting &#964; i = 0. We then added these energies to the factor model described above and regressed each of them on personal and social felt dissonances. Personal energies were significantly and moderately to strongly predicted by personal felt dissonances, &#946; = .42, p &lt; .001, but not by social felt dissonances, &#946; = .05, p = .14. Social energies were significantly and strongly predicted by social dissonances, &#946; = .55, p &lt; .001, but only weakly by personal dissonances, &#946; = .12, p &lt; .001. To summarize, we found that personal and social felt dissonances load on two separate factors, these dissonances are moderately related to each other, and they are more related to their associated potential dissonances (energies) than to the energies stemming from the other part of the internal belief network. Taken together, these results indicate that indeed felt dissonances arise from lack of consistency between beliefs, and are separate for personal and social beliefs.</p><p>To test the assumption about the relationships of potential and felt social and external dissonances, we analyze questions about Study 2 participants' personal and social beliefs about climate change, GM food, and vaccination. Here, because of time constraints in the survey, we measured only one personal belief for each topic (e.g., "What comes closer to your view on climate change? 1 = There is solid evidence that the climate is NOT changing because of human activity, 7 = There is solid evidence that the climate is changing because of human activity"). Similarly, we used just one question per topic to measure social felt dissonance (e.g., "I experience a lot of conflict between my beliefs about climate change and the beliefs of ). We measure potential social dissonance as the absolute difference between personal beliefs and perceived friend's beliefs, and external social dissonance as the absolute difference between social beliefs and actual friend's beliefs.</p><p>We use a mixed-effects regression models to investigate how social and external felt dissonance relates to social and external potential dissonances. In the model for each of the two felt dissonances, we also control for the other felt dissonance, as well as for the clustering of the three topics within participants. As expected, social potential dissonance was reliably but weakly positively related to social felt dissonance (&#946; = .07, p &lt; .001) but not to external felt dissonance (&#946; = -.01, p = .43). And, external potential dissonance was positively, although not reliably related to external felt dissonance (&#946; = .03, p = .12) and negatively and not reliably to social felt dissonance (&#946; = -.01, p = .59).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Figure E1 Steady State Distributions of Different Implementations of Energy Minimization (Distance Measures) Under Different Inverse Temperatures</head><p>Note. The simulations were run on a network of 10 belief nodes, using the settings described in the Formal Implementation section. The first row represents the implementation we use in this article, relying on multiplication. The second row represents calculating energies using signed distance <ref type="bibr">(Akerlof, 1997)</ref>. The third row represents calculating energies using absolute distance <ref type="bibr">(Akerlof, 1997)</ref>. The fourth row represents calculating energy using squared distance <ref type="bibr">(Deffuant et al., 2000)</ref>. The fifth row represents calculating energy using exponential distance (E. R. <ref type="bibr">Smith &amp; Zarate, 1992)</ref>. The sixth row represents calculating energy using cosine distance <ref type="bibr">(S&#238;rbu et al., 2013)</ref>. As can be seen, only the multiplication implementation can reproduce the increasing bimodality that we see in empirical data (see Figure <ref type="figure">2</ref>).</p><p>(Appendices continue)</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>NETWORKS OF BELIEFS THEORY</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Appendix H Consensus and Polarization</head><p>We use both qualitative and quantitative measures to understand how different levels of attention to dissonance affect the likelihood of consensus and polarization. On the qualitative level, we visualize the networks representative of those occurring at the end of simulation runs in different conditions. Panels (a)-(e) of Figure <ref type="figure">H1</ref> show five types of networks that we observe in our simulations, showing radical polarization (RP) where the two social network clusters end up having completely opposing beliefs, radical consensus (RC) where the two clusters end up having the same beliefs, moderate polarization (MP) where individuals in the two clusters have different but moderate beliefs, moderate heterophily (MH) where the two clusters have similar distribution of mostly moderate beliefs, and extreme heterophily (EH) where the two clusters have similar distribution of mostly extreme beliefs. Abbreviations of different networks in Panels (f)-(i) of 4 show in which conditions they appear.</p><p>On the quantitative level, we use two measures of consensus and polarization. One is variance of focal beliefs at the end of simulation runs in different conditions, shown in Panels (f) and (g) of Figure <ref type="figure">H1</ref>. High values of variance show that network members hold very different opinions (as in the network EH described above) while low values of variance indicate that the opinions are not very different from each other (as in RC networks). Note that in some conditions, RP (extreme variance) and RC (no variance) networks are equally likely outcomes, producing a moderate average variance. For this reason, we also use another quantitative measure, modularity, showing how likely is that connected individuals hold similar focal beliefs (Panels (h) and (i); <ref type="bibr">Newman, 2006)</ref>. High values of modularity indicate that connected individuals hold similar beliefs (corresponding to RP, RC, and MP networks above), while low values of modularity indicate that connected individuals are not more likely to hold similar beliefs than unconnected individuals (corresponding to MH and EH networks). To calculate modularity, we binarized the focal beliefs into positive and negative.</p><p>Taken together, the patterns in Figure <ref type="figure">H1</ref> suggest four main insights. First, when attention to both personal and social dissonance is low (&#946; pers = &#946; soc = 0.5), beliefs almost always remain moderate and the final state resembles either moderate polarization (MP, where the two clusters have different, but moderate beliefs) or moderate heterophily (MH, where there is little difference between the two clusters), independently of attention to external dissonance. In other words, when individuals pay little attention to either how much their personal beliefs align to each other or how much their personal beliefs align with the perceived beliefs of their social contacts, they will likely end up holding moderate beliefs. If in addition they pay little attention whether their perceived beliefs about social contacts are accurate (&#946; ext = 0.5), there will be a range of moderate beliefs throughout the network (MH). If they do pay attention to accuracy (&#946; ext = 0.5), the result will be a moderately polarized network (MP).</p><p>Second, when attention to personal dissonance is high and attention to external dissonance is low (&#946; pers = 2 and &#946; ext = 0.5), extreme heterophily (EH) is likely to emerge almost independently of the level of attention to social dissonance (&#946; soc ). In this case, individuals try to align their personal beliefs and are not pressured to align with their actual social environments. This allows their beliefs to radicalize unrestricted by others' beliefs.</p><p>Third, when attention to social dissonance is high and attention to external dissonance is low (&#946; soc = 2 and &#946; ext = 0.5), extreme heterophily (EH) is again likely to emerge, independently of the level of attention to personal dissonance (&#946; pers ). In this case, individuals try to align their personal beliefs and perceived beliefs of their social contacts, unfettered by concerns about what their social contacts actually believe. These dynamics allows for radicalization of personal beliefs independently of actual social environments.</p><p>Fourth, when attentions to social dissonance and external dissonance are both high (&#946; soc = &#946; ext = 2), either radical polarization or radical consensus will emerge (RP or RC) with equal probability, depending on minor biases in the initial random configuration of beliefs. If both clusters randomly initialize with the same tendency in beliefs, we observe extreme consensus; if the clusters randomly initialize with different tendencies in beliefs, we observe extreme polarization. In this condition, individuals are strongly motivated to conform to their social environments, radicalizing their personal beliefs in the process because the overall dissonance is lowest when all beliefs in one's network are extreme. Note. Panels (a)-(e) show the representative illustrations of five types of networks that occur at the end of simulations assuming different combinations of high and low attention to personal, social, and external dissonances (&#946; pers , &#946; soc , and &#946; ext , respectively). Panels (f) and (g) show the variance of focal beliefs, and Panels (h) and (i) their modularity at the end of simulation runs in different conditions. Each point in Panels (f)-(i) is marked by the abbreviation of the network type that is most likely to occur in that case. Error bars indicate 95% confidence intervals. In network illustrations, circles represent individuals with their personal and social beliefs (equivalent to the circles in Figure 1), and edges represent the directed influence of individuals' actual beliefs to the social beliefs of their contacts (each equivalent to the two edges connecting the individual circles in Figure 1). See the online article for the color version of this figure. 34 DALEGE, GALESIC, AND OLSSON (Appendices continue)</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Appendix I Group Radicalization</head><p>We examine the results both through network visualizations and quantitative indicators. Panels (a)-(d) in Figure <ref type="figure">I1</ref> show four different distributions of beliefs in networks observed at the end of our simulations. In the no radicalization moderate network, members have a range of relatively moderate beliefs. In the no radicalization extreme network, members have mostly extreme, but diverse beliefs. In moderate radicalization and extreme radicalization, almost all or all members, respectively, have the same extreme beliefs. For more nuanced results, Panels (e)-(h) provide absolute means of focal beliefs at the end of the two phases of our simulation, for different conditions. The higher those means, the more radicalized the group. Panels (e) and (f) show that, as expected, without group discussion beliefs in all conditions show no group radicalization, with different individuals still holding different beliefs after 100 iterations. The only difference between conditions is that a stronger attention to the consistency of personal beliefs (&#946; pers = 2 vs. 0.5) leads to more extreme personal beliefs (Panels (f) vs. (e) in Figure <ref type="figure">I1</ref>). After group discussion, however, beliefs can radicalize but not necessarily. When attention to personal dissonance is low (&#946; pers = 0.5), high attention to social dissonance (&#946; soc = 2) is sufficient to foster moderate (MR) or extreme (MR) radicalization independently of external dissonance. In other words, when people try to align their personal beliefs with perceived beliefs of others, while disregarding the consistency between their personal beliefs, this will lead to radicalization even if their perceptions do not correspond to the actual beliefs of others. When attention to personal dissonance is high (&#946; pers = 2), high attention to social dissonance (&#946; soc = 2) is not sufficient to overcome the need to align personal beliefs with each other. In that case, high attention to external dissonance (&#946; ext = 2) is also needed to produce at least moderate radicalization.</p><p>NETWORKS OF BELIEFS THEORY 35 (Appendices continue) </p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="2" xml:id="foot_0"><p>DALEGE, GALESIC, AND OLSSON</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="8" xml:id="foot_1"><p>DALEGE, GALESIC, AND OLSSON</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_2"><p>DALEGE, GALESIC, AND OLSSON</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="12" xml:id="foot_3"><p>DALEGE, GALESIC, AND OLSSON</p></note>
		</body>
		</text>
</TEI>
